00010000:00010000:3.0:1789760732.066151:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.066158:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f946748d14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59621376->59625471] (req 59621376->59625471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.066168:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f946748d14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59621376->59625471] (req 59621376->59625471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.066194:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f946748d14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59621376->59625471] (req 59621376->59625471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.066201:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f946748d14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59621376->59625471] (req 59621376->59625471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.067283:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565089792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 20261us (20529us total) trans 4294981864 rc 0/0 00000100:00100000:3.0:1789760732.067303:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14567 00000100:00100000:3.0:1789760732.067315:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670291597294 time 670307286453 state 0x2 ref 0 00000100:00100000:3.0:1789760732.105814:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.119553:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760732.129388:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59633664 -> 59637760 00002000:00010000:3.0:1789760732.129393:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116496 -> 116504 00010000:00010000:3.0:1789760732.129406:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129430:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129445:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129452:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.129456:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129466:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129485:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.129492:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946748d29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59633664->59637759] (req 59633664->59637759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.129581:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565090176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8451us (10033us total) trans 4294981867 rc 0/0 00000100:00100000:3.0:1789760732.129592:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14570 00000100:00100000:3.0:1789760732.129601:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670366526109 time 670381406723 state 0x2 ref 0 00000100:00100000:3.0:1789760732.154095:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670381667139 time 670395131466 state 0x0 ref 1 00000100:00100000:3.0:1789760732.154117:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670395391882 time 670395131466 state 0x1 ref 1 00000100:00100000:3.0:1789760732.154165:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670395391882 time 670414456279 state 0x0 ref 1 00000100:00100000:3.0:1789760732.154186:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565090432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.154256:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59641856, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0x1c720 00010000:00010000:3.0:1789760732.154268:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.154289:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=670s v=(0 0) 00010000:00010000:3.0:1789760732.154295:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.154303:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.154321:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.165976:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59641856 -> 59645952 00002000:00010000:3.0:1789760732.165983:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116512 -> 116520 00010000:00010000:3.0:1789760732.166002:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166099:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166110:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166125:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.166130:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166140:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166167:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.166175:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748d37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59641856->59645951] (req 59641856->59645951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.166338:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565090432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12153us (13001us total) trans 4294981869 rc 0/0 00000100:00100000:3.0:1789760732.166351:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14572 00000100:00100000:3.0:1789760732.166363:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670395391882 time 670414456279 state 0x2 ref 0 00000100:00100000:3.0:1789760732.171159:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565090560 00000100:00100000:3.0:1789760732.171176:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565090560 00000100:00100000:3.0:1789760732.171258:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670395391882 time 670414456279 state 0x0 ref 1 00000100:00100000:3.0:1789760732.171277:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670414716695 time 670414456279 state 0x1 ref 1 00000100:00100000:3.0:1789760732.171311:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670414716695 time 670431602934 state 0x0 ref 1 00000100:00100000:3.0:1789760732.171329:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565090560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.171406:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59645952, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0x1c728 00010000:00010000:3.0:1789760732.171624:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748d3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.171648:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=670s v=(0 0) 00010000:00010000:3.0:1789760732.171653:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.171662:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59645952->59650047] (req 59645952->59650047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.171679:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59645952->59650047] (req 59645952->59650047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.207315:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.220621:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.244908:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.257081:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.285581:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.295859:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.306927:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.315148:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981879 is committed 00000100:00100000:3.0:1789760732.334700:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.348174:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.366094:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.373351:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981882 is committed 00000100:00100000:3.0:1789760732.377861:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.389660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.419321:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.436028:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.463655:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.487211:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.493457:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981888 is committed 00000100:00100000:3.0:1789760732.503214:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.527309:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.547940:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.564693:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.575103:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.587391:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.603989:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.621548:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.636283:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565093888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14160us (14730us total) trans 4294981896 rc 0/0 00000100:00100000:3.0:1789760732.636305:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14599 00000100:00100000:3.0:1789760732.636318:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670866218823 time 670882380626 state 0x2 ref 0 00000100:00100000:3.0:1789760732.662268:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760732.675241:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59760640 -> 59764736 00002000:00010000:3.0:1789760732.675256:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116744 -> 116752 00010000:00010000:3.0:1789760732.675277:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675295:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675313:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675322:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.675329:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675341:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675370:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.675379:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748e02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59760640->59764735] (req 59760640->59764735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.676912:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565094144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14363us (14642us total) trans 4294981898 rc 0/0 00000100:00100000:3.0:1789760732.676929:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14601 00000100:00100000:3.0:1789760732.676943:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670901102640 time 670922813516 state 0x2 ref 0 00000100:00100000:3.0:1789760732.683285:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.691163:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981899 is committed 00000001:00080000:3.0:1789760732.701526:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981900 is committed 00000100:00100000:3.0:1789760732.706476:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.712466:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981901 is committed 00000100:00100000:3.0:1789760732.722282:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.727559:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981902 is committed 00000100:00100000:3.0:1789760732.734910:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 670983063667 time 670995198963 state 0x0 ref 1 00000100:00100000:3.0:1789760732.734931:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565094784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.734996:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59781120, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0x1c830 00010000:00010000:3.0:1789760732.735008:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946748e25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.735026:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=670s v=(0 0) 00010000:00010000:3.0:1789760732.735178:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.735188:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946748e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59781120->59785215] (req 59781120->59785215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.735206:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946748e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59781120->59785215] (req 59781120->59785215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.749117:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760732.755649:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59785216 -> 59789312 00002000:00010000:3.0:1789760732.755656:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116792 -> 116800 00010000:00010000:3.0:1789760732.755674:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755690:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755808:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755818:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.755824:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755835:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755860:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.755935:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f946748e2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59785216->59789311] (req 59785216->59789311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.759530:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760732.765088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981905 is committed 00000001:00080000:3.0:1789760732.792656:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981906 is committed 00000100:00100000:3.0:1789760732.798820:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.863128:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.880831:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565095808 00000100:00100000:3.0:1789760732.880839:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565095808 00000100:00100000:3.0:1789760732.880893:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671106982267 time 671124042767 state 0x0 ref 1 00000100:00100000:3.0:1789760732.880906:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671124303183 time 671124042767 state 0x1 ref 1 00000100:00100000:3.0:1789760732.880930:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671124303183 time 671141222989 state 0x0 ref 1 00000100:00100000:3.0:1789760732.880938:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565095808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.880978:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59813888, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0x1c870 00010000:00010000:3.0:1789760732.880985:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.880998:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760732.881001:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.881011:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.881028:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.890239:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59813888 -> 59817984 00002000:00010000:3.0:1789760732.890244:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116848 -> 116856 00010000:00010000:3.0:1789760732.890258:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890269:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890277:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890290:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.890294:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890302:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890322:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.890331:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59813888->59817983] (req 59813888->59817983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.890460:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565095808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9517us (9786us total) trans 4294981911 rc 0/0 00000100:00100000:3.0:1789760732.890470:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14614 00000100:00100000:3.0:1789760732.890480:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671124303183 time 671141222989 state 0x2 ref 0 00000100:00100000:3.0:1789760732.916180:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565096192 00000100:00100000:3.0:1789760732.916194:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565096192 00000100:00100000:3.0:1789760732.916272:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671154864691 time 671166384347 state 0x0 ref 1 00000100:00100000:3.0:1789760732.916293:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671166644763 time 671166384347 state 0x1 ref 1 00000100:00100000:3.0:1789760732.916353:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671166644763 time 671176644121 state 0x0 ref 1 00000100:00100000:3.0:1789760732.916373:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565096192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.916539:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59826176, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0x1c888 00010000:00010000:3.0:1789760732.916551:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.916572:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760732.916577:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.916585:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.916604:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.923171:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59826176 -> 59830272 00002000:00010000:3.0:1789760732.923177:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116872 -> 116880 00010000:00010000:3.0:1789760732.923195:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923210:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923221:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923229:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.923236:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923246:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923272:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.923281:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59826176->59830271] (req 59826176->59830271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.923421:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565096192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7033us (7416us total) trans 4294981914 rc 0/0 00000100:00100000:3.0:1789760732.923434:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14617 00000100:00100000:3.0:1789760732.923446:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671166644763 time 671176644121 state 0x2 ref 0 00000100:00100000:3.0:1789760732.927222:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760732.937192:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565096448 00000100:00100000:3.0:1789760732.937206:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565096448 00000100:00100000:3.0:1789760732.937285:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671176904537 time 671188203480 state 0x0 ref 1 00000100:00100000:3.0:1789760732.937306:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671188463896 time 671188203480 state 0x1 ref 1 00000100:00100000:3.0:1789760732.937336:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671188463896 time 671197627615 state 0x0 ref 1 00000100:00100000:3.0:1789760732.937351:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565096448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.937433:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59834368, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c898 00010000:00010000:3.0:1789760732.937444:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.937464:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760732.937470:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.937478:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.937494:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.945104:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59834368 -> 59838464 00002000:00010000:3.0:1789760732.945118:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116888 -> 116896 00010000:00010000:3.0:1789760732.945138:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945153:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945163:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945172:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.945178:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945192:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945218:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.945225:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59834368->59838463] (req 59834368->59838463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.945389:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565096448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8033us (8465us total) trans 4294981916 rc 0/0 00000100:00100000:3.0:1789760732.945518:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14619 00000100:00100000:3.0:1789760732.945533:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671188463896 time 671197627615 state 0x2 ref 0 00000100:00100000:3.0:1789760732.949636:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565096576 00000100:00100000:3.0:1789760732.949650:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565096576 00000100:00100000:3.0:1789760732.949763:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671188463896 time 671197627615 state 0x0 ref 1 00000100:00100000:3.0:1789760732.949781:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671197888031 time 671197627615 state 0x1 ref 1 00000100:00100000:3.0:1789760732.949807:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671197888031 time 671210099785 state 0x0 ref 1 00000100:00100000:3.0:1789760732.949822:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565096576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.949889:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59838464, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c8a0 00010000:00010000:3.0:1789760732.949902:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.949926:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760732.949931:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.949940:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59838464->59842559] (req 59838464->59842559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.949958:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946748e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59838464->59842559] (req 59838464->59842559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.974537:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565096832 00000100:00100000:3.0:1789760732.974551:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565096832 00000100:00100000:3.0:1789760732.974630:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671210360201 time 671221457999 state 0x0 ref 1 00000100:00100000:3.0:1789760732.974649:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671221718415 time 671221457999 state 0x1 ref 1 00000100:00100000:3.0:1789760732.974831:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671221718415 time 671235122056 state 0x0 ref 1 00000100:00100000:3.0:1789760732.974846:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565096832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760732.974906:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59846656, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c8b0 00010000:00010000:3.0:1789760732.974917:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.974937:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760732.974942:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.974949:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.974972:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.981135:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59846656 -> 59850752 00002000:00010000:3.0:1789760732.981142:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116912 -> 116920 00010000:00010000:3.0:1789760732.981160:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981176:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981188:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981197:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760732.981203:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981214:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981240:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.981249:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59846656->59850751] (req 59846656->59850751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.981484:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565096832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6634us (7565us total) trans 4294981919 rc 0/0 00000100:00100000:3.0:1789760732.981498:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14622 00000100:00100000:3.0:1789760732.981510:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671221718415 time 671235122056 state 0x2 ref 0 00000100:00100000:3.0:1789760733.025839:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565097216 00000100:00100000:3.0:1789760733.025852:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565097216 00000100:00100000:3.0:1789760733.025931:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671246103879 time 671270816551 state 0x0 ref 1 00000100:00100000:3.0:1789760733.025952:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671271076967 time 671270816551 state 0x1 ref 1 00000100:00100000:3.0:1789760733.026026:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671271076967 time 671286316512 state 0x0 ref 1 00000100:00100000:3.0:1789760733.026041:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565097216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.026125:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59858944, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c8c8 00010000:00010000:3.0:1789760733.026137:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.026155:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760733.026160:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.026167:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59858944->59863039] (req 59858944->59863039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.026183:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946748eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59858944->59863039] (req 59858944->59863039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.044313:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760733.114814:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981926 is committed 00000001:00080000:3.0:1789760733.127570:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981927 is committed 00000001:00080000:3.0:1789760733.190243:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981931 is committed 00000001:00080000:3.0:1789760733.203994:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981932 is committed 00000001:00080000:3.0:1789760733.218245:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981933 is committed 00002000:00010000:3.0:1789760733.561247:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59973632 -> 59977728 00002000:00010000:3.0:1789760733.561255:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117160 -> 117168 00010000:00010000:3.0:1789760733.561274:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561290:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561301:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561310:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.561316:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561325:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561352:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.561366:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946748f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59973632->59977727] (req 59973632->59977727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.561578:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565100800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9034us (9383us total) trans 4294981950 rc 0/0 00000100:00100000:3.0:1789760733.561591:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14653 00000100:00100000:3.0:1789760733.561604:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671784830046 time 671812815929 state 0x2 ref 0 00002000:00010000:3.0:1789760733.614918:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59981824 -> 59985920 00002000:00010000:3.0:1789760733.614924:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117176 -> 117184 00010000:00010000:3.0:1789760733.614941:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615020:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615136:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615146:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.615152:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615163:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615195:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.615203:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f946748f7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59981824->59985919] (req 59981824->59985919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.615320:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565101056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17681us (18912us total) trans 4294981952 rc 0/0 00000100:00100000:3.0:1789760733.615341:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14655 00000100:00100000:3.0:1789760733.615915:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671828040289 time 671857909124 state 0x2 ref 0 00000100:00100000:3.0:1789760733.621968:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565101184 00000100:00100000:3.0:1789760733.621988:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565101184 00000100:00100000:3.0:1789760733.622186:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671828040289 time 671857909124 state 0x0 ref 1 00000100:00100000:3.0:1789760733.622207:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671858169540 time 671857909124 state 0x1 ref 1 00000100:00100000:3.0:1789760733.622317:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671858169540 time 671882607747 state 0x0 ref 1 00000100:00100000:3.0:1789760733.622344:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565101184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.622423:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59985920, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c9c0 00010000:00010000:3.0:1789760733.622435:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.622457:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760733.622464:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.622473:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.622492:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.631886:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59985920 -> 59990016 00002000:00010000:3.0:1789760733.631893:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117184 -> 117192 00010000:00010000:3.0:1789760733.631910:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.631925:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.631937:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.631946:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.631953:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.631964:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.631989:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.632005:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59985920->59990015] (req 59985920->59990015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.632269:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565101184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9932us (12321us total) trans 4294981953 rc 0/0 00000100:00100000:3.0:1789760733.632291:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14656 00000100:00100000:3.0:1789760733.632302:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671858169540 time 671882607747 state 0x2 ref 0 00000100:00100000:3.0:1789760733.664100:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565101440 00000100:00100000:3.0:1789760733.664113:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565101440 00000100:00100000:3.0:1789760733.664202:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671882868163 time 671902918693 state 0x0 ref 1 00000100:00100000:3.0:1789760733.664223:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671903179109 time 671902918693 state 0x1 ref 1 00000100:00100000:3.0:1789760733.664258:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671903179109 time 671924550437 state 0x0 ref 1 00000100:00100000:3.0:1789760733.664272:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565101440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.664334:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59994112, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c9d0 00010000:00010000:3.0:1789760733.664345:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.664363:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760733.664368:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.664375:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59994112->59998207] (req 59994112->59998207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.664396:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946748f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59994112->59998207] (req 59994112->59998207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.690748:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565101568 00000100:00100000:3.0:1789760733.690760:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565101568 00000100:00100000:3.0:1789760733.690830:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671903179109 time 671924550437 state 0x0 ref 1 00000100:00100000:3.0:1789760733.690849:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671924810853 time 671924550437 state 0x1 ref 1 00000100:00100000:3.0:1789760733.690911:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671924810853 time 671951202999 state 0x0 ref 1 00000100:00100000:3.0:1789760733.690923:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565101568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.690977:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59998208, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c9d8 00010000:00010000:3.0:1789760733.690987:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.691003:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789760733.691007:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.691014:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.691031:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.701267:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59998208 -> 60002304 00002000:00010000:3.0:1789760733.701277:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117208 -> 117216 00010000:00010000:3.0:1789760733.701294:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701310:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701321:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701329:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.701336:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701347:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701375:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.701383:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748f98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59998208->60002303] (req 59998208->60002303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.701624:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565101568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10693us (10996us total) trans 4294981956 rc 0/0 00000100:00100000:3.0:1789760733.701637:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14659 00000100:00100000:3.0:1789760733.701650:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671924810853 time 671951202999 state 0x2 ref 0 00000100:00100000:3.0:1789760733.770472:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565101952 00000100:00100000:3.0:1789760733.770488:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565101952 00000100:00100000:3.0:1789760733.770578:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671972595326 time 671991195156 state 0x0 ref 1 00000100:00100000:3.0:1789760733.770650:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671991455572 time 671991195156 state 0x1 ref 1 00000100:00100000:3.0:1789760733.770764:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671991455572 time 672031054505 state 0x0 ref 1 00000100:00100000:3.0:1789760733.770781:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565101952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.770849:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60010496, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1c9f0 00010000:00010000:3.0:1789760733.770870:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.770891:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760733.770896:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.770904:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.770921:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.782986:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60010496 -> 60014592 00002000:00010000:3.0:1789760733.782992:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117232 -> 117240 00010000:00010000:3.0:1789760733.783011:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783033:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783042:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783049:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.783054:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783074:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783099:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.783108:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60010496->60014591] (req 60010496->60014591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.783230:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565101952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12446us (14517us total) trans 4294981959 rc 0/0 00000100:00100000:3.0:1789760733.783242:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14662 00000100:00100000:3.0:1789760733.783263:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 671991455572 time 672031054505 state 0x2 ref 0 00002000:00010000:3.0:1789760733.805191:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60014592 -> 60018688 00002000:00010000:3.0:1789760733.805203:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117240 -> 117248 00010000:00010000:3.0:1789760733.805222:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805238:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805248:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805256:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.805262:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805272:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805301:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.805310:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f946748fb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60014592->60018687] (req 60014592->60018687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.805532:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565102080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14440us (14836us total) trans 4294981960 rc 0/0 00000100:00100000:3.0:1789760733.805545:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14663 00000100:00100000:3.0:1789760733.805557:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672031314921 time 672051287537 state 0x2 ref 0 00000100:00100000:3.0:1789760733.832691:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565102336 00000100:00100000:3.0:1789760733.832740:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565102336 00000100:00100000:3.0:1789760733.832815:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672051547953 time 672071503948 state 0x0 ref 1 00000100:00100000:3.0:1789760733.832834:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672071764364 time 672071503948 state 0x1 ref 1 00000100:00100000:3.0:1789760733.832881:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672071764364 time 672093172693 state 0x0 ref 1 00000100:00100000:3.0:1789760733.832896:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565102336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.832967:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60022784, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1ca08 00010000:00010000:3.0:1789760733.832979:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.833000:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760733.833015:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.833023:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.833040:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.845674:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60022784 -> 60026880 00002000:00010000:3.0:1789760733.845681:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117256 -> 117264 00010000:00010000:3.0:1789760733.845700:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845755:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845766:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845775:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.845781:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845791:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845818:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.845827:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60022784->60026879] (req 60022784->60026879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.846033:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565102336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13132us (13437us total) trans 4294981962 rc 0/0 00000100:00100000:3.0:1789760733.846046:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14665 00000100:00100000:3.0:1789760733.846066:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672071764364 time 672093172693 state 0x2 ref 0 00000100:00100000:3.0:1789760733.859787:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565102464 00000100:00100000:3.0:1789760733.859801:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565102464 00000100:00100000:3.0:1789760733.859880:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672071764364 time 672093172693 state 0x0 ref 1 00000100:00100000:3.0:1789760733.859898:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672093433109 time 672093172693 state 0x1 ref 1 00000100:00100000:3.0:1789760733.859969:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672093433109 time 672120260124 state 0x0 ref 1 00000100:00100000:3.0:1789760733.859983:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565102464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.860054:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60026880, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1ca10 00010000:00010000:3.0:1789760733.860075:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.860095:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760733.860099:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.860120:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60026880->60030975] (req 60026880->60030975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.860138:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946748fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60026880->60030975] (req 60026880->60030975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.896855:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565102720 00000100:00100000:3.0:1789760733.896869:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565102720 00000100:00100000:3.0:1789760733.896955:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672120520540 time 672139896260 state 0x0 ref 1 00000100:00100000:3.0:1789760733.896974:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672140156676 time 672139896260 state 0x1 ref 1 00000100:00100000:3.0:1789760733.897000:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672140156676 time 672157291654 state 0x0 ref 1 00000100:00100000:3.0:1789760733.897019:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565102720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.897100:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60035072, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0x1ca20 00010000:00010000:3.0:1789760733.899732:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.899765:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760733.899771:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.899780:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.899799:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.915733:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60035072 -> 60039168 00002000:00010000:3.0:1789760733.915746:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117280 -> 117288 00010000:00010000:3.0:1789760733.915766:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915782:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915793:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915802:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.915810:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915820:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915847:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.915857:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748fd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60035072->60039167] (req 60035072->60039167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.966467:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580057728:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.966528:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d429c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580057984:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.966558:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760733.966654:0:6954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580057984 00000100:00100000:3.0:1789760733.966664:0:6954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580057984 00000100:00100000:3.0:1789760733.966763:0:6954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760733.966777:0:6954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580057984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.966841:0:6954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580057984:12345-0@lo:400:kworker.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.966850:0:6954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789760733.966875:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760733.966916:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d429c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580057984:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967241:0:5966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580057856 00000100:00100000:3.0:1789760733.967246:0:5966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580057856 00000100:00100000:3.0:1789760733.967297:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789760733.967304:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580057856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967348:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580057856:12345-0@lo:400:kworker.0 Request processed in 45us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.967354:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789760733.967388:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760733.967411:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d429c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580058240:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967433:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760733.967457:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760733.967462:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580057600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967486:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760733.967506:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d429c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580058112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967527:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760733.967553:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580057728 00000100:00100000:3.0:1789760733.967558:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580057728 00000100:00100000:3.0:1789760733.967583:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580058112 00000100:00100000:3.0:1789760733.967586:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580058112 00000100:00100000:3.0:1789760733.967607:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789760733.967613:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580057728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967645:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580057728:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.967651:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789760733.967661:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789760733.967666:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580058112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967687:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580058112:12345-0@lo:400:kworker.0 Request processed in 22us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.967697:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789760733.967737:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580058240 00000100:00100000:3.0:1789760733.967741:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580058240 00000100:00100000:3.0:1789760733.967771:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760733.967777:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580058240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967807:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580058240:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.967812:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760733.967829:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580057600 00000100:00100000:3.0:1789760733.967833:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580057600 00000100:00100000:3.0:1789760733.967858:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789760733.967864:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f58a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580057600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967896:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f58a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580057600:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.967902:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789760733.967951:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580057600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967962:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d429c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580058112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967970:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580057728:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.967977:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d429c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580058240:0@lo:400:kworker.0 00000100:00100000:3.0:1789760733.972538:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580058368 00000100:00100000:3.0:1789760733.972549:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580058368 00000100:00100000:3.0:1789760733.972613:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789760733.972623:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580058368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760733.972660:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760733.976906:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580058368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4269us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.976924:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789760733.990047:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565103232 00000100:00100000:3.0:1789760733.990068:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565103232 00000100:00100000:3.0:1789760733.990150:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672214347164 time 672237480781 state 0x0 ref 1 00000100:00100000:3.0:1789760733.990169:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672237741197 time 672237480781 state 0x1 ref 1 00000100:00100000:3.0:1789760733.990201:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672237741197 time 672250492739 state 0x0 ref 1 00000100:00100000:3.0:1789760733.990214:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565103232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760733.990272:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60051456, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1ca40 00010000:00010000:3.0:1789760733.990281:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.990298:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760733.990303:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.990310:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.990326:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760733.999195:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60051456 -> 60055552 00002000:00010000:3.0:1789760733.999202:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117312 -> 117320 00010000:00010000:3.0:1789760733.999219:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999235:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999245:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999253:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760733.999258:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999269:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999294:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.999302:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946748ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60051456->60055551] (req 60051456->60055551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.999443:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565103232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9222us (9493us total) trans 4294981969 rc 0/0 00000100:00100000:3.0:1789760733.999456:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14672 00000100:00100000:3.0:1789760733.999469:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672237741197 time 672250492739 state 0x2 ref 0 00000100:00100000:3.0:1789760734.039227:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565103616 00000100:00100000:3.0:1789760734.039240:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565103616 00000100:00100000:3.0:1789760734.039311:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672264338794 time 672280916584 state 0x0 ref 1 00000100:00100000:3.0:1789760734.039340:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672281177000 time 672280916584 state 0x1 ref 1 00000100:00100000:3.0:1789760734.039374:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672281177000 time 672299665542 state 0x0 ref 1 00000100:00100000:3.0:1789760734.039388:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565103616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.039455:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60063744, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1ca58 00010000:00010000:3.0:1789760734.039466:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.039485:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.039490:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.039497:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.039513:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.048758:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60063744 -> 60067840 00002000:00010000:3.0:1789760734.048764:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117336 -> 117344 00010000:00010000:3.0:1789760734.048781:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048795:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048812:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048820:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.048826:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048837:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048860:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.048869:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60063744->60067839] (req 60063744->60067839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.049033:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565103616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9640us (9902us total) trans 4294981972 rc 0/0 00000100:00100000:3.0:1789760734.049044:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14675 00000100:00100000:3.0:1789760734.049066:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672281177000 time 672299665542 state 0x2 ref 0 00000100:00100000:3.0:1789760734.081974:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565104000 00000100:00100000:3.0:1789760734.081988:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565104000 00000100:00100000:3.0:1789760734.082073:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672317920112 time 672328529916 state 0x0 ref 1 00000100:00100000:3.0:1789760734.082092:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672328790332 time 672328529916 state 0x1 ref 1 00000100:00100000:3.0:1789760734.082138:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672328790332 time 672342429299 state 0x0 ref 1 00000100:00100000:3.0:1789760734.082153:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565104000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.082216:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60076032, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1ca70 00010000:00010000:3.0:1789760734.082229:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.082249:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.082254:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.082261:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.082277:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.089193:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60076032 -> 60080128 00002000:00010000:3.0:1789760734.089199:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117360 -> 117368 00010000:00010000:3.0:1789760734.089216:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089231:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089242:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089256:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.089262:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089272:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089296:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.089303:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674901d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60076032->60080127] (req 60076032->60080127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.089567:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565104000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7410us (7952us total) trans 4294981975 rc 0/0 00000100:00100000:3.0:1789760734.089579:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14678 00000100:00100000:3.0:1789760734.089592:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672328790332 time 672342429299 state 0x2 ref 0 00000100:00100000:3.0:1789760734.128987:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565104384 00000100:00100000:3.0:1789760734.129001:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565104384 00000100:00100000:3.0:1789760734.129088:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672357150909 time 672374794060 state 0x0 ref 1 00000100:00100000:3.0:1789760734.129106:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672375054476 time 672374794060 state 0x1 ref 1 00000100:00100000:3.0:1789760734.129141:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672375054476 time 672389432666 state 0x0 ref 1 00000100:00100000:3.0:1789760734.129160:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565104384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.129224:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60088320, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1ca88 00010000:00010000:3.0:1789760734.129237:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.129258:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.129263:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.129271:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.129287:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.137689:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60088320 -> 60092416 00002000:00010000:3.0:1789760734.137745:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117384 -> 117392 00010000:00010000:3.0:1789760734.137764:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137779:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137788:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137795:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.137802:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137811:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137837:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.137844:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749032 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60088320->60092415] (req 60088320->60092415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.137972:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565104384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8808us (9094us total) trans 4294981978 rc 0/0 00000100:00100000:3.0:1789760734.137985:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14681 00000100:00100000:3.0:1789760734.137998:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672375054476 time 672389432666 state 0x2 ref 0 00000100:00100000:3.0:1789760734.169292:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565104768 00000100:00100000:3.0:1789760734.169310:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565104768 00000100:00100000:3.0:1789760734.169654:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672405813344 time 672420174524 state 0x0 ref 1 00000100:00100000:3.0:1789760734.169676:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672420434940 time 672420174524 state 0x1 ref 1 00000100:00100000:3.0:1789760734.170263:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672420434940 time 672430548944 state 0x0 ref 1 00000100:00100000:3.0:1789760734.170286:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565104768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.170378:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60100608, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1caa0 00010000:00010000:3.0:1789760734.170390:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.170411:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.170416:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.170424:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.170441:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.180791:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60100608 -> 60104704 00002000:00010000:3.0:1789760734.180799:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117408 -> 117416 00010000:00010000:3.0:1789760734.180876:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180891:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180901:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180910:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.180916:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180926:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180953:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.180963:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60100608->60104703] (req 60100608->60104703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.181209:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565104768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10921us (12171us total) trans 4294981981 rc 0/0 00000100:00100000:3.0:1789760734.181221:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14684 00000100:00100000:3.0:1789760734.181235:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672420434940 time 672430548944 state 0x2 ref 0 00000100:00100000:3.0:1789760734.207213:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565105152 00000100:00100000:3.0:1789760734.207226:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565105152 00000100:00100000:3.0:1789760734.207303:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672445752445 time 672455832386 state 0x0 ref 1 00000100:00100000:3.0:1789760734.207324:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672456092802 time 672455832386 state 0x1 ref 1 00000100:00100000:3.0:1789760734.207506:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672456092802 time 672467796839 state 0x0 ref 1 00000100:00100000:3.0:1789760734.207523:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565105152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.207587:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60112896, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cab8 00010000:00010000:3.0:1789760734.207600:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.207622:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.207629:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.207637:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.207656:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.212701:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60112896 -> 60116992 00002000:00010000:3.0:1789760734.212737:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117432 -> 117440 00010000:00010000:3.0:1789760734.212755:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212771:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212780:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212788:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.212793:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212804:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212827:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.212841:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674905c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60112896->60116991] (req 60112896->60116991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.213085:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565105152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5559us (5981us total) trans 4294981984 rc 0/0 00000100:00100000:3.0:1789760734.213098:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14687 00000100:00100000:3.0:1789760734.213111:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672456092802 time 672467796839 state 0x2 ref 0 00000001:00080000:3.0:1789760734.225673:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981985 is committed 00000001:00080000:3.0:1789760734.242668:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981986 is committed 00000100:00100000:3.0:1789760734.248767:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565105536 00000100:00100000:3.0:1789760734.248783:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565105536 00000100:00100000:3.0:1789760734.248867:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672478674842 time 672497910642 state 0x0 ref 1 00000100:00100000:3.0:1789760734.248887:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672498171058 time 672497910642 state 0x1 ref 1 00000100:00100000:3.0:1789760734.248926:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672498171058 time 672509217241 state 0x0 ref 1 00000100:00100000:3.0:1789760734.248940:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565105536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.249007:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60125184, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cad0 00010000:00010000:3.0:1789760734.249019:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.249045:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.249051:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.249075:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.249094:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.256197:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60125184 -> 60129280 00002000:00010000:3.0:1789760734.256205:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117456 -> 117464 00010000:00010000:3.0:1789760734.256231:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256248:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256259:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256268:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.256274:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256285:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256311:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.256327:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749071 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60125184->60129279] (req 60125184->60129279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.256454:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565105536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7510us (7912us total) trans 4294981987 rc 0/0 00000100:00100000:3.0:1789760734.256466:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14690 00000100:00100000:3.0:1789760734.256479:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672498171058 time 672509217241 state 0x2 ref 0 00000001:00080000:3.0:1789760734.266560:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981988 is committed 00000100:00100000:3.0:1789760734.283976:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565105920 00000100:00100000:3.0:1789760734.283990:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565105920 00000100:00100000:3.0:1789760734.284145:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672521893122 time 672533194321 state 0x0 ref 1 00000100:00100000:3.0:1789760734.284164:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672533454737 time 672533194321 state 0x1 ref 1 00000100:00100000:3.0:1789760734.284254:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672533454737 time 672544544615 state 0x0 ref 1 00000100:00100000:3.0:1789760734.284269:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565105920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.284333:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60137472, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cae8 00010000:00010000:3.0:1789760734.284344:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.284364:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.284369:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.284377:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60137472->60141567] (req 60137472->60141567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.284395:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60137472->60141567] (req 60137472->60141567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.368894:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672591353739 time 672609739246 state 0x0 ref 1 00000100:00100000:3.0:1789760734.368918:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672609999662 time 672609739246 state 0x1 ref 1 00000100:00100000:3.0:1789760734.368971:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672609999662 time 672629262731 state 0x0 ref 1 00000100:00100000:3.0:1789760734.368990:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565106560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.369067:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60157952, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb10 00010000:00010000:3.0:1789760734.369077:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.369097:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.369103:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.369119:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60157952->60162047] (req 60157952->60162047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.369137:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60157952->60162047] (req 60157952->60162047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760734.376073:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981995 is committed 00000001:00080000:3.0:1789760734.389327:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981996 is committed 00000001:00080000:3.0:1789760734.403615:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294981997 is committed 00000100:00100000:3.0:1789760734.415853:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565106944 00000100:00100000:3.0:1789760734.415866:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565106944 00000100:00100000:3.0:1789760734.415942:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672644598788 time 672658651966 state 0x0 ref 1 00000100:00100000:3.0:1789760734.415962:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672658912382 time 672658651966 state 0x1 ref 1 00000100:00100000:3.0:1789760734.416096:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672658912382 time 672676386518 state 0x0 ref 1 00000100:00100000:3.0:1789760734.416112:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565106944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.416170:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60170240, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb28 00010000:00010000:3.0:1789760734.416182:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.416201:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.416206:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.416214:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60170240->60174335] (req 60170240->60174335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.416230:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60170240->60174335] (req 60170240->60174335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.463142:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60182528, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb40 00010000:00010000:3.0:1789760734.463159:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.463177:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.463181:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.463188:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.463201:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.471303:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60182528 -> 60186624 00002000:00010000:3.0:1789760734.471312:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117568 -> 117576 00010000:00010000:3.0:1789760734.471332:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471348:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471359:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471367:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.471373:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471383:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471476:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.471492:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60182528->60186623] (req 60182528->60186623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.474178:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565107328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13199us (16212us total) trans 4294982001 rc 0/0 00000100:00100000:3.0:1789760734.474199:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14704 00000100:00100000:3.0:1789760734.474214:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672703666956 time 672721239015 state 0x2 ref 0 00000100:00100000:3.0:1789760734.486257:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760734.501999:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565107584 00000100:00100000:3.0:1789760734.502027:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565107584 00000100:00100000:3.0:1789760734.502119:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672721499431 time 672747096063 state 0x0 ref 1 00000100:00100000:3.0:1789760734.502139:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672747356479 time 672747096063 state 0x1 ref 1 00000100:00100000:3.0:1789760734.502177:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672747356479 time 672762468244 state 0x0 ref 1 00000100:00100000:3.0:1789760734.502193:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565107584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.502263:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60190720, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb50 00010000:00010000:3.0:1789760734.502275:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.502306:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.502312:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.502320:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.502338:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.509986:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60190720 -> 60194816 00002000:00010000:3.0:1789760734.510175:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117584 -> 117592 00010000:00010000:3.0:1789760734.510195:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510211:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510222:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510230:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.510236:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510246:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510273:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.510282:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60190720->60194815] (req 60190720->60194815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.514031:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565107584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11821us (12830us total) trans 4294982003 rc 0/0 00000100:00100000:3.0:1789760734.514051:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14706 00000100:00100000:3.0:1789760734.514075:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672747356479 time 672762468244 state 0x2 ref 0 00000100:00100000:3.0:1789760734.514609:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565107712 00000100:00100000:3.0:1789760734.514620:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565107712 00000100:00100000:3.0:1789760734.514684:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672747356479 time 672762468244 state 0x0 ref 1 00000100:00100000:3.0:1789760734.514845:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672762728660 time 672762468244 state 0x1 ref 1 00000100:00100000:3.0:1789760734.514879:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672762728660 time 672775170946 state 0x0 ref 1 00000100:00100000:3.0:1789760734.514893:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565107712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.514960:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60194816, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb58 00010000:00010000:3.0:1789760734.514972:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.515000:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.515006:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.515014:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.515032:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.521328:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60194816 -> 60198912 00002000:00010000:3.0:1789760734.521335:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117592 -> 117600 00010000:00010000:3.0:1789760734.521353:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521368:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521378:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521386:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.521392:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521412:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521439:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.521448:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60194816->60198911] (req 60194816->60198911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.521575:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565107712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6679us (7049us total) trans 4294982004 rc 0/0 00000100:00100000:3.0:1789760734.521682:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14707 00000100:00100000:3.0:1789760734.521876:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672762728660 time 672775170946 state 0x2 ref 0 00000100:00100000:3.0:1789760734.543438:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565107968 00000100:00100000:3.0:1789760734.543452:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565107968 00000100:00100000:3.0:1789760734.543546:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672775431362 time 672790468623 state 0x0 ref 1 00000100:00100000:3.0:1789760734.543570:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672790729039 time 672790468623 state 0x1 ref 1 00000100:00100000:3.0:1789760734.543611:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672790729039 time 672803902163 state 0x0 ref 1 00000100:00100000:3.0:1789760734.543627:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565107968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.543741:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60203008, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb68 00010000:00010000:3.0:1789760734.543753:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.543773:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.543779:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.543787:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.543815:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.549807:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60203008 -> 60207104 00002000:00010000:3.0:1789760734.549814:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117608 -> 117616 00010000:00010000:3.0:1789760734.549835:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549851:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549860:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549869:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.549874:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549884:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549910:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.549919:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467490f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60203008->60207103] (req 60203008->60207103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.550467:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565107968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6832us (7223us total) trans 4294982006 rc 0/0 00000100:00100000:3.0:1789760734.551296:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14709 00000100:00100000:3.0:1789760734.551320:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672790729039 time 672803902163 state 0x2 ref 0 00000100:00100000:3.0:1789760734.555336:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565108096 00000100:00100000:3.0:1789760734.555350:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565108096 00000100:00100000:3.0:1789760734.555439:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672790729039 time 672803902163 state 0x0 ref 1 00000100:00100000:3.0:1789760734.555457:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672804162579 time 672803902163 state 0x1 ref 1 00000100:00100000:3.0:1789760734.555499:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672804162579 time 672815790937 state 0x0 ref 1 00000100:00100000:3.0:1789760734.555516:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565108096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.555583:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60207104, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb70 00010000:00010000:3.0:1789760734.555595:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.555616:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.555620:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.555628:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.555645:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.562182:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60207104 -> 60211200 00002000:00010000:3.0:1789760734.562194:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117616 -> 117624 00010000:00010000:3.0:1789760734.562214:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562237:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562247:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562256:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.562262:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562272:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562299:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.562308:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467490fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60207104->60211199] (req 60207104->60211199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.563002:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565108096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7472us (7765us total) trans 4294982007 rc 0/0 00000100:00100000:3.0:1789760734.563018:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14710 00000100:00100000:3.0:1789760734.563030:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672804162579 time 672815790937 state 0x2 ref 0 00000100:00100000:3.0:1789760734.583606:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565108352 00000100:00100000:3.0:1789760734.583621:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565108352 00000100:00100000:3.0:1789760734.583885:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672816051353 time 672831296861 state 0x0 ref 1 00000100:00100000:3.0:1789760734.583907:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672831557277 time 672831296861 state 0x1 ref 1 00000100:00100000:3.0:1789760734.583939:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672831557277 time 672844231343 state 0x0 ref 1 00000100:00100000:3.0:1789760734.583954:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565108352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.584073:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60215296, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb80 00010000:00010000:3.0:1789760734.584086:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674910b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.584106:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.584112:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.584120:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60215296->60219391] (req 60215296->60219391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.584137:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60215296->60219391] (req 60215296->60219391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.599262:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565108480 00000100:00100000:3.0:1789760734.599276:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565108480 00000100:00100000:3.0:1789760734.599354:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672831557277 time 672844231343 state 0x0 ref 1 00000100:00100000:3.0:1789760734.599374:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672844491759 time 672844231343 state 0x1 ref 1 00000100:00100000:3.0:1789760734.599619:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672844491759 time 672859908914 state 0x0 ref 1 00000100:00100000:3.0:1789760734.599639:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565108480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.600242:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60219392, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb88 00010000:00010000:3.0:1789760734.600258:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.600280:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.600286:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.600295:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60219392->60223487] (req 60219392->60223487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.600313:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60219392->60223487] (req 60219392->60223487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760734.605795:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982010 is committed 00000100:00100000:3.0:1789760734.610455:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565108608 00000100:00100000:3.0:1789760734.610468:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565108608 00000100:00100000:3.0:1789760734.610557:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672844491759 time 672859908914 state 0x0 ref 1 00000100:00100000:3.0:1789760734.610576:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672860169330 time 672859908914 state 0x1 ref 1 00000100:00100000:3.0:1789760734.610610:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672860169330 time 672870901980 state 0x0 ref 1 00000100:00100000:3.0:1789760734.610625:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565108608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.610686:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60223488, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cb90 00010000:00010000:3.0:1789760734.610697:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749119 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.610758:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=672s v=(0 0) 00010000:00010000:3.0:1789760734.610764:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.610772:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749119 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60223488->60227583] (req 60223488->60227583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.610789:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749119 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60223488->60227583] (req 60223488->60227583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760734.615964:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982011 is committed 00000100:00100000:3.0:1789760734.644669:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760734.655371:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60235776 -> 60239872 00002000:00010000:3.0:1789760734.655378:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117672 -> 117680 00010000:00010000:3.0:1789760734.655396:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655422:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655433:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655441:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.655447:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655457:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655485:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.655494:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674912e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60235776->60239871] (req 60235776->60239871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.655628:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565108992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9605us (10963us total) trans 4294982014 rc 0/0 00000100:00100000:3.0:1789760734.655645:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14717 00000100:00100000:3.0:1789760734.655659:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 672894232413 time 672906284133 state 0x2 ref 0 00000100:00100000:3.0:1789760734.700677:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760734.730373:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982018 is committed 00000001:00080000:3.0:1789760734.755599:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982019 is committed 00000100:00100000:3.0:1789760734.764557:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760734.790250:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982021 is committed 00000001:00080000:3.0:1789760734.818595:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982022 is committed 00000100:00100000:3.0:1789760734.831371:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760734.880585:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60280832 -> 60284928 00002000:00010000:3.0:1789760734.880591:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117760 -> 117768 00010000:00010000:3.0:1789760734.880610:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880627:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880642:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880651:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.880657:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880666:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880690:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.880698:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674917b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60280832->60284927] (req 60280832->60284927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.880873:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565110400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9678us (11425us total) trans 4294982025 rc 0/0 00000100:00100000:3.0:1789760734.880886:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14728 00000100:00100000:3.0:1789760734.880898:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673113769997 time 673131466495 state 0x2 ref 0 00000100:00100000:3.0:1789760734.891222:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760734.902914:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60284928 -> 60289024 00002000:00010000:3.0:1789760734.902921:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117768 -> 117776 00010000:00010000:3.0:1789760734.902939:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.902955:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.902965:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.902974:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.902980:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.903068:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.903097:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.903105:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f946749182 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60284928->60289023] (req 60284928->60289023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.903365:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565110528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11671us (12151us total) trans 4294982026 rc 0/0 00000100:00100000:3.0:1789760734.903378:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14729 00000100:00100000:3.0:1789760734.903390:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673131726911 time 673151965492 state 0x2 ref 0 00000100:00100000:3.0:1789760734.932118:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565110784 00000100:00100000:3.0:1789760734.932135:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565110784 00000100:00100000:3.0:1789760734.932217:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673152225908 time 673169637584 state 0x0 ref 1 00000100:00100000:3.0:1789760734.932237:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673169898000 time 673169637584 state 0x1 ref 1 00000100:00100000:3.0:1789760734.932285:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673169898000 time 673192576906 state 0x0 ref 1 00000100:00100000:3.0:1789760734.932299:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565110784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.932366:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60293120, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0x1cc18 00010000:00010000:3.0:1789760734.932377:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.932407:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760734.932413:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.932422:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.932440:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760734.941242:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60293120 -> 60297216 00002000:00010000:3.0:1789760734.941247:0:6957:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760734 -> 1789760735 00002000:00010000:3.0:1789760734.941249:0:6957:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760734 -> 1789760735 00002000:00010000:3.0:1789760734.941251:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117784 -> 117792 00010000:00010000:3.0:1789760734.941267:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941285:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941294:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941301:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760734.941307:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941317:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941343:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.941350:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749190 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60293120->60297215] (req 60293120->60297215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.941479:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565110784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9176us (10518us total) trans 4294982028 rc 0/0 00000100:00100000:3.0:1789760734.941491:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14731 00000100:00100000:3.0:1789760734.941502:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673169898000 time 673192576906 state 0x2 ref 0 00000100:00100000:3.0:1789760734.949203:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760734.981836:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982030 is committed 00000100:00100000:3.0:1789760734.992950:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565111168 00000100:00100000:3.0:1789760734.993639:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565111168 00000100:00100000:3.0:1789760734.993776:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673210188706 time 673228315975 state 0x0 ref 1 00000100:00100000:3.0:1789760734.993796:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673228576391 time 673228315975 state 0x1 ref 1 00000100:00100000:3.0:1789760734.994097:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673228576391 time 673254386254 state 0x0 ref 1 00000100:00100000:3.0:1789760734.994116:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565111168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760734.994183:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60305408, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cc30 00010000:00010000:3.0:1789760734.994195:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.994215:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760734.994221:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.994229:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.994249:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.003180:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60305408 -> 60309504 00002000:00010000:3.0:1789760735.003188:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117808 -> 117816 00010000:00010000:3.0:1789760735.003206:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003227:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003237:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003245:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.003251:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003262:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003289:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.003296:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60305408->60309503] (req 60305408->60309503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.003469:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565111168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9351us (11139us total) trans 4294982031 rc 0/0 00000100:00100000:3.0:1789760735.003494:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14734 00000100:00100000:3.0:1789760735.003507:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673228576391 time 673254386254 state 0x2 ref 0 00000100:00100000:3.0:1789760735.011225:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.019172:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982032 is committed 00000001:00080000:3.0:1789760735.053119:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982033 is committed 00000100:00100000:3.0:1789760735.059700:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565111552 00000100:00100000:3.0:1789760735.059831:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565111552 00000100:00100000:3.0:1789760735.059906:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673272057267 time 673305696948 state 0x0 ref 1 00000100:00100000:3.0:1789760735.059926:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673305957364 time 673305696948 state 0x1 ref 1 00000100:00100000:3.0:1789760735.060020:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673305957364 time 673320310579 state 0x0 ref 1 00000100:00100000:3.0:1789760735.060035:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565111552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.060107:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60317696, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cc48 00010000:00010000:3.0:1789760735.060120:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.060141:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760735.060147:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.060155:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.060171:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.067373:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60317696 -> 60321792 00002000:00010000:3.0:1789760735.067379:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117832 -> 117840 00010000:00010000:3.0:1789760735.067501:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067524:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067535:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067544:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.067551:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067561:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067587:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.067597:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f9467491ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60317696->60321791] (req 60317696->60321791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.068107:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565111552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8065us (8548us total) trans 4294982034 rc 0/0 00000100:00100000:3.0:1789760735.068120:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14737 00000100:00100000:3.0:1789760735.068132:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673305957364 time 673320310579 state 0x2 ref 0 00000100:00100000:3.0:1789760735.072596:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.078886:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982035 is committed 00000001:00080000:3.0:1789760735.092964:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982036 is committed 00000100:00100000:3.0:1789760735.098324:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565111936 00000100:00100000:3.0:1789760735.098338:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565111936 00000100:00100000:3.0:1789760735.098427:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673333439793 time 673346184379 state 0x0 ref 1 00000100:00100000:3.0:1789760735.098448:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673346444795 time 673346184379 state 0x1 ref 1 00000100:00100000:3.0:1789760735.098475:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673346444795 time 673358767684 state 0x0 ref 1 00000100:00100000:3.0:1789760735.098490:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565111936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.098566:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60329984, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cc60 00010000:00010000:3.0:1789760735.098581:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f9467491cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.098606:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760735.098612:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.098621:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f9467491cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60329984->60334079] (req 60329984->60334079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.098643:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f9467491cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60329984->60334079] (req 60329984->60334079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760735.105601:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982037 is committed 00000100:00100000:3.0:1789760735.112820:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.122936:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982038 is committed 00000100:00100000:3.0:1789760735.160296:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.207137:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982043 is committed 00000001:00080000:3.0:1789760735.240565:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982044 is committed 00002000:00010000:3.0:1789760735.297124:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60370944 -> 60375040 00002000:00010000:3.0:1789760735.297133:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117936 -> 117944 00010000:00010000:3.0:1789760735.297150:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297165:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297176:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297184:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.297190:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297200:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297225:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.297234:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f946749215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60370944->60375039] (req 60370944->60375039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.298205:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565113216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11935us (14364us total) trans 4294982047 rc 0/0 00000100:00100000:3.0:1789760735.298226:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14750 00000100:00100000:3.0:1789760735.298240:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673525440396 time 673546533358 state 0x2 ref 0 00000100:00100000:3.0:1789760735.342907:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565113600 00000100:00100000:3.0:1789760735.342920:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565113600 00000100:00100000:3.0:1789760735.343226:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673570856649 time 673589580275 state 0x0 ref 1 00000100:00100000:3.0:1789760735.343247:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673589840691 time 673589580275 state 0x1 ref 1 00000100:00100000:3.0:1789760735.343282:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673589840691 time 673603574157 state 0x0 ref 1 00000100:00100000:3.0:1789760735.343297:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565113600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.343436:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60383232, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1ccc8 00010000:00010000:3.0:1789760735.343449:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.343471:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760735.343477:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.343486:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.343504:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.354951:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60383232 -> 60387328 00002000:00010000:3.0:1789760735.354958:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 117960 -> 117968 00010000:00010000:3.0:1789760735.354998:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355015:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355025:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355033:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.355039:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355057:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355081:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.355090:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674922a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60383232->60387327] (req 60383232->60387327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.355223:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565113600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11922us (13180us total) trans 4294982050 rc 0/0 00000100:00100000:3.0:1789760735.355236:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14753 00000100:00100000:3.0:1789760735.355251:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673589840691 time 673603574157 state 0x2 ref 0 00000100:00100000:3.0:1789760735.372634:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760735.389865:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565113984 00000100:00100000:3.0:1789760735.389878:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565113984 00000100:00100000:3.0:1789760735.389953:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673620344550 time 673633155572 state 0x0 ref 1 00000100:00100000:3.0:1789760735.390097:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673633415988 time 673633155572 state 0x1 ref 1 00000100:00100000:3.0:1789760735.390138:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673633415988 time 673650430022 state 0x0 ref 1 00000100:00100000:3.0:1789760735.390154:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565113984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.390227:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60395520, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cce0 00010000:00010000:3.0:1789760735.390239:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674923f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.390259:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760735.390264:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.390273:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674923f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60395520->60399615] (req 60395520->60399615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.390290:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674923f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60395520->60399615] (req 60395520->60399615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760735.398925:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982053 is committed 00000100:00100000:3.0:1789760735.418155:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.442501:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982056 is committed 00000100:00100000:3.0:1789760735.458893:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.498236:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982060 is committed 00000001:00080000:3.0:1789760735.519176:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982061 is committed 00000100:00100000:3.0:1789760735.547590:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760735.637135:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760735.637196:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760735.637235:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760735.641817:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760735.653268:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760735.672094:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60456960 -> 60461056 00002000:00010000:3.0:1789760735.672111:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118104 -> 118112 00010000:00010000:3.0:1789760735.672130:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672145:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672155:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672164:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.672170:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672180:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672207:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.672224:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f9467492a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60456960->60461055] (req 60456960->60461055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.672482:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565116288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15480us (19221us total) trans 4294982068 rc 0/0 00000100:00100000:3.0:1789760735.672496:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14771 00000100:00100000:3.0:1789760735.672509:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673902807117 time 673917274645 state 0x2 ref 0 00000100:00100000:3.0:1789760735.723352:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565116672 00000100:00100000:3.0:1789760735.723367:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565116672 00000100:00100000:3.0:1789760735.723867:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673943449672 time 673964106736 state 0x0 ref 1 00000100:00100000:3.0:1789760735.723888:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673964367152 time 673964106736 state 0x1 ref 1 00000100:00100000:3.0:1789760735.723923:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673964367152 time 673984214760 state 0x0 ref 1 00000100:00100000:3.0:1789760735.723940:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565116672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.724488:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60469248, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cd70 00010000:00010000:3.0:1789760735.724502:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.724523:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1789760735.724528:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.724536:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.724829:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.731807:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60469248 -> 60473344 00002000:00010000:3.0:1789760735.731815:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118128 -> 118136 00010000:00010000:3.0:1789760735.731836:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731854:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731866:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731875:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.731881:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731892:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731922:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.731931:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60469248->60473343] (req 60469248->60473343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.732185:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565116672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8239us (8936us total) trans 4294982071 rc 0/0 00000100:00100000:3.0:1789760735.732211:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14774 00000100:00100000:3.0:1789760735.732225:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 673964367152 time 673984214760 state 0x2 ref 0 00000100:00100000:3.0:1789760735.772272:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565117056 00000100:00100000:3.0:1789760735.772290:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565117056 00000100:00100000:3.0:1789760735.772375:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674001008285 time 674020120181 state 0x0 ref 1 00000100:00100000:3.0:1789760735.772406:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674020380597 time 674020120181 state 0x1 ref 1 00000100:00100000:3.0:1789760735.772668:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674020380597 time 674032957855 state 0x0 ref 1 00000100:00100000:3.0:1789760735.772685:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565117056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.772772:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60481536, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cd88 00010000:00010000:3.0:1789760735.772784:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.772804:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1789760735.772810:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.772818:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60481536->60485631] (req 60481536->60485631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.772834:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f9467492d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60481536->60485631] (req 60481536->60485631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760735.788188:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982074 is committed 00000100:00100000:3.0:1789760735.796181:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565117184 00000100:00100000:3.0:1789760735.796196:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565117184 00000100:00100000:3.0:1789760735.796279:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674020380597 time 674032957855 state 0x0 ref 1 00000100:00100000:3.0:1789760735.796301:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674033218271 time 674032957855 state 0x1 ref 1 00000100:00100000:3.0:1789760735.796335:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674033218271 time 674056626690 state 0x0 ref 1 00000100:00100000:3.0:1789760735.796362:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565117184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.796444:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60485632, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cd90 00010000:00010000:3.0:1789760735.796456:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.796476:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1789760735.796482:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.796491:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.796509:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.808296:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60485632 -> 60489728 00002000:00010000:3.0:1789760735.808302:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118160 -> 118168 00010000:00010000:3.0:1789760735.808319:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808334:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808345:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808354:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760735.808360:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808385:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808618:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.808628:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60485632->60489727] (req 60485632->60489727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.808821:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565117184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12456us (13059us total) trans 4294982075 rc 0/0 00000100:00100000:3.0:1789760735.808834:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14778 00000100:00100000:3.0:1789760735.808847:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674033218271 time 674056626690 state 0x2 ref 0 00000100:00100000:3.0:1789760735.847636:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565117568 00000100:00100000:3.0:1789760735.847654:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565117568 00000100:00100000:3.0:1789760735.847777:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674073444678 time 674089517506 state 0x0 ref 1 00000100:00100000:3.0:1789760735.847798:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674089777922 time 674089517506 state 0x1 ref 1 00000100:00100000:3.0:1789760735.847839:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674089777922 time 674108130824 state 0x0 ref 1 00000100:00100000:3.0:1789760735.847853:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565117568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760735.847920:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60497920, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0x1cda8 00010000:00010000:3.0:1789760735.847934:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.847955:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1789760735.847960:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760735.848038:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60497920->60502015] (req 60497920->60502015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.848070:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467492ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60497920->60502015] (req 60497920->60502015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.881619:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.939791:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982082 is committed 00000100:00100000:3.0:1789760735.947414:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760735.953910:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982083 is committed 00000001:00080000:3.0:1789760735.966353:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982084 is committed 00000100:00100000:3.0:1789760735.971900:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760735.989792:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565118592 00000100:00100000:3.0:1789760735.989803:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565118592 00000100:00100000:3.0:1789760735.989859:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674220918374 time 674232405766 state 0x0 ref 1 00000100:00100000:3.0:1789760735.989874:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674232666182 time 674232405766 state 0x1 ref 1 00000100:00100000:3.0:1789760735.989905:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674232666182 time 674250197371 state 0x0 ref 1 00000100:00100000:3.0:1789760735.989927:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565118592:12345-192.168.203.47@tcp:4:dd.0 00000100:00100000:3.0:1789760736.007302:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.014093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982088 is committed 00000001:00080000:3.0:1789760736.028095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982089 is committed 00000001:00080000:3.0:1789760736.040741:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982090 is committed 00000100:00100000:3.0:1789760736.045063:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.051251:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982091 is committed 00000001:00080000:3.0:1789760736.061207:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982092 is committed 00000100:00100000:3.0:1789760736.073026:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.105587:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982095 is committed 00000100:00100000:3.0:1789760736.121432:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.130121:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.153834:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.166070:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.191985:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.202932:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.229302:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.237303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982106 is committed 00000100:00100000:3.0:1789760736.245421:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.250433:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982107 is committed 00000001:00080000:3.0:1789760736.265557:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982108 is committed 00000100:00100000:3.0:1789760736.272920:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.286922:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.316918:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.329793:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.337282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982113 is committed 00000001:00080000:3.0:1789760736.354306:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982114 is committed 00000100:00100000:3.0:1789760736.365140:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.371196:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982115 is committed 00000100:00100000:3.0:1789760736.376223:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.393795:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.402950:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.422255:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.443945:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.454837:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982122 is committed 00000100:00100000:3.0:1789760736.482031:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.497921:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.527841:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.542052:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.565828:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.580224:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.611236:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.630894:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760736.636758:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60727296 -> 60731392 00002000:00010000:3.0:1789760736.636764:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118632 -> 118640 00010000:00010000:3.0:1789760736.636777:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636790:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636800:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636808:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760736.636813:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636823:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636841:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.636849:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749476 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60727296->60731391] (req 60727296->60731391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.636983:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565124736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5852us (6092us total) trans 4294982134 rc 0/0 00000100:00100000:3.0:1789760736.636993:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14837 00000100:00100000:3.0:1789760736.637001:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 674872054179 time 674891406883 state 0x2 ref 0 00000100:00100000:3.0:1789760736.640580:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760736.646522:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982135 is committed 00000100:00100000:3.0:1789760736.660623:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.669375:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.694573:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.728600:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.747840:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.785108:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760736.795127:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60776448 -> 60780544 00002000:00010000:3.0:1789760736.795132:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118728 -> 118736 00010000:00010000:3.0:1789760736.795146:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795159:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795167:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795175:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760736.795180:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795190:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795210:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.795218:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f9467494ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60776448->60780543] (req 60776448->60780543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.795324:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565126272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9988us (10220us total) trans 4294982146 rc 0/0 00000100:00100000:3.0:1789760736.795335:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14849 00000100:00100000:3.0:1789760736.795344:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675019868787 time 675045608062 state 0x2 ref 0 00000100:00100000:3.0:1789760736.801581:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.828832:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.842356:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.871532:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760736.884858:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760736.891179:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60805120 -> 60809216 00002000:00010000:3.0:1789760736.891185:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118784 -> 118792 00010000:00010000:3.0:1789760736.891199:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891212:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891221:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891227:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760736.891232:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891245:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891267:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.891275:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f9467494fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60805120->60809215] (req 60805120->60809215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.891688:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565127168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6543us (6833us total) trans 4294982153 rc 0/0 00000100:00100000:3.0:1789760736.891699:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14856 00000100:00100000:3.0:1789760736.891752:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675132780037 time 675145417447 state 0x2 ref 0 00000100:00100000:3.0:1789760736.922591:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760737.074574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982166 is committed 00000100:00100000:3.0:1789760737.104907:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760737.117914:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982168 is committed 00000001:00080000:3.0:1789760737.133285:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982169 is committed 00000001:00080000:3.0:1789760737.145462:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982170 is committed 00000100:00100000:3.0:1789760737.155009:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.194277:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.232136:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.272386:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565130624 00000100:00100000:3.0:1789760737.272396:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565130624 00000100:00100000:3.0:1789760737.272450:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675501932023 time 675513196662 state 0x0 ref 1 00000100:00100000:3.0:1789760737.272464:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675513457078 time 675513196662 state 0x1 ref 1 00000100:00100000:3.0:1789760737.272497:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675513457078 time 675532788850 state 0x0 ref 1 00000100:00100000:3.0:1789760737.272509:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565130624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.272555:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60915712, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d0d8 00010000:00010000:3.0:1789760737.272564:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.272581:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.272585:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.272592:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.272605:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.282219:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60915712 -> 60919808 00002000:00010000:3.0:1789760737.282224:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119000 -> 119008 00010000:00010000:3.0:1789760737.282334:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282347:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282356:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282364:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.282368:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282438:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282462:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.282470:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60915712->60919807] (req 60915712->60919807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.282626:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565130624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10114us (10408us total) trans 4294982180 rc 0/0 00000100:00100000:3.0:1789760737.282637:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14883 00000100:00100000:3.0:1789760737.282646:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675513457078 time 675532788850 state 0x2 ref 0 00000100:00100000:3.0:1789760737.315615:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565131008 00000100:00100000:3.0:1789760737.315625:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565131008 00000100:00100000:3.0:1789760737.315682:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675549338796 time 675561854008 state 0x0 ref 1 00000100:00100000:3.0:1789760737.315697:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675562114424 time 675561854008 state 0x1 ref 1 00000100:00100000:3.0:1789760737.315947:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675562114424 time 675576237295 state 0x0 ref 1 00000100:00100000:3.0:1789760737.315965:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565131008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.316023:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60928000, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d0f0 00010000:00010000:3.0:1789760737.316040:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.316056:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.316059:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.316065:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60928000->60932095] (req 60928000->60932095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.316081:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f9467495cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60928000->60932095] (req 60928000->60932095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.365543:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565131392 00000100:00100000:3.0:1789760737.365553:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565131392 00000100:00100000:3.0:1789760737.365608:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675587977439 time 675607449587 state 0x0 ref 1 00000100:00100000:3.0:1789760737.365624:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675607710003 time 675607449587 state 0x1 ref 1 00000100:00100000:3.0:1789760737.365660:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675607710003 time 675625951699 state 0x0 ref 1 00000100:00100000:3.0:1789760737.365674:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565131392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.365750:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60940288, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d108 00010000:00010000:3.0:1789760737.365760:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.365787:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.365792:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.365799:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.365814:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.377536:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60940288 -> 60944384 00002000:00010000:3.0:1789760737.377546:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119048 -> 119056 00010000:00010000:3.0:1789760737.377560:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377573:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377583:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377590:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.377595:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377605:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377632:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.377640:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60940288->60944383] (req 60940288->60944383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.377778:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565131392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12101us (12380us total) trans 4294982186 rc 0/0 00000100:00100000:3.0:1789760737.377789:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14889 00000100:00100000:3.0:1789760737.377799:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675607710003 time 675625951699 state 0x2 ref 0 00000100:00100000:3.0:1789760737.429356:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565131776 00000100:00100000:3.0:1789760737.429365:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565131776 00000100:00100000:3.0:1789760737.429488:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675655239844 time 675674992465 state 0x0 ref 1 00000100:00100000:3.0:1789760737.429502:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675675252881 time 675674992465 state 0x1 ref 1 00000100:00100000:3.0:1789760737.429536:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675675252881 time 675689828150 state 0x0 ref 1 00000100:00100000:3.0:1789760737.429550:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565131776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.429597:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60952576, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d120 00010000:00010000:3.0:1789760737.429605:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.429620:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.429625:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.429632:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.429915:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.438621:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60952576 -> 60956672 00002000:00010000:3.0:1789760737.438627:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119072 -> 119080 00010000:00010000:3.0:1789760737.438639:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438651:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438660:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438667:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.438672:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438831:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438853:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.438866:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f9467495f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60952576->60956671] (req 60952576->60956671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.439015:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565131776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9463us (10376us total) trans 4294982189 rc 0/0 00000100:00100000:3.0:1789760737.439026:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14892 00000100:00100000:3.0:1789760737.439044:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675675252881 time 675689828150 state 0x2 ref 0 00000001:00080000:3.0:1789760737.470754:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982191 is committed 00000100:00100000:3.0:1789760737.480184:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565132160 00000100:00100000:3.0:1789760737.480195:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565132160 00000100:00100000:3.0:1789760737.480258:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675704631881 time 675718564322 state 0x0 ref 1 00000100:00100000:3.0:1789760737.480275:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675718824738 time 675718564322 state 0x1 ref 1 00000100:00100000:3.0:1789760737.480374:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675718824738 time 675740664506 state 0x0 ref 1 00000100:00100000:3.0:1789760737.480400:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565132160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.480447:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60964864, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d138 00010000:00010000:3.0:1789760737.480457:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674960c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.480473:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.480477:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.480484:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674960c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60964864->60968959] (req 60964864->60968959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.480499:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674960c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60964864->60968959] (req 60964864->60968959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760737.491008:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982192 is committed 00000100:00100000:3.0:1789760737.501290:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760737.509695:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982193 is committed 00000001:00080000:3.0:1789760737.526067:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982194 is committed 00002000:00010000:3.0:1789760737.545052:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60977152 -> 60981248 00002000:00010000:3.0:1789760737.545057:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119120 -> 119128 00010000:00010000:3.0:1789760737.545071:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545085:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545094:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545101:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.545106:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545115:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545135:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.545143:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f946749621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60977152->60981247] (req 60977152->60981247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.545243:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565132544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9888us (10119us total) trans 4294982195 rc 0/0 00000100:00100000:3.0:1789760737.545253:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14898 00000100:00100000:3.0:1789760737.545263:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675778893087 time 675795630847 state 0x2 ref 0 00000001:00080000:3.0:1789760737.566091:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982196 is committed 00000001:00080000:3.0:1789760737.594179:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982197 is committed 00000100:00100000:3.0:1789760737.606648:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565132928 00000100:00100000:3.0:1789760737.606657:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565132928 00000100:00100000:3.0:1789760737.606747:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675818666583 time 675847785472 state 0x0 ref 1 00000100:00100000:3.0:1789760737.606763:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675848045888 time 675847785472 state 0x1 ref 1 00000100:00100000:3.0:1789760737.606794:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675848045888 time 675867086544 state 0x0 ref 1 00000100:00100000:3.0:1789760737.606807:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565132928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.606854:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60989440, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d168 00010000:00010000:3.0:1789760737.606863:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.606878:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1789760737.606883:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.606891:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.606905:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.618509:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60989440 -> 60993536 00002000:00010000:3.0:1789760737.618515:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119144 -> 119152 00010000:00010000:3.0:1789760737.618528:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618628:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618638:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618645:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.618650:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618660:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618679:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.618692:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60989440->60993535] (req 60989440->60993535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.618821:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565132928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12011us (12770us total) trans 4294982198 rc 0/0 00000100:00100000:3.0:1789760737.618832:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14901 00000100:00100000:3.0:1789760737.618841:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675848045888 time 675867086544 state 0x2 ref 0 00000100:00100000:3.0:1789760737.632780:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760737.642913:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982199 is committed 00002000:00010000:3.0:1789760737.672276:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60997632 -> 61001728 00002000:00010000:3.0:1789760737.672284:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119160 -> 119168 00010000:00010000:3.0:1789760737.672297:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672310:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672319:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672326:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.672331:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672345:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672364:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.672380:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f946749644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60997632->61001727] (req 60997632->61001727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.672470:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565133184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11187us (11977us total) trans 4294982200 rc 0/0 00000100:00100000:3.0:1789760737.672481:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14903 00000100:00100000:3.0:1789760737.672490:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675893693829 time 675921556010 state 0x2 ref 0 00000100:00100000:3.0:1789760737.680758:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.751786:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565133568 00000100:00100000:3.0:1789760737.751796:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565133568 00000100:00100000:3.0:1789760737.751843:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675941523402 time 675978767456 state 0x0 ref 1 00000100:00100000:3.0:1789760737.751857:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675979027872 time 675978767456 state 0x1 ref 1 00000100:00100000:3.0:1789760737.751887:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675979027872 time 676012179340 state 0x0 ref 1 00000100:00100000:3.0:1789760737.751898:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565133568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.751940:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61009920, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d190 00010000:00010000:3.0:1789760737.751950:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.751965:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760737.751969:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.751975:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.751991:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.761009:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61009920 -> 61014016 00002000:00010000:3.0:1789760737.761014:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119184 -> 119192 00010000:00010000:3.0:1789760737.761028:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761050:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761059:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761067:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.761072:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761081:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761101:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.761110:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749659 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61009920->61014015] (req 61009920->61014015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.761199:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565133568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9298us (10063us total) trans 4294982203 rc 0/0 00000100:00100000:3.0:1789760737.761210:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14906 00000100:00100000:3.0:1789760737.761219:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 675979027872 time 676012179340 state 0x2 ref 0 00000100:00100000:3.0:1789760737.767905:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.794539:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565133952 00000100:00100000:3.0:1789760737.794548:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565133952 00000100:00100000:3.0:1789760737.794601:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676029882789 time 676042909692 state 0x0 ref 1 00000100:00100000:3.0:1789760737.794616:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676043170108 time 676042909692 state 0x1 ref 1 00000100:00100000:3.0:1789760737.794637:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676043170108 time 676054929131 state 0x0 ref 1 00000100:00100000:3.0:1789760737.794649:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565133952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.794695:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61022208, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d1a8 00010000:00010000:3.0:1789760737.794725:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.794747:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760737.794751:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.794757:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.794770:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760737.801262:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61022208 -> 61026304 00002000:00010000:3.0:1789760737.801267:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119208 -> 119216 00010000:00010000:3.0:1789760737.801280:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801292:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801302:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801310:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760737.801315:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801324:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801348:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.801356:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674966e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61022208->61026303] (req 61022208->61026303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.801596:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565133952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6944us (7159us total) trans 4294982206 rc 0/0 00000100:00100000:3.0:1789760737.801606:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14909 00000100:00100000:3.0:1789760737.801615:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676043170108 time 676054929131 state 0x2 ref 0 00000001:00080000:3.0:1789760737.829480:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982208 is committed 00000100:00100000:3.0:1789760737.839619:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565134336 00000100:00100000:3.0:1789760737.839628:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565134336 00000100:00100000:3.0:1789760737.839686:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676071193857 time 676081393866 state 0x0 ref 1 00000100:00100000:3.0:1789760737.839700:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676081654282 time 676081393866 state 0x1 ref 1 00000100:00100000:3.0:1789760737.839772:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676081654282 time 676100063977 state 0x0 ref 1 00000100:00100000:3.0:1789760737.839785:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565134336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760737.839833:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61034496, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0x1d1c0 00010000:00010000:3.0:1789760737.839842:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749683 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.839864:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760737.839868:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760737.839874:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61034496->61038591] (req 61034496->61038591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.839888:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61034496->61038591] (req 61034496->61038591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760737.846596:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982209 is committed 00000100:00100000:3.0:1789760737.903615:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.948978:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760737.995487:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760738.006511:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760738.035575:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760738.076207:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61100032 -> 61104128 00002000:00010000:3.0:1789760738.076213:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119360 -> 119368 00010000:00010000:3.0:1789760738.076226:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076239:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076248:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076256:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.076261:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076269:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076290:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.076298:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f9467496f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61100032->61104127] (req 61100032->61104127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.076484:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565136384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8619us (8870us total) trans 4294982225 rc 0/0 00000100:00100000:3.0:1789760738.076494:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14928 00000100:00100000:3.0:1789760738.076503:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676310529240 time 676328141334 state 0x2 ref 0 00000100:00100000:3.0:1789760738.081358:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.089945:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565136512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8343us (8584us total) trans 4294982226 rc 0/0 00000100:00100000:3.0:1789760738.089961:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14929 00000100:00100000:3.0:1789760738.089971:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676328401750 time 676341870567 state 0x2 ref 0 00000100:00100000:3.0:1789760738.112206:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565136768 00000100:00100000:3.0:1789760738.112216:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565136768 00000100:00100000:3.0:1789760738.112272:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676342130983 time 676354591625 state 0x0 ref 1 00000100:00100000:3.0:1789760738.112287:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676354852041 time 676354591625 state 0x1 ref 1 00000100:00100000:3.0:1789760738.112958:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676354852041 time 676373247456 state 0x0 ref 1 00000100:00100000:3.0:1789760738.112978:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565136768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.113039:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61112320, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d258 00010000:00010000:3.0:1789760738.113049:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.113066:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.113071:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.113077:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.113092:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760738.124264:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61112320 -> 61116416 00002000:00010000:3.0:1789760738.124275:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119384 -> 119392 00010000:00010000:3.0:1789760738.124289:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124303:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124312:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124324:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.124329:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124338:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124358:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.124365:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749708 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61112320->61116415] (req 61112320->61116415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.124528:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565136768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11549us (12432us total) trans 4294982228 rc 0/0 00000100:00100000:3.0:1789760738.124539:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14931 00000100:00100000:3.0:1789760738.124549:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676354852041 time 676373247456 state 0x2 ref 0 00000100:00100000:3.0:1789760738.134199:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.162173:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565137152 00000100:00100000:3.0:1789760738.162183:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565137152 00000100:00100000:3.0:1789760738.162851:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676395248025 time 676407940324 state 0x0 ref 1 00000100:00100000:3.0:1789760738.162871:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676408200740 time 676407940324 state 0x1 ref 1 00000100:00100000:3.0:1789760738.162972:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676408200740 time 676423253798 state 0x0 ref 1 00000100:00100000:3.0:1789760738.162989:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565137152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.163047:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61124608, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d270 00010000:00010000:3.0:1789760738.163057:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.163073:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.163077:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.163084:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.163097:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760738.168133:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61124608 -> 61128704 00002000:00010000:3.0:1789760738.168138:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119408 -> 119416 00010000:00010000:3.0:1789760738.168155:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168168:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168176:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168183:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.168189:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168198:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168218:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.168225:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674971d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61124608->61128703] (req 61124608->61128703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.168543:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565137152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5552us (6478us total) trans 4294982231 rc 0/0 00000100:00100000:3.0:1789760738.168554:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14934 00000100:00100000:3.0:1789760738.168564:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676408200740 time 676423253798 state 0x2 ref 0 00000100:00100000:3.0:1789760738.172519:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.206609:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.221796:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760738.233247:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61140992 -> 61145088 00002000:00010000:3.0:1789760738.233254:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119440 -> 119448 00010000:00010000:3.0:1789760738.233267:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233279:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233293:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233301:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.233305:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233313:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233332:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.233340:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f946749739 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61140992->61145087] (req 61140992->61145087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.233440:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565137664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11258us (11649us total) trans 4294982235 rc 0/0 00000100:00100000:3.0:1789760738.233451:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14938 00000100:00100000:3.0:1789760738.233460:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676467778816 time 676482454986 state 0x2 ref 0 00000100:00100000:3.0:1789760738.257104:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565137920 00000100:00100000:3.0:1789760738.257238:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565137920 00000100:00100000:3.0:1789760738.257295:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676482715402 time 676501804113 state 0x0 ref 1 00000100:00100000:3.0:1789760738.257311:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676502064529 time 676501804113 state 0x1 ref 1 00000100:00100000:3.0:1789760738.257348:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676502064529 time 676517639071 state 0x0 ref 1 00000100:00100000:3.0:1789760738.257361:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565137920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.257417:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61149184, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d2a0 00010000:00010000:3.0:1789760738.257427:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749747 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.257448:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.257453:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.257459:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61149184->61153279] (req 61149184->61153279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.257473:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61149184->61153279] (req 61149184->61153279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.276743:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760738.317288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982239 is committed 00000100:00100000:3.0:1789760738.344457:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.356102:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760738.365645:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61165568 -> 61169664 00002000:00010000:3.0:1789760738.365651:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119488 -> 119496 00010000:00010000:3.0:1789760738.365664:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365678:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365693:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365701:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.365741:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365751:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365772:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.365780:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749763 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61165568->61169663] (req 61165568->61169663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.365918:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565138432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9569us (9819us total) trans 4294982241 rc 0/0 00000100:00100000:3.0:1789760738.365929:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14944 00000100:00100000:3.0:1789760738.365941:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676605353691 time 676616620995 state 0x2 ref 0 00000100:00100000:3.0:1789760738.412757:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565138816 00000100:00100000:3.0:1789760738.412770:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565138816 00000100:00100000:3.0:1789760738.412829:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676637769677 time 676649180431 state 0x0 ref 1 00000100:00100000:3.0:1789760738.412845:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676649440847 time 676649180431 state 0x1 ref 1 00000100:00100000:3.0:1789760738.412935:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676649440847 time 676673226030 state 0x0 ref 1 00000100:00100000:3.0:1789760738.412951:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565138816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.413011:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61177856, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d2d8 00010000:00010000:3.0:1789760738.413020:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.413045:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.413050:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.413057:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.413073:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760738.423387:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61177856 -> 61181952 00002000:00010000:3.0:1789760738.423393:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119512 -> 119520 00010000:00010000:3.0:1789760738.423407:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423419:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423429:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423441:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.423446:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423455:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423476:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.423484:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749778 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61177856->61181951] (req 61177856->61181951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.424097:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565138816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11144us (11667us total) trans 4294982244 rc 0/0 00000100:00100000:3.0:1789760738.424110:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14947 00000100:00100000:3.0:1789760738.424125:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676649440847 time 676673226030 state 0x2 ref 0 00000001:00080000:3.0:1789760738.455954:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982246 is committed 00000100:00100000:3.0:1789760738.467269:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565139200 00000100:00100000:3.0:1789760738.467284:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565139200 00000100:00100000:3.0:1789760738.467404:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676691562029 time 676709671040 state 0x0 ref 1 00000100:00100000:3.0:1789760738.467421:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676709931456 time 676709671040 state 0x1 ref 1 00000001:00080000:3.0:1789760738.472817:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982247 is committed 00000001:00080000:3.0:1789760738.485871:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982248 is committed 00000100:00100000:3.0:1789760738.493926:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.507227:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565139584 00000100:00100000:3.0:1789760738.507238:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565139584 00000100:00100000:3.0:1789760738.507292:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676741288774 time 676754481104 state 0x0 ref 1 00000100:00100000:3.0:1789760738.507308:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676754741520 time 676754481104 state 0x1 ref 1 00000100:00100000:3.0:1789760738.507336:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676754741520 time 676767628354 state 0x0 ref 1 00000100:00100000:3.0:1789760738.507348:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6f759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565139584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.507408:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61202432, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d308 00010000:00010000:3.0:1789760738.507417:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f9467497a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.507433:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.507437:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.507444:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f9467497a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61202432->61206527] (req 61202432->61206527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.507456:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f9467497a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61202432->61206527] (req 61202432->61206527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.533640:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.551683:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.584441:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.599967:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760738.640629:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61227008 -> 61231104 00002000:00010000:3.0:1789760738.640639:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119608 -> 119616 00010000:00010000:3.0:1789760738.640654:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640668:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640676:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640684:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.640689:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640699:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640733:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.640741:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f9467497cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61227008->61231103] (req 61227008->61231103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.640865:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565140352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17419us (21597us total) trans 4294982256 rc 0/0 00000100:00100000:3.0:1789760738.640877:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14959 00000100:00100000:3.0:1789760738.640889:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676860844992 time 676883719723 state 0x2 ref 0 00000100:00100000:3.0:1789760738.647099:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760738.665319:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61231104 -> 61235200 00002000:00010000:3.0:1789760738.665329:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119616 -> 119624 00010000:00010000:3.0:1789760738.665343:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665357:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665367:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665386:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.665391:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665400:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665420:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.665428:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f9467497d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61231104->61235199] (req 61231104->61235199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.665532:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565140480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18181us (18438us total) trans 4294982257 rc 0/0 00000100:00100000:3.0:1789760738.665543:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 14960 00000100:00100000:3.0:1789760738.665554:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676883980139 time 676907628623 state 0x2 ref 0 00000100:00100000:3.0:1789760738.694406:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565140736 00000100:00100000:3.0:1789760738.694416:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565140736 00000100:00100000:3.0:1789760738.694471:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676907889039 time 676936398910 state 0x0 ref 1 00000100:00100000:3.0:1789760738.694487:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676936659326 time 676936398910 state 0x1 ref 1 00000100:00100000:3.0:1789760738.694640:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 676936659326 time 676954930743 state 0x0 ref 1 00000100:00100000:3.0:1789760738.694654:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565140736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760738.694701:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61239296, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0x1d350 00010000:00010000:3.0:1789760738.694751:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.694767:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789760738.694772:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.694778:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.694792:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760738.708442:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61239296 -> 61243392 00002000:00010000:3.0:1789760738.708451:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 119632 -> 119640 00010000:00010000:3.0:1789760738.708467:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708481:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708490:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708701:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760738.708730:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708741:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708761:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.708769:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467497e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61239296->61243391] (req 61239296->61243391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.714766:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.733155:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.808095:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760738.866781:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760738.894807:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982268 is committed 00000001:00080000:3.0:1789760738.909162:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982269 is committed 00000100:00100000:3.0:1789760738.915629:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760738.921543:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982270 is committed 00000001:00080000:3.0:1789760738.936496:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982271 is committed 00000001:00080000:3.0:1789760738.947473:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982272 is committed 00000100:00100000:3.0:1789760738.952948:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760738.959881:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982273 is committed 00000001:00080000:3.0:1789760739.004777:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982276 is committed 00000100:00100000:3.0:1789760739.084065:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580058624 00000100:00100000:3.0:1789760739.084073:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580058624 00000100:00100000:3.0:1789760739.084135:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789760739.084145:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580058624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760739.084171:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760739.086514:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580058624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2367us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760739.086526:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000001:00080000:3.0:1789760739.109677:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982281 is committed 00000001:00080000:3.0:1789760739.190884:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982286 is committed 00000001:00080000:3.0:1789760739.207942:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982287 is committed 00000001:00080000:3.0:1789760739.219968:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982288 is committed 00000001:00080000:3.0:1789760739.231692:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982289 is committed 00000001:00080000:3.0:1789760739.243206:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982290 is committed 00000001:00080000:3.0:1789760739.259908:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982291 is committed 00000001:00080000:3.0:1789760739.267992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982292 is committed 00000001:00080000:3.0:1789760739.320352:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982298 is committed 00000001:00080000:3.0:1789760739.330428:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982299 is committed 00000100:00100000:3.0:1789760739.338132:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565145984 00000100:00100000:3.0:1789760739.338141:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565145984 00000100:00100000:3.0:1789760739.338194:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677575628857 time 677585986908 state 0x0 ref 1 00000100:00100000:3.0:1789760739.338209:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677586247324 time 677585986908 state 0x1 ref 1 00000100:00100000:3.0:1789760739.338238:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677586247324 time 677598529570 state 0x0 ref 1 00000100:00100000:3.0:1789760739.338251:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565145984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.338297:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61407232, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d498 00010000:00010000:3.0:1789760739.338306:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.338322:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.338327:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.338333:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61407232->61411327] (req 61407232->61411327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.338357:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61407232->61411327] (req 61407232->61411327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760739.342216:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982300 is committed 00000001:00080000:3.0:1789760739.364280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982302 is committed 00000001:00080000:3.0:1789760739.378332:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982303 is committed 00000001:00080000:3.0:1789760739.398695:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982304 is committed 00000100:00100000:3.0:1789760739.427344:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565146752 00000100:00100000:3.0:1789760739.427354:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565146752 00000100:00100000:3.0:1789760739.427418:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677646820150 time 677665173599 state 0x0 ref 1 00000100:00100000:3.0:1789760739.427435:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677665434015 time 677665173599 state 0x1 ref 1 00000100:00100000:3.0:1789760739.427481:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677665434015 time 677687772172 state 0x0 ref 1 00000100:00100000:3.0:1789760739.427503:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565146752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.427549:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61431808, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d4c8 00010000:00010000:3.0:1789760739.427559:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.427574:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.427578:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.427584:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.427597:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.436297:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61431808 -> 61435904 00002000:00010000:3.0:1789760739.436302:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120008 -> 120016 00010000:00010000:3.0:1789760739.436316:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436329:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436338:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436351:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.436356:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436375:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436396:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.436404:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674992a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61431808->61435903] (req 61431808->61435903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.436634:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565146752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9137us (9380us total) trans 4294982306 rc 0/0 00000100:00100000:3.0:1789760739.436645:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15009 00000100:00100000:3.0:1789760739.436655:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677665434015 time 677687772172 state 0x2 ref 0 00000100:00100000:3.0:1789760739.500058:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565147136 00000100:00100000:3.0:1789760739.500073:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565147136 00000100:00100000:3.0:1789760739.500157:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677709773533 time 677741419050 state 0x0 ref 1 00000100:00100000:3.0:1789760739.500172:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677741679466 time 677741419050 state 0x1 ref 1 00000100:00100000:3.0:1789760739.500245:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677741679466 time 677760535961 state 0x0 ref 1 00000100:00100000:3.0:1789760739.500262:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565147136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.500306:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61444096, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d4e0 00010000:00010000:3.0:1789760739.500315:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.500331:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.500336:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.500342:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.500356:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.516732:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61444096 -> 61448192 00002000:00010000:3.0:1789760739.516740:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120032 -> 120040 00010000:00010000:3.0:1789760739.516754:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516767:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516777:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516785:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.516791:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516801:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516821:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.516829:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674993f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61444096->61448191] (req 61444096->61448191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.517092:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565147136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16827us (19678us total) trans 4294982309 rc 0/0 00000100:00100000:3.0:1789760739.517102:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15012 00000100:00100000:3.0:1789760739.517112:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677741679466 time 677760535961 state 0x2 ref 0 00000100:00100000:3.0:1789760739.548265:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565147520 00000100:00100000:3.0:1789760739.548275:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565147520 00000100:00100000:3.0:1789760739.548330:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677781882823 time 677793938017 state 0x0 ref 1 00000100:00100000:3.0:1789760739.548345:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677794198433 time 677793938017 state 0x1 ref 1 00000100:00100000:3.0:1789760739.548411:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677794198433 time 677808703403 state 0x0 ref 1 00000100:00100000:3.0:1789760739.548425:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565147520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.548471:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61456384, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d4f8 00010000:00010000:3.0:1789760739.548481:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.548508:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.548513:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.548519:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.548533:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.556262:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61456384 -> 61460480 00002000:00010000:3.0:1789760739.556268:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120056 -> 120064 00010000:00010000:3.0:1789760739.556282:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556294:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556304:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556312:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.556317:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556326:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556346:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.556353:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749954 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61456384->61460479] (req 61456384->61460479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.556455:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565147520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8028us (8304us total) trans 4294982312 rc 0/0 00000100:00100000:3.0:1789760739.556465:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15015 00000100:00100000:3.0:1789760739.556475:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677794198433 time 677808703403 state 0x2 ref 0 00000100:00100000:3.0:1789760739.595219:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565147904 00000100:00100000:3.0:1789760739.595230:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565147904 00000100:00100000:3.0:1789760739.595286:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677824254500 time 677838898329 state 0x0 ref 1 00000100:00100000:3.0:1789760739.595302:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677839158745 time 677838898329 state 0x1 ref 1 00000100:00100000:3.0:1789760739.595335:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677839158745 time 677855626448 state 0x0 ref 1 00000100:00100000:3.0:1789760739.595348:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565147904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.595409:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61468672, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d510 00010000:00010000:3.0:1789760739.595419:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.595437:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.595442:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.595448:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.595462:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.603079:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61468672 -> 61472768 00002000:00010000:3.0:1789760739.603085:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120080 -> 120088 00010000:00010000:3.0:1789760739.603098:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603111:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603119:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603126:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.603130:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603139:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603159:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.603172:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749969 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61468672->61472767] (req 61468672->61472767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.603264:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565147904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7915us (8147us total) trans 4294982315 rc 0/0 00000100:00100000:3.0:1789760739.603274:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15018 00000100:00100000:3.0:1789760739.603283:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677839158745 time 677855626448 state 0x2 ref 0 00000100:00100000:3.0:1789760739.649394:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565148288 00000100:00100000:3.0:1789760739.649404:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565148288 00000100:00100000:3.0:1789760739.649457:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677871718085 time 677889443942 state 0x0 ref 1 00000100:00100000:3.0:1789760739.649471:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677889704358 time 677889443942 state 0x1 ref 1 00000100:00100000:3.0:1789760739.649500:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677889704358 time 677909791825 state 0x0 ref 1 00000100:00100000:3.0:1789760739.649515:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565148288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.649562:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61480960, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d528 00010000:00010000:3.0:1789760739.649572:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.649588:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.649593:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.649599:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.649618:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.657658:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61480960 -> 61485056 00002000:00010000:3.0:1789760739.657663:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120104 -> 120112 00010000:00010000:3.0:1789760739.657677:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657690:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657699:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657738:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.657743:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657751:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657769:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.657777:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674997e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61480960->61485055] (req 61480960->61485055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.657912:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565148288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8396us (8628us total) trans 4294982318 rc 0/0 00000100:00100000:3.0:1789760739.657922:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15021 00000100:00100000:3.0:1789760739.657931:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677889704358 time 677909791825 state 0x2 ref 0 00000100:00100000:3.0:1789760739.688043:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565148672 00000100:00100000:3.0:1789760739.688052:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565148672 00000100:00100000:3.0:1789760739.688102:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677927156818 time 677936470504 state 0x0 ref 1 00000100:00100000:3.0:1789760739.688116:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677936730920 time 677936470504 state 0x1 ref 1 00000100:00100000:3.0:1789760739.688148:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 677936730920 time 677948440143 state 0x0 ref 1 00000100:00100000:3.0:1789760739.688160:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565148672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.688204:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61493248, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d540 00010000:00010000:3.0:1789760739.688213:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749993 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.688226:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=677s v=(0 0) 00010000:00010000:3.0:1789760739.688230:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.688235:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61493248->61497343] (req 61493248->61497343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.688248:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61493248->61497343] (req 61493248->61497343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.858139:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61530112 -> 61534208 00002000:00010000:3.0:1789760739.858154:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120200 -> 120208 00010000:00010000:3.0:1789760739.858168:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858181:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858190:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858198:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.858203:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858212:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858234:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.858242:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f9467499d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61530112->61534207] (req 61530112->61534207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.858416:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565149824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12310us (12541us total) trans 4294982330 rc 0/0 00000100:00100000:3.0:1789760739.858428:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15033 00000100:00100000:3.0:1789760739.858437:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678080852107 time 678106382055 state 0x2 ref 0 00000100:00100000:3.0:1789760739.866913:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760739.890294:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565150208 00000100:00100000:3.0:1789760739.890304:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565150208 00000100:00100000:3.0:1789760739.890368:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678127698747 time 678138545933 state 0x0 ref 1 00000100:00100000:3.0:1789760739.890385:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678138806349 time 678138545933 state 0x1 ref 1 00000100:00100000:3.0:1789760739.890425:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678138806349 time 678150717170 state 0x0 ref 1 00000100:00100000:3.0:1789760739.890439:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6f759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565150208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.890484:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61542400, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d5a0 00010000:00010000:3.0:1789760739.890495:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.890511:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760739.890516:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.890639:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.890657:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.896098:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61542400 -> 61546496 00002000:00010000:3.0:1789760739.896104:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120224 -> 120232 00010000:00010000:3.0:1789760739.896117:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896206:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896214:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896221:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.896226:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896236:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896256:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.896265:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f9467499e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61542400->61546495] (req 61542400->61546495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.896366:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6f759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565150208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5924us (6374us total) trans 4294982333 rc 0/0 00000100:00100000:3.0:1789760739.896376:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15036 00000100:00100000:3.0:1789760739.896385:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678138806349 time 678150717170 state 0x2 ref 0 00000100:00100000:3.0:1789760739.900790:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760739.950564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565150592 00000100:00100000:3.0:1789760739.950575:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565150592 00000100:00100000:3.0:1789760739.950631:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678161596828 time 678181647628 state 0x0 ref 1 00000100:00100000:3.0:1789760739.950648:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678181908044 time 678181647628 state 0x1 ref 1 00000100:00100000:3.0:1789760739.950681:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678181908044 time 678210973245 state 0x0 ref 1 00000100:00100000:3.0:1789760739.950694:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565150592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760739.950770:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61554688, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0x1d5b8 00010000:00010000:3.0:1789760739.950780:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.950797:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760739.950801:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.950808:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.950833:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760739.955812:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61554688 -> 61558784 00002000:00010000:3.0:1789760739.955816:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760739 -> 1789760740 00002000:00010000:3.0:1789760739.955819:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760739 -> 1789760740 00002000:00010000:3.0:1789760739.955821:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120248 -> 120256 00010000:00010000:3.0:1789760739.955834:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955846:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955854:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955862:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760739.955867:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955877:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955896:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.955904:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f9467499fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61554688->61558783] (req 61554688->61558783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760739.955995:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565150592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5299us (5890us total) trans 4294982336 rc 0/0 00000100:00100000:3.0:1789760739.956005:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15039 00000100:00100000:3.0:1789760739.956025:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678181908044 time 678210973245 state 0x2 ref 0 00000100:00100000:3.0:1789760739.961741:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760739.996908:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982338 is committed 00000100:00100000:3.0:1789760740.001893:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565150976 00000100:00100000:3.0:1789760740.001914:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565150976 00000100:00100000:3.0:1789760740.001979:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678222489707 time 678252042618 state 0x0 ref 1 00000100:00100000:3.0:1789760740.001996:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678252303034 time 678252042618 state 0x1 ref 1 00000100:00100000:3.0:1789760740.002036:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678252303034 time 678262327404 state 0x0 ref 1 00000100:00100000:3.0:1789760740.002051:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565150976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.002099:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61566976, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d5d0 00010000:00010000:3.0:1789760740.002110:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.002126:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.002131:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.002137:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.002150:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760740.006296:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61566976 -> 61571072 00002000:00010000:3.0:1789760740.006301:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120272 -> 120280 00010000:00010000:3.0:1789760740.006314:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006326:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006336:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006344:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.006349:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006369:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006388:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.006396:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61566976->61571071] (req 61566976->61571071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.006533:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565150976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4482us (4725us total) trans 4294982339 rc 0/0 00000100:00100000:3.0:1789760740.006543:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15042 00000100:00100000:3.0:1789760740.006551:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678252303034 time 678262327404 state 0x2 ref 0 00000100:00100000:3.0:1789760740.023288:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.034341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982340 is committed 00002000:00010000:3.0:1789760740.049582:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61575168 -> 61579264 00002000:00010000:3.0:1789760740.049588:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120288 -> 120296 00010000:00010000:3.0:1789760740.049601:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049613:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049622:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049630:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.049634:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049644:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049663:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.049671:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f946749a1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61575168->61579263] (req 61575168->61579263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.049816:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565151232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7335us (7693us total) trans 4294982341 rc 0/0 00000100:00100000:3.0:1789760740.049829:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15044 00000100:00100000:3.0:1789760740.049837:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678284067210 time 678302758102 state 0x2 ref 0 00000100:00100000:3.0:1789760740.059298:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760740.062503:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678303018518 time 678322783655 state 0x0 ref 1 00000100:00100000:3.0:1789760740.062528:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565151360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.062578:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61579264, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d5e8 00010000:00010000:3.0:1789760740.062586:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.062601:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.062605:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.062611:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61579264->61583359] (req 61579264->61583359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.062623:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f946749a26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61579264->61583359] (req 61579264->61583359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760740.068924:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982342 is committed 00000001:00080000:3.0:1789760740.080236:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982343 is committed 00000100:00100000:3.0:1789760740.085191:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565151616 00000100:00100000:3.0:1789760740.085201:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565151616 00000100:00100000:3.0:1789760740.085258:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678323044071 time 678334325657 state 0x0 ref 1 00000100:00100000:3.0:1789760740.085276:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678334586073 time 678334325657 state 0x1 ref 1 00000100:00100000:3.0:1789760740.085306:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678334586073 time 678345598535 state 0x0 ref 1 00000100:00100000:3.0:1789760740.085319:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565151616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.085368:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61587456, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d5f8 00010000:00010000:3.0:1789760740.085378:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749a34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.085393:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.085397:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.085404:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61587456->61591551] (req 61587456->61591551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.085416:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f946749a34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61587456->61591551] (req 61587456->61591551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760740.092676:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982344 is committed 00000100:00100000:3.0:1789760740.097367:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.104792:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982345 is committed 00000001:00080000:3.0:1789760740.125945:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982346 is committed 00000001:00080000:3.0:1789760740.138179:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982347 is committed 00000100:00100000:3.0:1789760740.147600:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760740.167343:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.174516:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982349 is committed 00000001:00080000:3.0:1789760740.195483:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982350 is committed 00000100:00100000:3.0:1789760740.207649:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.214444:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982351 is committed 00000100:00100000:3.0:1789760740.218628:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760740.230157:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565152768 00000100:00100000:3.0:1789760740.230167:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565152768 00000100:00100000:3.0:1789760740.230223:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678468501202 time 678479298910 state 0x0 ref 1 00000100:00100000:3.0:1789760740.230240:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678479559326 time 678479298910 state 0x1 ref 1 00000100:00100000:3.0:1789760740.230270:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678479559326 time 678490562103 state 0x0 ref 1 00000100:00100000:3.0:1789760740.230282:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565152768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.230355:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61624320, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d640 00010000:00010000:3.0:1789760740.230364:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.230379:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.230384:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.230391:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.230404:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760740.237176:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61624320 -> 61628416 00002000:00010000:3.0:1789760740.237182:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120384 -> 120392 00010000:00010000:3.0:1789760740.237196:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237213:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237222:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237242:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.237247:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237256:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237277:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.237286:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749a73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61624320->61628415] (req 61624320->61628415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.237387:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565152768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7103us (7326us total) trans 4294982353 rc 0/0 00000100:00100000:3.0:1789760740.237398:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15056 00000100:00100000:3.0:1789760740.237408:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678479559326 time 678490562103 state 0x2 ref 0 00000100:00100000:3.0:1789760740.240371:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.256927:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982355 is committed 00000100:00100000:3.0:1789760740.265318:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565153152 00000100:00100000:3.0:1789760740.265337:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565153152 00000100:00100000:3.0:1789760740.265399:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678501225400 time 678512065944 state 0x0 ref 1 00000100:00100000:3.0:1789760740.265413:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678512326360 time 678512065944 state 0x1 ref 1 00000100:00100000:3.0:1789760740.265445:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678512326360 time 678525737530 state 0x0 ref 1 00000100:00100000:3.0:1789760740.265459:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565153152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.265511:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61636608, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d658 00010000:00010000:3.0:1789760740.265522:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.265537:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.265542:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.265548:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.265560:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760740.271335:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61636608 -> 61640704 00002000:00010000:3.0:1789760740.271340:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120408 -> 120416 00010000:00010000:3.0:1789760740.271354:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271380:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271390:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271397:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.271402:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271412:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271432:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.271440:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61636608->61640703] (req 61636608->61640703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.271547:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565153152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6085us (6661us total) trans 4294982356 rc 0/0 00000100:00100000:3.0:1789760740.271557:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15059 00000100:00100000:3.0:1789760740.271567:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678512326360 time 678525737530 state 0x2 ref 0 00000100:00100000:3.0:1789760740.280978:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.286303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982357 is committed 00000100:00100000:3.0:1789760740.305118:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565153536 00000100:00100000:3.0:1789760740.305129:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565153536 00000100:00100000:3.0:1789760740.305186:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678541884264 time 678552429127 state 0x0 ref 1 00000100:00100000:3.0:1789760740.305202:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678552689543 time 678552429127 state 0x1 ref 1 00000100:00100000:3.0:1789760740.305275:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678552689543 time 678565565923 state 0x0 ref 1 00000100:00100000:3.0:1789760740.305289:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565153536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.305338:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61648896, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d670 00010000:00010000:3.0:1789760740.305347:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.305374:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.305378:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.305385:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.305400:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760740.311954:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61648896 -> 61652992 00002000:00010000:3.0:1789760740.311963:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120432 -> 120440 00010000:00010000:3.0:1789760740.311977:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.311994:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.312003:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.312021:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.312026:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.312036:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.312056:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.312064:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749a9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61648896->61652991] (req 61648896->61652991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.312178:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565153536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6887us (7598us total) trans 4294982359 rc 0/0 00000100:00100000:3.0:1789760740.312189:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15062 00000100:00100000:3.0:1789760740.312198:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678552689543 time 678565565923 state 0x2 ref 0 00000100:00100000:3.0:1789760740.317628:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760740.360310:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565153920 00000100:00100000:3.0:1789760740.360325:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565153920 00000100:00100000:3.0:1789760740.360403:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678578716123 time 678597610554 state 0x0 ref 1 00000100:00100000:3.0:1789760740.360419:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678597870970 time 678597610554 state 0x1 ref 1 00000100:00100000:3.0:1789760740.360455:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678597870970 time 678620746699 state 0x0 ref 1 00000100:00100000:3.0:1789760740.360469:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565153920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.360533:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61661184, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d688 00010000:00010000:3.0:1789760740.360542:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.360559:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.360563:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.360569:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.360588:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760740.368468:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61661184 -> 61665280 00002000:00010000:3.0:1789760740.368479:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120456 -> 120464 00010000:00010000:3.0:1789760740.368494:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.368508:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.368517:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.368525:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.368530:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.368540:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.369956:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.369995:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749ab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61661184->61665279] (req 61661184->61665279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.375330:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565154048 00000100:00100000:3.0:1789760740.375339:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565154048 00000100:00100000:3.0:1789760740.375391:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678597870970 time 678620746699 state 0x0 ref 1 00000100:00100000:3.0:1789760740.375405:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678621007115 time 678620746699 state 0x1 ref 1 00000100:00100000:3.0:1789760740.375435:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678621007115 time 678635726490 state 0x0 ref 1 00000100:00100000:3.0:1789760740.375447:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565154048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760740.375511:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61665280, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0x1d690 00010000:00010000:3.0:1789760740.375520:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749ab9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.375535:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1789760740.375539:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.375545:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749ab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61665280->61669375] (req 61665280->61669375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.375559:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f946749ab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61665280->61669375] (req 61665280->61669375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760740.384629:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982363 is committed 00000001:00080000:3.0:1789760740.407262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982364 is committed 00000001:00080000:3.0:1789760740.420681:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982365 is committed 00000100:00100000:3.0:1789760740.502915:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760740.510040:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61693952 -> 61698048 00002000:00010000:3.0:1789760740.510047:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120520 -> 120528 00010000:00010000:3.0:1789760740.510061:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510074:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510084:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510888:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760740.510894:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510905:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510924:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.510932:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749aea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61693952->61698047] (req 61693952->61698047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.511095:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565154944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7782us (8185us total) trans 4294982370 rc 0/0 00000100:00100000:3.0:1789760740.511175:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15073 00000100:00100000:3.0:1789760740.511188:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 678747787322 time 678763587275 state 0x2 ref 0 00000100:00100000:3.0:1789760740.542165:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.562372:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982374 is committed 00000001:00080000:3.0:1789760740.581820:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982375 is committed 00000100:00100000:3.0:1789760740.586083:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.592330:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982376 is committed 00000001:00080000:3.0:1789760740.625022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982378 is committed 00000100:00100000:3.0:1789760740.632122:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760740.638997:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982379 is committed 00000001:00080000:3.0:1789760740.655766:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982380 is committed 00000001:00080000:3.0:1789760740.700323:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982383 is committed 00000100:00100000:3.0:1789760740.756414:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565157376 00000100:00100000:3.0:1789760740.756420:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565157376 00000100:00100000:3.0:1789760740.756463:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565157504 00000100:00100000:3.0:1789760740.756466:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565157504 00000001:00080000:3.0:1789760740.854247:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982395 is committed 00000001:00080000:3.0:1789760740.877215:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982396 is committed 00000001:00080000:3.0:1789760740.891510:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982397 is committed 00000001:00080000:3.0:1789760740.905862:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982398 is committed 00000001:00080000:3.0:1789760740.928645:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982399 is committed 00000001:00080000:3.0:1789760740.941587:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982400 is committed 00000001:00080000:3.0:1789760740.988586:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982404 is committed 00000001:00080000:3.0:1789760741.001991:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982405 is committed 00000001:00080000:3.0:1789760741.013241:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982406 is committed 00000001:00080000:3.0:1789760741.024457:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982407 is committed 00000001:00080000:3.0:1789760741.043784:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982408 is committed 00000001:00080000:3.0:1789760741.073235:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982410 is committed 00000001:00080000:3.0:1789760741.104383:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982413 is committed 00000001:00080000:3.0:1789760741.147017:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982416 is committed 00000100:00100000:3.0:1789760741.176460:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565161472 00000100:00100000:3.0:1789760741.176470:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565161472 00000100:00100000:3.0:1789760741.176526:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679403101073 time 679411600833 state 0x0 ref 1 00000100:00100000:3.0:1789760741.176555:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679411861249 time 679411600833 state 0x1 ref 1 00000100:00100000:3.0:1789760741.176590:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679411861249 time 679436882279 state 0x0 ref 1 00000100:00100000:3.0:1789760741.176602:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565161472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.176648:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61890560, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d848 00010000:00010000:3.0:1789760741.176658:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.176674:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789760741.176678:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.176684:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.176698:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760741.192170:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61890560 -> 61894656 00002000:00010000:3.0:1789760741.192178:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120904 -> 120912 00010000:00010000:3.0:1789760741.192191:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192205:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192214:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192221:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.192226:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192235:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192255:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.192262:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61890560->61894655] (req 61890560->61894655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.193060:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565161472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16452us (16707us total) trans 4294982418 rc 0/0 00000100:00100000:3.0:1789760741.193072:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15121 00000100:00100000:3.0:1789760741.193082:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679411861249 time 679436882279 state 0x2 ref 0 00000001:00080000:3.0:1789760741.205992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982419 is committed 00000001:00080000:3.0:1789760741.222559:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982420 is committed 00000001:00080000:3.0:1789760741.256685:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982421 is committed 00000001:00080000:3.0:1789760741.272811:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982422 is committed 00000001:00080000:3.0:1789760741.291400:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982423 is committed 00002000:00010000:3.0:1789760741.389107:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61931520 -> 61935616 00002000:00010000:3.0:1789760741.389118:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120984 -> 120992 00010000:00010000:3.0:1789760741.389134:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389149:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389159:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389172:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.389178:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389187:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389206:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.389214:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f946749c80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61931520->61935615] (req 61931520->61935615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.389312:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565162752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14839us (15225us total) trans 4294982428 rc 0/0 00000100:00100000:3.0:1789760741.389321:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15131 00000100:00100000:3.0:1789760741.389330:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679619670155 time 679634748766 state 0x2 ref 0 00000001:00080000:3.0:1789760741.427961:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982430 is committed 00000100:00100000:3.0:1789760741.432947:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565163136 00000100:00100000:3.0:1789760741.432961:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565163136 00000100:00100000:3.0:1789760741.433034:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679662628482 time 679682376236 state 0x0 ref 1 00000100:00100000:3.0:1789760741.433050:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679682636652 time 679682376236 state 0x1 ref 1 00000100:00100000:3.0:1789760741.433120:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679682636652 time 679693411793 state 0x0 ref 1 00000100:00100000:3.0:1789760741.433134:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565163136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.433182:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61943808, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d8b0 00010000:00010000:3.0:1789760741.433192:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.433209:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789760741.433214:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.433220:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.433234:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760741.442389:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61943808 -> 61947904 00002000:00010000:3.0:1789760741.442398:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121008 -> 121016 00010000:00010000:3.0:1789760741.442412:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443476:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443487:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443495:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.443501:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443512:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443533:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.443541:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749c95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61943808->61947903] (req 61943808->61947903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.443890:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565163136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10707us (11789us total) trans 4294982431 rc 0/0 00000100:00100000:3.0:1789760741.443900:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15134 00000100:00100000:3.0:1789760741.443909:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679682636652 time 679693411793 state 0x2 ref 0 00000001:00080000:3.0:1789760741.457494:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982432 is committed 00002000:00010000:3.0:1789760741.458480:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61947904 -> 61952000 00002000:00010000:3.0:1789760741.458486:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121016 -> 121024 00010000:00010000:3.0:1789760741.458499:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458511:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458520:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458528:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.458533:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458541:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458560:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.458568:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f946749c9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61947904->61951999] (req 61947904->61951999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.459318:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565163264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6356us (6741us total) trans 4294982432 rc 0/0 00000100:00100000:3.0:1789760741.459329:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15135 00000100:00100000:3.0:1789760741.459338:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679693672209 time 679713236529 state 0x2 ref 0 00000001:00080000:3.0:1789760741.470801:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982433 is committed 00000100:00100000:3.0:1789760741.480277:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565163520 00000100:00100000:3.0:1789760741.480286:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565163520 00000100:00100000:3.0:1789760741.480337:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679713496945 time 679726771704 state 0x0 ref 1 00000100:00100000:3.0:1789760741.480361:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679727032120 time 679726771704 state 0x1 ref 1 00000100:00100000:3.0:1789760741.480391:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679727032120 time 679740683457 state 0x0 ref 1 00000100:00100000:3.0:1789760741.480404:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565163520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.480454:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61956096, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d8c8 00010000:00010000:3.0:1789760741.480463:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749caa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.480480:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789760741.480484:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.480490:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61956096->61960191] (req 61956096->61960191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.480505:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f946749caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61956096->61960191] (req 61956096->61960191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760741.496294:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982434 is committed 00000100:00100000:3.0:1789760741.503935:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565163648 00000100:00100000:3.0:1789760741.503946:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565163648 00000100:00100000:3.0:1789760741.504016:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679727032120 time 679740683457 state 0x0 ref 1 00000100:00100000:3.0:1789760741.504042:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679740943873 time 679740683457 state 0x1 ref 1 00000100:00100000:3.0:1789760741.504076:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679740943873 time 679764367056 state 0x0 ref 1 00000100:00100000:3.0:1789760741.504089:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565163648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.504138:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61960192, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d8d0 00010000:00010000:3.0:1789760741.504148:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749cb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.504164:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789760741.504168:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.504174:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61960192->61964287] (req 61960192->61964287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.504188:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61960192->61964287] (req 61960192->61964287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760741.509640:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982435 is committed 00000001:00080000:3.0:1789760741.525419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982436 is committed 00000001:00080000:3.0:1789760741.544536:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982437 is committed 00000001:00080000:3.0:1789760741.564766:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982438 is committed 00000001:00080000:3.0:1789760741.588739:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982439 is committed 00000001:00080000:3.0:1789760741.597924:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982440 is committed 00000001:00080000:3.0:1789760741.607896:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982441 is committed 00000001:00080000:3.0:1789760741.623908:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982442 is committed 00002000:00010000:3.0:1789760741.649783:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61997056 -> 62001152 00002000:00010000:3.0:1789760741.649788:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121112 -> 121120 00010000:00010000:3.0:1789760741.649801:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649815:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649826:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649840:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.649846:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649856:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649877:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.649885:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f946749cf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61997056->62001151] (req 61997056->62001151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.649993:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565164800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7411us (7758us total) trans 4294982444 rc 0/0 00000100:00100000:3.0:1789760741.650015:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15147 00000100:00100000:3.0:1789760741.650027:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679894628213 time 679902857437 state 0x2 ref 0 00000100:00100000:3.0:1789760741.729222:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565165440 00000100:00100000:3.0:1789760741.729232:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565165440 00000100:00100000:3.0:1789760741.729290:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679953448502 time 679969109092 state 0x0 ref 1 00000100:00100000:3.0:1789760741.729307:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679969369508 time 679969109092 state 0x1 ref 1 00000100:00100000:3.0:1789760741.729337:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679969369508 time 679989629854 state 0x0 ref 1 00000100:00100000:3.0:1789760741.729362:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.729412:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62017536, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d940 00010000:00010000:3.0:1789760741.729421:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.729438:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789760741.729442:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.729450:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.729465:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760741.734229:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62017536 -> 62021632 00002000:00010000:3.0:1789760741.734447:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121152 -> 121160 00010000:00010000:3.0:1789760741.734463:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734476:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734484:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734491:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.734497:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734506:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734526:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.734534:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62017536->62021631] (req 62017536->62021631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.734688:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5323us (5574us total) trans 4294982449 rc 0/0 00000100:00100000:3.0:1789760741.734698:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15152 00000100:00100000:3.0:1789760741.734748:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679969369508 time 679989629854 state 0x2 ref 0 00002000:00010000:3.0:1789760741.746367:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62021632 -> 62025728 00002000:00010000:3.0:1789760741.746372:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121160 -> 121168 00010000:00010000:3.0:1789760741.746385:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746399:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746409:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746424:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.746429:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746438:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746456:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.746463:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f946749d1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62021632->62025727] (req 62021632->62025727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.746553:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565165568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4145us (4413us total) trans 4294982450 rc 0/0 00000100:00100000:3.0:1789760741.746564:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15153 00000100:00100000:3.0:1789760741.746573:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 679989890270 time 680002684255 state 0x2 ref 0 00000100:00100000:3.0:1789760741.752981:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760741.766311:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565165824 00000100:00100000:3.0:1789760741.766325:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565165824 00000100:00100000:3.0:1789760741.766409:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680002944671 time 680013484686 state 0x0 ref 1 00000100:00100000:3.0:1789760741.766432:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680013745102 time 680013484686 state 0x1 ref 1 00000100:00100000:3.0:1789760741.766470:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680013745102 time 680026762341 state 0x0 ref 1 00000100:00100000:3.0:1789760741.766489:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.766548:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62029824, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d958 00010000:00010000:3.0:1789760741.766559:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.766578:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760741.766583:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.766591:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.766607:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760741.774601:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62029824 -> 62033920 00002000:00010000:3.0:1789760741.774611:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121176 -> 121184 00010000:00010000:3.0:1789760741.774630:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774647:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774658:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774666:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.774673:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774684:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774780:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.774790:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62029824->62033919] (req 62029824->62033919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.775123:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8628us (8932us total) trans 4294982452 rc 0/0 00000100:00100000:3.0:1789760741.775136:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15155 00000100:00100000:3.0:1789760741.775148:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680013745102 time 680026762341 state 0x2 ref 0 00000100:00100000:3.0:1789760741.785923:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565165952 00000100:00100000:3.0:1789760741.785944:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565165952 00000100:00100000:3.0:1789760741.786037:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680013745102 time 680026762341 state 0x0 ref 1 00000100:00100000:3.0:1789760741.786442:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680027022757 time 680026762341 state 0x1 ref 1 00000100:00100000:3.0:1789760741.786546:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680027022757 time 680046836740 state 0x0 ref 1 00000100:00100000:3.0:1789760741.786563:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.786629:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62033920, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d960 00010000:00010000:3.0:1789760741.786642:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.786660:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760741.786665:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.786673:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.786690:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760741.793587:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62033920 -> 62038016 00002000:00010000:3.0:1789760741.793594:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121184 -> 121192 00010000:00010000:3.0:1789760741.793611:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793626:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793637:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793645:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760741.793652:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793663:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793689:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.793697:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62033920->62038015] (req 62033920->62038015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.793939:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565165952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7375us (11003us total) trans 4294982453 rc 0/0 00000100:00100000:3.0:1789760741.793953:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15156 00000100:00100000:3.0:1789760741.793965:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680027022757 time 680046836740 state 0x2 ref 0 00000100:00100000:3.0:1789760741.823310:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565166208 00000100:00100000:3.0:1789760741.823330:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565166208 00000100:00100000:3.0:1789760741.823418:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680047097156 time 680070582948 state 0x0 ref 1 00000100:00100000:3.0:1789760741.823437:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680070843364 time 680070582948 state 0x1 ref 1 00000100:00100000:3.0:1789760741.823476:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680070843364 time 680083768044 state 0x0 ref 1 00000100:00100000:3.0:1789760741.823491:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565166208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.823558:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62042112, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d970 00010000:00010000:3.0:1789760741.823569:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.823588:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760741.823594:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.823602:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62042112->62046207] (req 62042112->62046207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.823618:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749d3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62042112->62046207] (req 62042112->62046207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.835341:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565166336 00000100:00100000:3.0:1789760741.835357:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565166336 00000100:00100000:3.0:1789760741.835522:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680070843364 time 680083768044 state 0x0 ref 1 00000100:00100000:3.0:1789760741.835544:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680084028460 time 680083768044 state 0x1 ref 1 00000100:00100000:3.0:1789760741.835577:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680084028460 time 680095868806 state 0x0 ref 1 00000100:00100000:3.0:1789760741.835591:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565166336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760741.835660:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62046208, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0x1d978 00010000:00010000:3.0:1789760741.835672:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749d44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.835692:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760741.835697:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.836203:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749d44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62046208->62050303] (req 62046208->62050303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.836227:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749d44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62046208->62050303] (req 62046208->62050303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760741.848605:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760741.890941:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760741.920052:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760741.961872:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.007932:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982468 is committed 00000100:00100000:3.0:1789760742.014866:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.022406:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982469 is committed 00000100:00100000:3.0:1789760742.027955:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.036895:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982470 is committed 00000100:00100000:3.0:1789760742.062302:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.114036:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982474 is committed 00000100:00100000:3.0:1789760742.122067:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.122674:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680366897120 time 680382961730 state 0x0 ref 1 00000100:00100000:3.0:1789760742.122694:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565168768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.122787:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62124032, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da10 00010000:00010000:3.0:1789760742.122799:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.122819:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.122824:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.122831:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.122848:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.131072:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62124032 -> 62128128 00002000:00010000:3.0:1789760742.131079:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121360 -> 121368 00010000:00010000:3.0:1789760742.131098:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131113:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131124:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131131:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.131137:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131148:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131173:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.131181:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62124032->62128127] (req 62124032->62128127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.131353:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565168768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8656us (9292us total) trans 4294982475 rc 0/0 00000100:00100000:3.0:1789760742.131367:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15178 00000100:00100000:3.0:1789760742.131378:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680366897120 time 680382961730 state 0x2 ref 0 00000100:00100000:3.0:1789760742.169028:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565169152 00000100:00100000:3.0:1789760742.169045:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565169152 00000100:00100000:3.0:1789760742.169122:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680396466059 time 680413820876 state 0x0 ref 1 00000100:00100000:3.0:1789760742.169140:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680414081292 time 680413820876 state 0x1 ref 1 00000100:00100000:3.0:1789760742.169252:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680414081292 time 680429542020 state 0x0 ref 1 00000100:00100000:3.0:1789760742.169268:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565169152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.169333:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62136320, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da28 00010000:00010000:3.0:1789760742.169357:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.172318:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.172325:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.172339:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62136320->62140415] (req 62136320->62140415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.172372:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f946749dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62136320->62140415] (req 62136320->62140415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760742.186341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982478 is committed 00002000:00010000:3.0:1789760742.279016:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62156800 -> 62160896 00002000:00010000:3.0:1789760742.279026:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121424 -> 121432 00010000:00010000:3.0:1789760742.279039:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279054:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279063:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279071:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.279076:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279085:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279104:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.279112:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f946749e01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62156800->62160895] (req 62156800->62160895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.279356:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565169792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15055us (15285us total) trans 4294982483 rc 0/0 00000100:00100000:3.0:1789760742.279368:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15186 00000100:00100000:3.0:1789760742.279377:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680510691305 time 680524577445 state 0x2 ref 0 00002000:00010000:3.0:1789760742.289781:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62160896 -> 62164992 00002000:00010000:3.0:1789760742.289787:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121432 -> 121440 00010000:00010000:3.0:1789760742.289799:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289812:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289822:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289830:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.289835:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289843:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289863:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.289871:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f946749e08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62160896->62164991] (req 62160896->62164991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.290047:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565169920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6748us (6947us total) trans 4294982484 rc 0/0 00000100:00100000:3.0:1789760742.290060:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15187 00000100:00100000:3.0:1789760742.290069:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680524837861 time 680543574852 state 0x2 ref 0 00000100:00100000:3.0:1789760742.313760:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565170176 00000100:00100000:3.0:1789760742.313770:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565170176 00000100:00100000:3.0:1789760742.313825:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680543835268 time 680557232231 state 0x0 ref 1 00000100:00100000:3.0:1789760742.313841:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680557492647 time 680557232231 state 0x1 ref 1 00000100:00100000:3.0:1789760742.313861:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680557492647 time 680574153394 state 0x0 ref 1 00000100:00100000:3.0:1789760742.313883:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565170176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.313930:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62169088, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da68 00010000:00010000:3.0:1789760742.313939:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.313954:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.313958:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.313964:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.313977:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.324253:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62169088 -> 62173184 00002000:00010000:3.0:1789760742.324258:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121448 -> 121456 00010000:00010000:3.0:1789760742.324273:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324284:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324292:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324299:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.324304:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324313:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324333:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.324341:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62169088->62173183] (req 62169088->62173183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.324521:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565170176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10645us (10936us total) trans 4294982486 rc 0/0 00000100:00100000:3.0:1789760742.324532:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15189 00000100:00100000:3.0:1789760742.324541:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680557492647 time 680574153394 state 0x2 ref 0 00000100:00100000:3.0:1789760742.336930:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565170304 00000100:00100000:3.0:1789760742.336940:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565170304 00000100:00100000:3.0:1789760742.338845:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680557492647 time 680574153394 state 0x0 ref 1 00000100:00100000:3.0:1789760742.338864:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680574413810 time 680574153394 state 0x1 ref 1 00000100:00100000:3.0:1789760742.338905:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680574413810 time 680599197091 state 0x0 ref 1 00000100:00100000:3.0:1789760742.338920:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565170304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.338981:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62173184, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da70 00010000:00010000:3.0:1789760742.338991:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.339017:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.339022:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.339028:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.339042:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.350438:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62173184 -> 62177280 00002000:00010000:3.0:1789760742.350443:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121456 -> 121464 00010000:00010000:3.0:1789760742.350841:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.350981:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.350991:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.351010:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.351015:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.351023:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.351044:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.351052:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62173184->62177279] (req 62173184->62177279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.379564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565170560 00000100:00100000:3.0:1789760742.379574:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565170560 00000100:00100000:3.0:1789760742.379631:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680599457507 time 680624616765 state 0x0 ref 1 00000100:00100000:3.0:1789760742.379647:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680624877181 time 680624616765 state 0x1 ref 1 00000100:00100000:3.0:1789760742.379681:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680624877181 time 680639973373 state 0x0 ref 1 00000100:00100000:3.0:1789760742.379694:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565170560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.379778:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62181376, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da80 00010000:00010000:3.0:1789760742.379788:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.379802:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.379806:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.379811:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.379825:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.386410:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62181376 -> 62185472 00002000:00010000:3.0:1789760742.386416:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121472 -> 121480 00010000:00010000:3.0:1789760742.386430:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386442:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386451:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386458:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.386463:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386472:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386491:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.386499:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62181376->62185471] (req 62181376->62185471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.386591:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565170560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6894us (7122us total) trans 4294982489 rc 0/0 00000100:00100000:3.0:1789760742.386602:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15192 00000100:00100000:3.0:1789760742.386611:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680624877181 time 680639973373 state 0x2 ref 0 00000100:00100000:3.0:1789760742.414955:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565170944 00000100:00100000:3.0:1789760742.414964:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565170944 00000100:00100000:3.0:1789760742.415101:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680652906826 time 680664508157 state 0x0 ref 1 00000100:00100000:3.0:1789760742.415116:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680664768573 time 680664508157 state 0x1 ref 1 00000100:00100000:3.0:1789760742.415185:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680664768573 time 680675474810 state 0x0 ref 1 00000100:00100000:3.0:1789760742.415199:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565170944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.415246:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62193664, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1da98 00010000:00010000:3.0:1789760742.415256:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.415345:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.415350:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.415358:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62193664->62197759] (req 62193664->62197759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.415373:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f946749e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62193664->62197759] (req 62193664->62197759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.525895:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.568244:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.609293:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.654895:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.705250:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680915791315 time 680936380926 state 0x0 ref 1 00000100:00100000:3.0:1789760742.705270:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680936641342 time 680936380926 state 0x1 ref 1 00000100:00100000:3.0:1789760742.705519:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680936641342 time 680965809908 state 0x0 ref 1 00000100:00100000:3.0:1789760742.705537:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565173248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.705588:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62267392, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1db28 00010000:00010000:3.0:1789760742.705598:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.705614:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1789760742.705618:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.705625:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.705638:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.716457:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62267392 -> 62271488 00002000:00010000:3.0:1789760742.716466:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121640 -> 121648 00010000:00010000:3.0:1789760742.716480:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716494:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716503:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716512:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.716517:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716527:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716546:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.716560:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749ebe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62267392->62271487] (req 62267392->62271487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.717325:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565173248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11785us (18178us total) trans 4294982510 rc 0/0 00000100:00100000:3.0:1789760742.717347:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15213 00000100:00100000:3.0:1789760742.717357:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680936641342 time 680965809908 state 0x2 ref 0 00000100:00100000:3.0:1789760742.720407:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.725404:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982511 is committed 00000100:00100000:3.0:1789760742.746619:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565173632 00000100:00100000:3.0:1789760742.746629:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565173632 00000100:00100000:3.0:1789760742.746685:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680981176616 time 680992455124 state 0x0 ref 1 00000100:00100000:3.0:1789760742.746700:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680992715540 time 680992455124 state 0x1 ref 1 00000100:00100000:3.0:1789760742.746833:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680992715540 time 681007124351 state 0x0 ref 1 00000100:00100000:3.0:1789760742.746847:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565173632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.746893:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62279680, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1db40 00010000:00010000:3.0:1789760742.746903:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.746919:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.746923:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.746929:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.746943:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.763697:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62279680 -> 62283776 00002000:00010000:3.0:1789760742.763760:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121664 -> 121672 00010000:00010000:3.0:1789760742.763774:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763787:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763796:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763803:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.763808:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763817:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763837:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.763849:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62279680->62283775] (req 62279680->62283775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.763944:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565173632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17095us (17653us total) trans 4294982513 rc 0/0 00000100:00100000:3.0:1789760742.763954:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15216 00000100:00100000:3.0:1789760742.763964:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 680992715540 time 681007124351 state 0x2 ref 0 00000100:00100000:3.0:1789760742.770097:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.800940:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565174016 00000100:00100000:3.0:1789760742.800950:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565174016 00000100:00100000:3.0:1789760742.802052:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681030897211 time 681050733511 state 0x0 ref 1 00000100:00100000:3.0:1789760742.802070:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681050993927 time 681050733511 state 0x1 ref 1 00000100:00100000:3.0:1789760742.802173:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681050993927 time 681062463539 state 0x0 ref 1 00000100:00100000:3.0:1789760742.802194:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.802244:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62291968, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1db58 00010000:00010000:3.0:1789760742.802255:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.802270:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.802274:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.802280:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.802295:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.808630:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62291968 -> 62296064 00002000:00010000:3.0:1789760742.808635:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121688 -> 121696 00010000:00010000:3.0:1789760742.808648:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808661:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808670:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808678:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.808682:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808691:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808775:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.808783:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749ee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62291968->62296063] (req 62291968->62296063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.808918:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6728us (8065us total) trans 4294982516 rc 0/0 00000100:00100000:3.0:1789760742.808928:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15219 00000100:00100000:3.0:1789760742.808938:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681050993927 time 681062463539 state 0x2 ref 0 00000100:00100000:3.0:1789760742.815261:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.849109:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565174400 00000100:00100000:3.0:1789760742.849126:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565174400 00000100:00100000:3.0:1789760742.849210:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681076212802 time 681095067636 state 0x0 ref 1 00000100:00100000:3.0:1789760742.849230:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681095328052 time 681095067636 state 0x1 ref 1 00000100:00100000:3.0:1789760742.849265:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681095328052 time 681109557052 state 0x0 ref 1 00000100:00100000:3.0:1789760742.849278:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.849335:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62304256, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1db70 00010000:00010000:3.0:1789760742.849353:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.849370:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.849373:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.849378:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.849392:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.856610:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62304256 -> 62308352 00002000:00010000:3.0:1789760742.856615:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121712 -> 121720 00010000:00010000:3.0:1789760742.856628:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857176:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857187:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857195:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.857199:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857208:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857228:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.857237:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749efd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62304256->62308351] (req 62304256->62308351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.857334:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8053us (8471us total) trans 4294982519 rc 0/0 00000100:00100000:3.0:1789760742.857345:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15222 00000100:00100000:3.0:1789760742.857355:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681095328052 time 681109557052 state 0x2 ref 0 00000100:00100000:3.0:1789760742.861018:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760742.895500:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565174784 00000100:00100000:3.0:1789760742.895512:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565174784 00000100:00100000:3.0:1789760742.895585:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681122005754 time 681139322950 state 0x0 ref 1 00000100:00100000:3.0:1789760742.895604:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681139583366 time 681139322950 state 0x1 ref 1 00000100:00100000:3.0:1789760742.895686:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681139583366 time 681155977319 state 0x0 ref 1 00000100:00100000:3.0:1789760742.895700:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.895848:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62316544, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1db88 00010000:00010000:3.0:1789760742.895859:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.895884:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.895889:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.895897:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.895914:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.907911:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62316544 -> 62320640 00002000:00010000:3.0:1789760742.907917:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121736 -> 121744 00010000:00010000:3.0:1789760742.907936:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.907952:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.907961:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.907968:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.907974:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.907985:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.908021:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.908029:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f946749f12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62316544->62320639] (req 62316544->62320639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.908347:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565174784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12629us (13038us total) trans 4294982522 rc 0/0 00000100:00100000:3.0:1789760742.908360:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15225 00000100:00100000:3.0:1789760742.908379:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681139583366 time 681155977319 state 0x2 ref 0 00000100:00100000:3.0:1789760742.912682:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.920568:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982523 is committed 00000100:00100000:3.0:1789760742.943360:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565175168 00000100:00100000:3.0:1789760742.943370:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565175168 00000100:00100000:3.0:1789760742.943571:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681173511598 time 681186849880 state 0x0 ref 1 00000100:00100000:3.0:1789760742.943585:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681187110296 time 681186849880 state 0x1 ref 1 00000100:00100000:3.0:1789760742.943682:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681187110296 time 681203973022 state 0x0 ref 1 00000100:00100000:3.0:1789760742.943697:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565175168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.943778:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62328832, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0x1dba0 00010000:00010000:3.0:1789760742.943787:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.943802:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.943807:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.943813:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.943827:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760742.951610:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62328832 -> 62332928 00002000:00010000:3.0:1789760742.951616:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760742 -> 1789760743 00002000:00010000:3.0:1789760742.951619:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760742 -> 1789760743 00002000:00010000:3.0:1789760742.951622:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121760 -> 121768 00010000:00010000:3.0:1789760742.951634:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951648:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951657:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951665:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760742.951669:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951684:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951820:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.951830:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62328832->62332927] (req 62328832->62332927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.952057:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565175168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8359us (8874us total) trans 4294982525 rc 0/0 00000100:00100000:3.0:1789760742.952067:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15228 00000100:00100000:3.0:1789760742.952077:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681187110296 time 681203973022 state 0x2 ref 0 00000100:00100000:3.0:1789760742.957328:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760742.983523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982527 is committed 00000100:00100000:3.0:1789760742.993332:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565175552 00000100:00100000:3.0:1789760742.993341:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565175552 00000100:00100000:3.0:1789760742.993471:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681218162099 time 681236451241 state 0x0 ref 1 00000100:00100000:3.0:1789760742.993486:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681236711657 time 681236451241 state 0x1 ref 1 00000100:00100000:3.0:1789760742.993644:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681236711657 time 681253934448 state 0x0 ref 1 00000100:00100000:3.0:1789760742.993660:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565175552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760742.993755:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62341120, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dbb8 00010000:00010000:3.0:1789760742.993766:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.993782:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760742.993786:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.993793:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.993806:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.004986:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62341120 -> 62345216 00002000:00010000:3.0:1789760743.005002:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121784 -> 121792 00010000:00010000:3.0:1789760743.005021:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005037:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005047:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005055:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.005061:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005072:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005095:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005103:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f946749f3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62341120->62345215] (req 62341120->62345215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.005223:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565175552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11560us (12080us total) trans 4294982528 rc 0/0 00000100:00100000:3.0:1789760743.005235:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15231 00000100:00100000:3.0:1789760743.005246:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681236711657 time 681253934448 state 0x2 ref 0 00000100:00100000:3.0:1789760743.016289:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760743.036257:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982530 is committed 00000100:00100000:3.0:1789760743.039109:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760743.067934:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982532 is committed 00000001:00080000:3.0:1789760743.082507:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982533 is committed 00000100:00100000:3.0:1789760743.086286:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760743.096395:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982534 is committed 00000001:00080000:3.0:1789760743.113131:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982535 is committed 00000100:00100000:3.0:1789760743.137302:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760743.191491:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982540 is committed 00000001:00080000:3.0:1789760743.207383:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982541 is committed 00000001:00080000:3.0:1789760743.219516:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982542 is committed 00000001:00080000:3.0:1789760743.230797:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982543 is committed 00000100:00100000:3.0:1789760743.351274:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760743.386676:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62443520 -> 62447616 00002000:00010000:3.0:1789760743.386682:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 121984 -> 121992 00010000:00010000:3.0:1789760743.386701:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386767:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386777:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386785:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.386791:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386809:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386837:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.386845:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f946749feb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62443520->62447615] (req 62443520->62447615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.386978:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565178752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9619us (9903us total) trans 4294982553 rc 0/0 00000100:00100000:3.0:1789760743.387002:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15256 00000100:00100000:3.0:1789760743.387019:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681623099547 time 681637630657 state 0x2 ref 0 00000100:00100000:3.0:1789760743.396583:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760743.426675:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565179136 00000100:00100000:3.0:1789760743.426687:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565179136 00000100:00100000:3.0:1789760743.426806:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681657442080 time 681671153025 state 0x0 ref 1 00000100:00100000:3.0:1789760743.426827:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681671413441 time 681671153025 state 0x1 ref 1 00000100:00100000:3.0:1789760743.426858:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681671413441 time 681687150261 state 0x0 ref 1 00000100:00100000:3.0:1789760743.426872:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565179136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.426938:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62455808, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dc98 00010000:00010000:3.0:1789760743.426950:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.426972:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.426978:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.426986:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.427013:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.434380:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62455808 -> 62459904 00002000:00010000:3.0:1789760743.434386:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122008 -> 122016 00010000:00010000:3.0:1789760743.434405:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434422:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434432:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434441:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.434447:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434463:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434491:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.434500:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a000 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62455808->62459903] (req 62455808->62459903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.434623:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565179136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7745us (8103us total) trans 4294982556 rc 0/0 00000100:00100000:3.0:1789760743.434636:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15259 00000100:00100000:3.0:1789760743.434649:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681671413441 time 681687150261 state 0x2 ref 0 00000100:00100000:3.0:1789760743.438271:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760743.473926:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62464000 -> 62468096 00002000:00010000:3.0:1789760743.473932:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122024 -> 122032 00010000:00010000:3.0:1789760743.473951:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.473967:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.473978:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.474000:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.474006:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.474019:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.474052:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.474060:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674a00e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62464000->62468095] (req 62464000->62468095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.474187:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565179392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8734us (14546us total) trans 4294982558 rc 0/0 00000100:00100000:3.0:1789760743.474201:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15261 00000100:00100000:3.0:1789760743.474214:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681699809702 time 681725722045 state 0x2 ref 0 00000100:00100000:3.0:1789760743.480189:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565179520 00000100:00100000:3.0:1789760743.480204:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565179520 00000100:00100000:3.0:1789760743.480288:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681699809702 time 681725722045 state 0x0 ref 1 00000100:00100000:3.0:1789760743.480311:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681725982461 time 681725722045 state 0x1 ref 1 00000100:00100000:3.0:1789760743.480351:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681725982461 time 681740642960 state 0x0 ref 1 00000100:00100000:3.0:1789760743.480366:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565179520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.480429:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62468096, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcb0 00010000:00010000:3.0:1789760743.480441:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.480462:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.480468:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.480477:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.480494:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.486472:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62468096 -> 62472192 00002000:00010000:3.0:1789760743.486479:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122032 -> 122040 00010000:00010000:3.0:1789760743.486496:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486510:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486531:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486540:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.486546:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486557:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486590:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.486599:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62468096->62472191] (req 62468096->62472191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.486783:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565179520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6413us (6740us total) trans 4294982559 rc 0/0 00000100:00100000:3.0:1789760743.486794:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15262 00000100:00100000:3.0:1789760743.486808:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681725982461 time 681740642960 state 0x2 ref 0 00000100:00100000:3.0:1789760743.502762:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565179776 00000100:00100000:3.0:1789760743.502775:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565179776 00000100:00100000:3.0:1789760743.502851:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681740903376 time 681751566387 state 0x0 ref 1 00000100:00100000:3.0:1789760743.502876:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681751826803 time 681751566387 state 0x1 ref 1 00000100:00100000:3.0:1789760743.502902:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681751826803 time 681763194498 state 0x0 ref 1 00000100:00100000:3.0:1789760743.502923:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565179776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.502999:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62476288, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcc0 00010000:00010000:3.0:1789760743.503011:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.503037:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.503043:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.503052:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.503068:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.512455:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62476288 -> 62480384 00002000:00010000:3.0:1789760743.512468:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122048 -> 122056 00010000:00010000:3.0:1789760743.512485:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512502:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512512:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512520:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.512525:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512536:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512562:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.512576:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62476288->62480383] (req 62476288->62480383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.512791:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565179776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9870us (10194us total) trans 4294982561 rc 0/0 00000100:00100000:3.0:1789760743.512804:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15264 00000100:00100000:3.0:1789760743.512817:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681751826803 time 681763194498 state 0x2 ref 0 00000100:00100000:3.0:1789760743.522166:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565179904 00000100:00100000:3.0:1789760743.522187:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565179904 00000100:00100000:3.0:1789760743.522272:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681751826803 time 681763194498 state 0x0 ref 1 00000100:00100000:3.0:1789760743.522292:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681763454914 time 681763194498 state 0x1 ref 1 00000100:00100000:3.0:1789760743.522334:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681763454914 time 681782624926 state 0x0 ref 1 00000100:00100000:3.0:1789760743.522349:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565179904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.522423:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62480384, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcc8 00010000:00010000:3.0:1789760743.522435:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.522455:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.522460:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.522467:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.522490:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.532795:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62480384 -> 62484480 00002000:00010000:3.0:1789760743.532801:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122056 -> 122064 00010000:00010000:3.0:1789760743.532817:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532833:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532843:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532852:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.532857:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532867:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532890:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.532898:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a02a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62480384->62484479] (req 62480384->62484479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.533577:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565179904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10674us (12140us total) trans 4294982562 rc 0/0 00000100:00100000:3.0:1789760743.533592:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15265 00000100:00100000:3.0:1789760743.533605:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681763454914 time 681782624926 state 0x2 ref 0 00000100:00100000:3.0:1789760743.566406:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180160 00000100:00100000:3.0:1789760743.566420:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180160 00000100:00100000:3.0:1789760743.566504:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681782885342 time 681802760261 state 0x0 ref 1 00000100:00100000:3.0:1789760743.566523:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681803020677 time 681802760261 state 0x1 ref 1 00000100:00100000:3.0:1789760743.566557:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681803020677 time 681826848557 state 0x0 ref 1 00000100:00100000:3.0:1789760743.566571:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565180160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.566638:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62488576, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcd8 00010000:00010000:3.0:1789760743.566650:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.566671:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.566676:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.566684:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.566746:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.572524:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62488576 -> 62492672 00002000:00010000:3.0:1789760743.572530:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122072 -> 122080 00010000:00010000:3.0:1789760743.572547:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572563:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572573:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572580:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.572586:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572655:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572682:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.572691:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62488576->62492671] (req 62488576->62492671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.572842:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565180160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6266us (6553us total) trans 4294982564 rc 0/0 00000100:00100000:3.0:1789760743.572855:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15267 00000100:00100000:3.0:1789760743.572867:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681803020677 time 681826848557 state 0x2 ref 0 00000100:00100000:3.0:1789760743.576520:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180288 00000100:00100000:3.0:1789760743.576533:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180288 00000100:00100000:3.0:1789760743.576611:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681803020677 time 681826848557 state 0x0 ref 1 00000100:00100000:3.0:1789760743.576630:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681827108973 time 681826848557 state 0x1 ref 1 00000100:00100000:3.0:1789760743.576669:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681827108973 time 681836960941 state 0x0 ref 1 00000100:00100000:3.0:1789760743.576685:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565180288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.576779:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62492672, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dce0 00010000:00010000:3.0:1789760743.576789:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.576911:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.576917:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.576925:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.576942:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.588153:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62492672 -> 62496768 00002000:00010000:3.0:1789760743.588159:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122080 -> 122088 00010000:00010000:3.0:1789760743.588178:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588193:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588203:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588213:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.588219:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588229:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588252:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.588260:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a03f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62492672->62496767] (req 62492672->62496767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.588461:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565180288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11772us (12067us total) trans 4294982565 rc 0/0 00000100:00100000:3.0:1789760743.588476:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15268 00000100:00100000:3.0:1789760743.588488:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681827108973 time 681836960941 state 0x2 ref 0 00000100:00100000:3.0:1789760743.617088:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180544 00000100:00100000:3.0:1789760743.617099:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180544 00000100:00100000:3.0:1789760743.617155:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681837221357 time 681854590419 state 0x0 ref 1 00000100:00100000:3.0:1789760743.617171:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681854850835 time 681854590419 state 0x1 ref 1 00000100:00100000:3.0:1789760743.617323:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681854850835 time 681877614246 state 0x0 ref 1 00000100:00100000:3.0:1789760743.617337:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565180544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.617385:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62500864, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcf0 00010000:00010000:3.0:1789760743.617395:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.617411:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.617416:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.617423:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.617436:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.626244:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62500864 -> 62504960 00002000:00010000:3.0:1789760743.626250:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122096 -> 122104 00010000:00010000:3.0:1789760743.626263:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626282:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626291:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626298:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.626302:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626310:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626398:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.626407:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a04d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62500864->62504959] (req 62500864->62504959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.626618:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565180544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9278us (9949us total) trans 4294982567 rc 0/0 00000100:00100000:3.0:1789760743.626630:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15270 00000100:00100000:3.0:1789760743.626641:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681854850835 time 681877614246 state 0x2 ref 0 00000100:00100000:3.0:1789760743.634370:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180672 00000100:00100000:3.0:1789760743.634383:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180672 00000100:00100000:3.0:1789760743.634516:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681854850835 time 681877614246 state 0x0 ref 1 00000100:00100000:3.0:1789760743.634531:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681877874662 time 681877614246 state 0x1 ref 1 00000100:00100000:3.0:1789760743.634618:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681877874662 time 681894908523 state 0x0 ref 1 00000100:00100000:3.0:1789760743.634632:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565180672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.634693:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62504960, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dcf8 00010000:00010000:3.0:1789760743.634723:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.634739:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.634745:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.634752:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.634766:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.643424:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62504960 -> 62509056 00002000:00010000:3.0:1789760743.643432:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122104 -> 122112 00010000:00010000:3.0:1789760743.643447:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643459:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643475:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643482:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.643487:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643495:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643619:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.643628:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a054 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62504960->62509055] (req 62504960->62509055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.643834:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565180672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9199us (10680us total) trans 4294982568 rc 0/0 00000100:00100000:3.0:1789760743.643844:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15271 00000100:00100000:3.0:1789760743.643853:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681877874662 time 681894908523 state 0x2 ref 0 00000100:00100000:3.0:1789760743.648381:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180800 00000100:00100000:3.0:1789760743.648392:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180800 00000100:00100000:3.0:1789760743.648466:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681877874662 time 681894908523 state 0x0 ref 1 00000100:00100000:3.0:1789760743.648484:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681895168939 time 681894908523 state 0x1 ref 1 00000100:00100000:3.0:1789760743.648520:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681895168939 time 681908811024 state 0x0 ref 1 00000100:00100000:3.0:1789760743.648535:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565180800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.648591:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62509056, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd00 00010000:00010000:3.0:1789760743.648602:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a05b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.648621:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.648626:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.648632:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62509056->62513151] (req 62509056->62513151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.648647:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62509056->62513151] (req 62509056->62513151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.674427:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565180928 00000100:00100000:3.0:1789760743.674441:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565180928 00000100:00100000:3.0:1789760743.674517:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681895168939 time 681908811024 state 0x0 ref 1 00000100:00100000:3.0:1789760743.674538:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681909071440 time 681908811024 state 0x1 ref 1 00000100:00100000:3.0:1789760743.674572:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681909071440 time 681934863784 state 0x0 ref 1 00000100:00100000:3.0:1789760743.674587:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565180928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.674654:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62513152, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd08 00010000:00010000:3.0:1789760743.674666:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.674685:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.674690:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.674699:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62513152->62517247] (req 62513152->62517247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.674745:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62513152->62517247] (req 62513152->62517247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.697569:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565181056 00000100:00100000:3.0:1789760743.697580:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565181056 00000100:00100000:3.0:1789760743.697633:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681909071440 time 681934863784 state 0x0 ref 1 00000100:00100000:3.0:1789760743.697648:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681935124200 time 681934863784 state 0x1 ref 1 00000100:00100000:3.0:1789760743.697810:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681935124200 time 681958101107 state 0x0 ref 1 00000100:00100000:3.0:1789760743.697827:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565181056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.697875:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62517248, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd10 00010000:00010000:3.0:1789760743.697885:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.697900:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.697905:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.697911:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.697938:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.706095:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62517248 -> 62521344 00002000:00010000:3.0:1789760743.706102:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122128 -> 122136 00010000:00010000:3.0:1789760743.706119:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706133:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706143:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706152:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.706157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706167:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706192:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.706201:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62517248->62521343] (req 62517248->62521343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.706431:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565181056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8602us (9357us total) trans 4294982571 rc 0/0 00000100:00100000:3.0:1789760743.706444:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15274 00000100:00100000:3.0:1789760743.706456:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681935124200 time 681958101107 state 0x2 ref 0 00000100:00100000:3.0:1789760743.737492:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565181440 00000100:00100000:3.0:1789760743.737553:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565181440 00000100:00100000:3.0:1789760743.737619:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681971513163 time 681984832207 state 0x0 ref 1 00000100:00100000:3.0:1789760743.737636:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681985092623 time 681984832207 state 0x1 ref 1 00000100:00100000:3.0:1789760743.737890:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681985092623 time 681998181256 state 0x0 ref 1 00000100:00100000:3.0:1789760743.737905:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565181440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.737966:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62529536, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd28 00010000:00010000:3.0:1789760743.737978:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.738006:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1789760743.738011:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.738018:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.738034:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.747611:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62529536 -> 62533632 00002000:00010000:3.0:1789760743.747616:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122152 -> 122160 00010000:00010000:3.0:1789760743.747630:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748557:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748569:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748576:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.748581:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748590:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748612:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.748619:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a07e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62529536->62533631] (req 62529536->62533631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.748743:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565181440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10835us (11710us total) trans 4294982574 rc 0/0 00000100:00100000:3.0:1789760743.748754:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15277 00000100:00100000:3.0:1789760743.748764:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 681985092623 time 681998181256 state 0x2 ref 0 00000100:00100000:3.0:1789760743.793885:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565181824 00000100:00100000:3.0:1789760743.793895:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565181824 00000100:00100000:3.0:1789760743.793946:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682016026764 time 682032427818 state 0x0 ref 1 00000100:00100000:3.0:1789760743.793961:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682032688234 time 682032427818 state 0x1 ref 1 00000100:00100000:3.0:1789760743.794113:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682032688234 time 682054403049 state 0x0 ref 1 00000100:00100000:3.0:1789760743.794127:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565181824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.794170:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62541824, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd40 00010000:00010000:3.0:1789760743.794181:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.794196:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760743.794200:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.794207:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.794222:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.802790:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62541824 -> 62545920 00002000:00010000:3.0:1789760743.802803:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122176 -> 122184 00010000:00010000:3.0:1789760743.802822:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802837:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802847:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802857:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.802863:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802874:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802899:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.802908:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62541824->62545919] (req 62541824->62545919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.803287:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565181824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9155us (9612us total) trans 4294982577 rc 0/0 00000100:00100000:3.0:1789760743.803299:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15280 00000100:00100000:3.0:1789760743.803312:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682032688234 time 682054403049 state 0x2 ref 0 00000100:00100000:3.0:1789760743.809456:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760743.823745:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62545920 -> 62550016 00002000:00010000:3.0:1789760743.823757:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122184 -> 122192 00010000:00010000:3.0:1789760743.823774:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823790:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823802:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823811:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.823817:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823827:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823853:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.823863:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a09a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62545920->62550015] (req 62545920->62550015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.823996:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565181952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14185us (14539us total) trans 4294982578 rc 0/0 00000100:00100000:3.0:1789760743.824010:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15281 00000100:00100000:3.0:1789760743.824021:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682054663465 time 682070074776 state 0x2 ref 0 00000100:00100000:3.0:1789760743.850738:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565182208 00000100:00100000:3.0:1789760743.850751:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565182208 00000100:00100000:3.0:1789760743.850817:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682070335192 time 682095636354 state 0x0 ref 1 00000100:00100000:3.0:1789760743.850835:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682095896770 time 682095636354 state 0x1 ref 1 00000100:00100000:3.0:1789760743.850869:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682095896770 time 682111160555 state 0x0 ref 1 00000100:00100000:3.0:1789760743.850882:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565182208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.850943:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62554112, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd58 00010000:00010000:3.0:1789760743.850954:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.850974:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760743.850980:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.850996:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.851014:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.857156:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62554112 -> 62558208 00002000:00010000:3.0:1789760743.857163:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122200 -> 122208 00010000:00010000:3.0:1789760743.857184:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857200:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857211:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857220:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.857225:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857236:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857263:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.857272:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a0a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62554112->62558207] (req 62554112->62558207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.857408:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565182208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6520us (6968us total) trans 4294982580 rc 0/0 00000100:00100000:3.0:1789760743.857422:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15283 00000100:00100000:3.0:1789760743.857436:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682095896770 time 682111160555 state 0x2 ref 0 00000100:00100000:3.0:1789760743.864016:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760743.891055:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565182592 00000100:00100000:3.0:1789760743.891067:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565182592 00000100:00100000:3.0:1789760743.891142:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682124825950 time 682139732459 state 0x0 ref 1 00000100:00100000:3.0:1789760743.891162:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682139992875 time 682139732459 state 0x1 ref 1 00000100:00100000:3.0:1789760743.891198:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682139992875 time 682151489804 state 0x0 ref 1 00000100:00100000:3.0:1789760743.891212:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565182592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.891274:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62566400, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd70 00010000:00010000:3.0:1789760743.891286:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.891307:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760743.891312:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.891320:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.891349:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760743.897581:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62566400 -> 62570496 00002000:00010000:3.0:1789760743.897588:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122224 -> 122232 00010000:00010000:3.0:1789760743.897606:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897627:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897637:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897645:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760743.897650:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897661:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897689:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.897697:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62566400->62570495] (req 62566400->62570495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.897892:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565182592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6676us (7089us total) trans 4294982583 rc 0/0 00000100:00100000:3.0:1789760743.897905:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15286 00000100:00100000:3.0:1789760743.897917:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682139992875 time 682151489804 state 0x2 ref 0 00000100:00100000:3.0:1789760743.909306:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760743.915410:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982584 is committed 00000001:00080000:3.0:1789760743.925348:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982585 is committed 00000100:00100000:3.0:1789760743.934265:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565182976 00000100:00100000:3.0:1789760743.934278:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565182976 00000100:00100000:3.0:1789760743.934356:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682170485655 time 682180989924 state 0x0 ref 1 00000100:00100000:3.0:1789760743.934376:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682181250340 time 682180989924 state 0x1 ref 1 00000100:00100000:3.0:1789760743.934409:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682181250340 time 682194700704 state 0x0 ref 1 00000100:00100000:3.0:1789760743.934424:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565182976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.934488:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62578688, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0x1dd88 00010000:00010000:3.0:1789760743.934501:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.934521:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760743.934527:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.934535:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62578688->62582783] (req 62578688->62582783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.934553:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62578688->62582783] (req 62578688->62582783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760743.945114:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982586 is committed 00000100:00100000:3.0:1789760743.952295:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760743.992578:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565183360 00000100:00100000:3.0:1789760743.992593:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565183360 00000100:00100000:3.0:1789760743.992677:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682213141463 time 682233471089 state 0x0 ref 1 00000100:00100000:3.0:1789760743.992698:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682233731505 time 682233471089 state 0x1 ref 1 00000100:00100000:3.0:1789760743.992789:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682233731505 time 682253080764 state 0x0 ref 1 00000100:00100000:3.0:1789760743.992809:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565183360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760743.992871:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62590976, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1dda0 00010000:00010000:3.0:1789760743.992882:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.992901:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760743.992906:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.992914:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.992931:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.001689:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62590976 -> 62595072 00002000:00010000:3.0:1789760744.001695:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122272 -> 122280 00010000:00010000:3.0:1789760744.001875:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001891:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001900:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001908:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.001914:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001924:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001950:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.001959:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a0e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62590976->62595071] (req 62590976->62595071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.007974:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760744.042637:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760744.057810:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565183872 00000100:00100000:3.0:1789760744.057823:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565183872 00000100:00100000:3.0:1789760744.057895:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682291614584 time 682303193605 state 0x0 ref 1 00000100:00100000:3.0:1789760744.057913:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682303454021 time 682303193605 state 0x1 ref 1 00000100:00100000:3.0:1789760744.057958:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682303454021 time 682318249311 state 0x0 ref 1 00000100:00100000:3.0:1789760744.057973:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565183872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.058054:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62607360, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1ddc0 00010000:00010000:3.0:1789760744.058066:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.058087:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.058092:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.058100:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.058117:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.068224:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62607360 -> 62611456 00002000:00010000:3.0:1789760744.068230:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122304 -> 122312 00010000:00010000:3.0:1789760744.068249:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068264:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068275:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068283:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.068288:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068298:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068323:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.068387:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a103 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62607360->62611455] (req 62607360->62611455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.068556:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565183872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10578us (10942us total) trans 4294982593 rc 0/0 00000100:00100000:3.0:1789760744.068567:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15296 00000100:00100000:3.0:1789760744.068579:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682303454021 time 682318249311 state 0x2 ref 0 00000001:00080000:3.0:1789760744.147729:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982597 is committed 00000001:00080000:3.0:1789760744.166084:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982598 is committed 00000001:00080000:3.0:1789760744.196151:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982600 is committed 00000100:00100000:3.0:1789760744.199944:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760744.209857:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62640128 -> 62644224 00002000:00010000:3.0:1789760744.209866:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122368 -> 122376 00010000:00010000:3.0:1789760744.209884:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209901:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209912:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209934:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.209939:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209949:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209974:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.209990:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674a13b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62640128->62644223] (req 62640128->62644223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.210246:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565184896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9841us (10317us total) trans 4294982601 rc 0/0 00000100:00100000:3.0:1789760744.210260:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15304 00000100:00100000:3.0:1789760744.210272:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682446989401 time 682460677591 state 0x2 ref 0 00000100:00100000:3.0:1789760744.215105:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d47699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:769fd61a-9f51-46fc-af80-467e2ca172bc:3458:1876699580059648:0@lo:400:kworker.0 00000100:00100000:3.0:1789760744.216149:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565185024 00000100:00100000:3.0:1789760744.216158:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565185024 00000100:00100000:3.0:1789760744.216223:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682446989401 time 682460677591 state 0x0 ref 1 00000100:00100000:3.0:1789760744.216242:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682460938007 time 682460677591 state 0x1 ref 1 00000100:00100000:3.0:1789760744.216271:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682460938007 time 682476563153 state 0x0 ref 1 00000100:00100000:3.0:1789760744.216284:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565185024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.216344:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62644224, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1de08 00010000:00010000:3.0:1789760744.216356:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.216375:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.216381:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.216388:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.216405:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.222218:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62644224 -> 62648320 00002000:00010000:3.0:1789760744.222224:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122376 -> 122384 00010000:00010000:3.0:1789760744.222241:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222256:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222267:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222282:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.222288:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222299:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222335:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.222344:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a142 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62644224->62648319] (req 62644224->62648319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.222530:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565185024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6241us (6672us total) trans 4294982602 rc 0/0 00000100:00100000:3.0:1789760744.222543:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15305 00000100:00100000:3.0:1789760744.222556:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682460938007 time 682476563153 state 0x2 ref 0 00000100:00100000:3.0:1789760744.246661:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565185280 00000100:00100000:3.0:1789760744.246674:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565185280 00000100:00100000:3.0:1789760744.246791:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682476823569 time 682495533517 state 0x0 ref 1 00000100:00100000:3.0:1789760744.246810:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682495793933 time 682495533517 state 0x1 ref 1 00000100:00100000:3.0:1789760744.247009:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682495793933 time 682507299332 state 0x0 ref 1 00000100:00100000:3.0:1789760744.247030:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565185280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.247090:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62652416, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1de18 00010000:00010000:3.0:1789760744.247100:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.247119:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.247124:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.247133:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.247151:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.252136:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62652416 -> 62656512 00002000:00010000:3.0:1789760744.252142:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122392 -> 122400 00010000:00010000:3.0:1789760744.252160:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252176:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252188:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252197:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.252204:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252216:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252242:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.252252:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a150 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62652416->62656511] (req 62652416->62656511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.252375:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565185280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5342us (5837us total) trans 4294982604 rc 0/0 00000100:00100000:3.0:1789760744.252388:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15307 00000100:00100000:3.0:1789760744.252402:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682495793933 time 682507299332 state 0x2 ref 0 00000100:00100000:3.0:1789760744.260131:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565185408 00000100:00100000:3.0:1789760744.260143:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565185408 00000100:00100000:3.0:1789760744.260211:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682495793933 time 682507299332 state 0x0 ref 1 00000100:00100000:3.0:1789760744.260228:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682507559748 time 682507299332 state 0x1 ref 1 00000100:00100000:3.0:1789760744.260263:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682507559748 time 682520554903 state 0x0 ref 1 00000100:00100000:3.0:1789760744.260275:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565185408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.260335:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62656512, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1de20 00010000:00010000:3.0:1789760744.260347:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.260367:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.260373:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.260381:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.260397:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.270778:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62656512 -> 62660608 00002000:00010000:3.0:1789760744.270785:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122400 -> 122408 00010000:00010000:3.0:1789760744.270802:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270816:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270827:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270834:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.270839:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270849:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270875:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.270883:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a157 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62656512->62660607] (req 62656512->62660607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.271031:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565185408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10751us (11140us total) trans 4294982605 rc 0/0 00000100:00100000:3.0:1789760744.271044:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15308 00000100:00100000:3.0:1789760744.271056:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682507559748 time 682520554903 state 0x2 ref 0 00000001:00080000:3.0:1789760744.285392:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982606 is committed 00000100:00100000:3.0:1789760744.290314:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565185664 00000100:00100000:3.0:1789760744.290328:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565185664 00000100:00100000:3.0:1789760744.290465:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682520815319 time 682539836286 state 0x0 ref 1 00000100:00100000:3.0:1789760744.290484:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682540096702 time 682539836286 state 0x1 ref 1 00000100:00100000:3.0:1789760744.290549:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682540096702 time 682550840228 state 0x0 ref 1 00000100:00100000:3.0:1789760744.290565:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565185664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.290629:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62664704, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1de30 00010000:00010000:3.0:1789760744.290640:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a165 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.290667:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.290673:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.290682:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62664704->62668799] (req 62664704->62668799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.290700:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62664704->62668799] (req 62664704->62668799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.316787:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760744.389650:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760744.450971:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760744.477955:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62697472 -> 62701568 00002000:00010000:3.0:1789760744.477962:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122480 -> 122488 00010000:00010000:3.0:1789760744.477990:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478006:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478017:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478026:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.478031:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478046:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478069:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.478076:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674a19d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62697472->62701567] (req 62697472->62701567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.478249:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565186688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14292us (14601us total) trans 4294982615 rc 0/0 00000100:00100000:3.0:1789760744.478263:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15318 00000100:00100000:3.0:1789760744.478276:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682711794292 time 682724227293 state 0x2 ref 0 00000001:00080000:3.0:1789760744.500290:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982617 is committed 00000100:00100000:3.0:1789760744.504677:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565187072 00000100:00100000:3.0:1789760744.504690:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565187072 00000100:00100000:3.0:1789760744.504841:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682742237476 time 682752698650 state 0x0 ref 1 00000100:00100000:3.0:1789760744.504860:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682752959066 time 682752698650 state 0x1 ref 1 00000100:00100000:3.0:1789760744.505045:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682752959066 time 682765334920 state 0x0 ref 1 00000100:00100000:3.0:1789760744.505061:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565187072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.505120:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62709760, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1de88 00010000:00010000:3.0:1789760744.505133:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a1b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.505152:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.505157:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.505165:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a1b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62709760->62713855] (req 62709760->62713855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.505183:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a1b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62709760->62713855] (req 62709760->62713855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760744.510951:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982618 is committed 00000001:00080000:3.0:1789760744.521783:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982619 is committed 00000100:00100000:3.0:1789760744.529097:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760744.536645:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982620 is committed 00000100:00100000:3.0:1789760744.544464:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565187456 00000100:00100000:3.0:1789760744.544478:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565187456 00000100:00100000:3.0:1789760744.544555:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682776957201 time 682790538428 state 0x0 ref 1 00000100:00100000:3.0:1789760744.544574:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682790798844 time 682790538428 state 0x1 ref 1 00000100:00100000:3.0:1789760744.544732:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682790798844 time 682805023004 state 0x0 ref 1 00000100:00100000:3.0:1789760744.544748:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565187456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.544808:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62722048, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1dea0 00010000:00010000:3.0:1789760744.544819:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.544843:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.544848:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.544856:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.544872:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.552629:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62722048 -> 62726144 00002000:00010000:3.0:1789760744.552636:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122528 -> 122536 00010000:00010000:3.0:1789760744.552654:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552669:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552680:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552688:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.552694:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552734:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552771:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.552780:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62722048->62726143] (req 62722048->62726143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.553008:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565187456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8257us (8718us total) trans 4294982621 rc 0/0 00000100:00100000:3.0:1789760744.553020:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15324 00000100:00100000:3.0:1789760744.553032:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682790798844 time 682805023004 state 0x2 ref 0 00000001:00080000:3.0:1789760744.586759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982623 is committed 00000100:00100000:3.0:1789760744.592551:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565187840 00000100:00100000:3.0:1789760744.592565:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565187840 00000100:00100000:3.0:1789760744.592651:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682818543618 time 682833190385 state 0x0 ref 1 00000100:00100000:3.0:1789760744.592670:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682833450801 time 682833190385 state 0x1 ref 1 00000100:00100000:3.0:1789760744.592730:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682833450801 time 682852995952 state 0x0 ref 1 00000100:00100000:3.0:1789760744.592747:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4227aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565187840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.592811:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62734336, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1deb8 00010000:00010000:3.0:1789760744.592823:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.592851:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.592856:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.592864:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.592881:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.600550:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62734336 -> 62738432 00002000:00010000:3.0:1789760744.600743:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122552 -> 122560 00010000:00010000:3.0:1789760744.600763:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600778:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600790:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600799:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.600805:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600818:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600850:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.600860:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62734336->62738431] (req 62734336->62738431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.601110:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4227aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565187840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8359us (8695us total) trans 4294982624 rc 0/0 00000100:00100000:3.0:1789760744.601123:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15327 00000100:00100000:3.0:1789760744.601135:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682833450801 time 682852995952 state 0x2 ref 0 00000100:00100000:3.0:1789760744.648592:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565188224 00000100:00100000:3.0:1789760744.648601:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565188224 00000100:00100000:3.0:1789760744.648652:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682868589407 time 682884965243 state 0x0 ref 1 00000100:00100000:3.0:1789760744.648666:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682885225659 time 682884965243 state 0x1 ref 1 00000100:00100000:3.0:1789760744.648694:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 682885225659 time 682908986612 state 0x0 ref 1 00000100:00100000:3.0:1789760744.648741:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565188224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.648787:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62746624, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1ded0 00010000:00010000:3.0:1789760744.648797:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.648813:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1789760744.648818:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.648825:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62746624->62750719] (req 62746624->62750719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.648839:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62746624->62750719] (req 62746624->62750719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760744.676792:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982628 is committed 00000001:00080000:3.0:1789760744.719103:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982629 is committed 00000001:00080000:3.0:1789760744.740081:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982630 is committed 00000001:00080000:3.0:1789760744.758265:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982631 is committed 00002000:00010000:3.0:1789760744.781994:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62767104 -> 62771200 00002000:00010000:3.0:1789760744.782000:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122616 -> 122624 00010000:00010000:3.0:1789760744.782019:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782032:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782043:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782051:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.782057:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782066:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782096:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.782105:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674a214 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62767104->62771199] (req 62767104->62771199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.782520:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565188864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11680us (12697us total) trans 4294982632 rc 0/0 00000100:00100000:3.0:1789760744.782533:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15335 00000100:00100000:3.0:1789760744.782544:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683011157915 time 683031111309 state 0x2 ref 0 00000001:00080000:3.0:1789760744.798556:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982633 is committed 00000001:00080000:3.0:1789760744.819501:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982634 is committed 00000100:00100000:3.0:1789760744.825482:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565189248 00000100:00100000:3.0:1789760744.825496:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565189248 00000100:00100000:3.0:1789760744.825571:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683049686804 time 683071114735 state 0x0 ref 1 00000100:00100000:3.0:1789760744.825591:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683071375151 time 683071114735 state 0x1 ref 1 00000100:00100000:3.0:1789760744.825628:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683071375151 time 683085919876 state 0x0 ref 1 00000100:00100000:3.0:1789760744.825643:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565189248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.826055:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62779392, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1df10 00010000:00010000:3.0:1789760744.826068:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.826095:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760744.826100:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.826108:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.826125:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760744.835556:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62779392 -> 62783488 00002000:00010000:3.0:1789760744.835566:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122640 -> 122648 00010000:00010000:3.0:1789760744.835586:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835601:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835611:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835620:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760744.835626:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835637:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835669:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.835677:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a229 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62779392->62783487] (req 62779392->62783487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.835904:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565189248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10254us (10784us total) trans 4294982635 rc 0/0 00000100:00100000:3.0:1789760744.836151:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15338 00000100:00100000:3.0:1789760744.836165:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683071375151 time 683085919876 state 0x2 ref 0 00000100:00100000:3.0:1789760744.891211:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565189632 00000100:00100000:3.0:1789760744.891221:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565189632 00000100:00100000:3.0:1789760744.891273:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683107039331 time 683135688641 state 0x0 ref 1 00000100:00100000:3.0:1789760744.891288:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683135949057 time 683135688641 state 0x1 ref 1 00000100:00100000:3.0:1789760744.891317:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683135949057 time 683151609179 state 0x0 ref 1 00000100:00100000:3.0:1789760744.891336:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565189632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.891379:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62791680, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1df28 00010000:00010000:3.0:1789760744.891388:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a23e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.891403:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760744.891407:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.891414:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62791680->62795775] (req 62791680->62795775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.891428:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62791680->62795775] (req 62791680->62795775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.940378:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565189888 00000100:00100000:3.0:1789760744.940396:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565189888 00000100:00100000:3.0:1789760744.940484:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683151869595 time 683177628735 state 0x0 ref 1 00000100:00100000:3.0:1789760744.940505:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683177889151 time 683177628735 state 0x1 ref 1 00000100:00100000:3.0:1789760744.940544:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683177889151 time 683200835884 state 0x0 ref 1 00000100:00100000:3.0:1789760744.940560:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565189888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760744.940623:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62799872, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0x1df38 00010000:00010000:3.0:1789760744.940634:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a24c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.940652:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760744.940658:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.940666:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62799872->62803967] (req 62799872->62803967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.940684:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62799872->62803967] (req 62799872->62803967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.015048:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565190400 00000100:00100000:3.0:1789760745.015063:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565190400 00000100:00100000:3.0:1789760745.015137:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683239493190 time 683258074647 state 0x0 ref 1 00000100:00100000:3.0:1789760745.015157:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683258335063 time 683258074647 state 0x1 ref 1 00000100:00100000:3.0:1789760745.015201:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683258335063 time 683275491895 state 0x0 ref 1 00000100:00100000:3.0:1789760745.015215:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565190400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760745.015278:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62816256, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0x1df58 00010000:00010000:3.0:1789760745.015289:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.015310:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760745.015316:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760745.015324:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.015341:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760745.021221:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62816256 -> 62820352 00002000:00010000:3.0:1789760745.021230:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122712 -> 122720 00010000:00010000:3.0:1789760745.021243:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021261:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021270:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021277:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.021282:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021291:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021311:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.021319:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62816256->62820351] (req 62816256->62820351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.021422:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565190400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6205us (6545us total) trans 4294982644 rc 0/0 00000100:00100000:3.0:1789760745.021433:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15347 00000100:00100000:3.0:1789760745.021453:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683258335063 time 683275491895 state 0x2 ref 0 00000100:00100000:3.0:1789760745.061182:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565190784 00000100:00100000:3.0:1789760745.061196:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565190784 00000100:00100000:3.0:1789760745.061258:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683295898167 time 683311117437 state 0x0 ref 1 00000100:00100000:3.0:1789760745.061276:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683311377853 time 683311117437 state 0x1 ref 1 00000100:00100000:3.0:1789760745.061307:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683311377853 time 683321599017 state 0x0 ref 1 00000100:00100000:3.0:1789760745.061320:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565190784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760745.061369:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62828544, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0x1df70 00010000:00010000:3.0:1789760745.061379:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.061396:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760745.061402:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760745.061409:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.061424:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760745.068196:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62828544 -> 62832640 00002000:00010000:3.0:1789760745.068201:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122736 -> 122744 00010000:00010000:3.0:1789760745.068215:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068422:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068437:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068444:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.068449:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068459:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068478:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.068486:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a27d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62828544->62832639] (req 62828544->62832639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.068578:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565190784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7256us (7474us total) trans 4294982647 rc 0/0 00000100:00100000:3.0:1789760745.068588:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15350 00000100:00100000:3.0:1789760745.068596:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683311377853 time 683321599017 state 0x2 ref 0 00000100:00100000:3.0:1789760745.071922:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.125223:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565191168 00000100:00100000:3.0:1789760745.125232:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565191168 00000100:00100000:3.0:1789760745.125279:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683332724539 time 683359666725 state 0x0 ref 1 00000100:00100000:3.0:1789760745.125296:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683359927141 time 683359666725 state 0x1 ref 1 00000100:00100000:3.0:1789760745.125332:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683359927141 time 683385623696 state 0x0 ref 1 00000100:00100000:3.0:1789760745.125345:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565191168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760745.125551:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62840832, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0x1df88 00010000:00010000:3.0:1789760745.125561:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.125577:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1789760745.125582:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760745.125589:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62840832->62844927] (req 62840832->62844927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.125602:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62840832->62844927] (req 62840832->62844927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.140878:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.196142:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.254932:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.310822:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760745.328065:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62881792 -> 62885888 00002000:00010000:3.0:1789760745.328077:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122840 -> 122848 00010000:00010000:3.0:1789760745.328094:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328114:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328124:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328133:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.328139:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328148:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328171:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.328179:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674a2d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62881792->62885887] (req 62881792->62885887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.328562:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565192448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17442us (17746us total) trans 4294982660 rc 0/0 00000100:00100000:3.0:1789760745.328576:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15363 00000100:00100000:3.0:1789760745.328587:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 683544320357 time 683571391276 state 0x2 ref 0 00000001:00080000:3.0:1789760745.361475:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982662 is committed 00000100:00100000:3.0:1789760745.367073:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565192832 00000100:00100000:3.0:1789760745.367087:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565192832 00000001:00080000:3.0:1789760745.372537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982663 is committed 00000001:00080000:3.0:1789760745.432781:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982667 is committed 00000001:00080000:3.0:1789760745.448629:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982668 is committed 00000100:00100000:3.0:1789760745.454589:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760745.465220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982669 is committed 00000100:00100000:3.0:1789760745.479634:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.570032:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.580298:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.602078:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760745.613720:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982678 is committed 00000001:00080000:3.0:1789760745.632244:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982679 is committed 00000001:00080000:3.0:1789760745.644472:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982680 is committed 00000100:00100000:3.0:1789760745.655687:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760745.664514:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982681 is committed 00000001:00080000:3.0:1789760745.676252:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982682 is committed 00000001:00080000:3.0:1789760745.687940:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982683 is committed 00000100:00100000:3.0:1789760745.695019:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760745.701157:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982684 is committed 00000001:00080000:3.0:1789760745.712749:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982685 is committed 00000001:00080000:3.0:1789760745.743664:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982686 is committed 00000100:00100000:3.0:1789760745.771064:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760745.807000:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982688 is committed 00000001:00080000:3.0:1789760745.835649:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982689 is committed 00000100:00100000:3.0:1789760745.841958:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.883417:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.883477:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760745.883511:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760745.885236:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760745.923334:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760745.955070:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63029248 -> 63033344 00002000:00010000:3.0:1789760745.955079:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760745 -> 1789760746 00002000:00010000:3.0:1789760745.955082:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760745 -> 1789760746 00002000:00010000:3.0:1789760745.955084:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123128 -> 123136 00010000:00010000:3.0:1789760745.955098:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955111:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955120:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955127:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.955132:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955140:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955161:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.955169:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a3d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63029248->63033343] (req 63029248->63033343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.955309:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565197440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17546us (17804us total) trans 4294982696 rc 0/0 00000100:00100000:3.0:1789760745.955329:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15399 00000100:00100000:3.0:1789760745.955346:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684184210519 time 684198039604 state 0x2 ref 0 00000100:00100000:3.0:1789760745.972055:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760745.979735:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63037440 -> 63041536 00002000:00010000:3.0:1789760745.979740:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123144 -> 123152 00010000:00010000:3.0:1789760745.979754:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979768:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979777:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979785:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.979789:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979799:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979818:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.979825:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674a3e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63037440->63041535] (req 63037440->63041535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.979916:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565197696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7307us (7857us total) trans 4294982698 rc 0/0 00000100:00100000:3.0:1789760745.979928:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15401 00000100:00100000:3.0:1789760745.979937:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684221962173 time 684232874147 state 0x2 ref 0 00000100:00100000:3.0:1789760745.985590:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565197824 00000100:00100000:3.0:1789760745.985601:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565197824 00000100:00100000:3.0:1789760745.985657:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684221962173 time 684232874147 state 0x0 ref 1 00000100:00100000:3.0:1789760745.985673:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684233134563 time 684232874147 state 0x1 ref 1 00000100:00100000:3.0:1789760745.985752:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684233134563 time 684246043467 state 0x0 ref 1 00000100:00100000:3.0:1789760745.985766:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565197824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760745.985813:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63041536, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e110 00010000:00010000:3.0:1789760745.985824:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.985841:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760745.985846:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760745.985853:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.985866:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760745.991819:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63041536 -> 63045632 00002000:00010000:3.0:1789760745.991824:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123152 -> 123160 00010000:00010000:3.0:1789760745.991837:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991848:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991857:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991864:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760745.991869:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991878:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991901:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.991909:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63041536->63045631] (req 63041536->63045631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760745.992093:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565197824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6325us (6890us total) trans 4294982699 rc 0/0 00000100:00100000:3.0:1789760745.992105:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15402 00000100:00100000:3.0:1789760745.992115:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684233134563 time 684246043467 state 0x2 ref 0 00000100:00100000:3.0:1789760746.012684:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760746.027683:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565198208 00000100:00100000:3.0:1789760746.027693:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565198208 00000100:00100000:3.0:1789760746.027788:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684259202030 time 684273419976 state 0x0 ref 1 00000100:00100000:3.0:1789760746.027805:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684273680392 time 684273419976 state 0x1 ref 1 00000100:00100000:3.0:1789760746.027831:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684273680392 time 684288122890 state 0x0 ref 1 00000100:00100000:3.0:1789760746.027845:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565198208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.027892:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63053824, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e128 00010000:00010000:3.0:1789760746.027901:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.027917:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.027921:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.027927:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.027941:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.032130:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63053824 -> 63057920 00002000:00010000:3.0:1789760746.032136:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123176 -> 123184 00010000:00010000:3.0:1789760746.032150:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032163:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032173:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032181:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.032185:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032194:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032213:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.032221:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a3fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63053824->63057919] (req 63053824->63057919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.032426:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565198208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4464us (4775us total) trans 4294982702 rc 0/0 00000100:00100000:3.0:1789760746.032437:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15405 00000100:00100000:3.0:1789760746.032446:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684273680392 time 684288122890 state 0x2 ref 0 00000100:00100000:3.0:1789760746.060423:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565198464 00000100:00100000:3.0:1789760746.060434:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565198464 00000100:00100000:3.0:1789760746.060493:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684288383306 time 684300436406 state 0x0 ref 1 00000100:00100000:3.0:1789760746.060510:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684300696822 time 684300436406 state 0x1 ref 1 00000100:00100000:3.0:1789760746.060538:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684300696822 time 684320829836 state 0x0 ref 1 00000100:00100000:3.0:1789760746.061008:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565198464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.061075:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63062016, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e138 00010000:00010000:3.0:1789760746.061085:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.061102:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.061107:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.061114:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.061129:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.068235:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63062016 -> 63066112 00002000:00010000:3.0:1789760746.068240:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123192 -> 123200 00010000:00010000:3.0:1789760746.068254:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068274:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068284:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068292:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.068296:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068306:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068326:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.068335:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a40c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63062016->63066111] (req 63062016->63066111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.068429:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565198464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7436us (8523us total) trans 4294982704 rc 0/0 00000100:00100000:3.0:1789760746.068440:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15407 00000100:00100000:3.0:1789760746.068451:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684300696822 time 684320829836 state 0x2 ref 0 00000100:00100000:3.0:1789760746.072139:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760746.096649:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565198848 00000100:00100000:3.0:1789760746.096658:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565198848 00000100:00100000:3.0:1789760746.096760:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684333069944 time 684344917368 state 0x0 ref 1 00000100:00100000:3.0:1789760746.096776:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684345177784 time 684344917368 state 0x1 ref 1 00000100:00100000:3.0:1789760746.096804:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684345177784 time 684357095985 state 0x0 ref 1 00000100:00100000:3.0:1789760746.096818:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565198848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.096865:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63074304, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e150 00010000:00010000:3.0:1789760746.096875:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.096889:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.096893:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.096900:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.096925:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.101408:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63074304 -> 63078400 00002000:00010000:3.0:1789760746.101414:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123216 -> 123224 00010000:00010000:3.0:1789760746.101427:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101440:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101449:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101456:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.101461:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101469:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101489:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.101498:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63074304->63078399] (req 63074304->63078399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.101642:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565198848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4822us (5085us total) trans 4294982707 rc 0/0 00000100:00100000:3.0:1789760746.101652:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15410 00000100:00100000:3.0:1789760746.101662:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684345177784 time 684357095985 state 0x2 ref 0 00000100:00100000:3.0:1789760746.130258:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565199232 00000100:00100000:3.0:1789760746.130267:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565199232 00000100:00100000:3.0:1789760746.130325:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684370557912 time 684382715652 state 0x0 ref 1 00000100:00100000:3.0:1789760746.130408:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684382976068 time 684382715652 state 0x1 ref 1 00000100:00100000:3.0:1789760746.130439:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684382976068 time 684390731534 state 0x0 ref 1 00000100:00100000:3.0:1789760746.130453:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565199232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.130506:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63086592, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e168 00010000:00010000:3.0:1789760746.130516:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.130530:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.130535:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.130541:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63086592->63090687] (req 63086592->63090687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.130554:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63086592->63090687] (req 63086592->63090687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.175096:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684426908520 time 684435386118 state 0x0 ref 1 00000100:00100000:3.0:1789760746.175112:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565199616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.175158:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63098880, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e180 00010000:00010000:3.0:1789760746.175167:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.175182:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.175186:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.175191:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.175205:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.179276:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63098880 -> 63102976 00002000:00010000:3.0:1789760746.179281:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123264 -> 123272 00010000:00010000:3.0:1789760746.179294:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179307:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179325:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179332:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.179337:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179346:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179365:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.179373:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a44b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63098880->63102975] (req 63098880->63102975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.179508:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565199616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4395us (4818us total) trans 4294982713 rc 0/0 00000100:00100000:3.0:1789760746.179520:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15416 00000100:00100000:3.0:1789760746.179529:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684426908520 time 684435386118 state 0x2 ref 0 00000100:00100000:3.0:1789760746.184074:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760746.206841:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565200000 00000100:00100000:3.0:1789760746.206850:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565200000 00000100:00100000:3.0:1789760746.206904:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684444867625 time 684456168042 state 0x0 ref 1 00000100:00100000:3.0:1789760746.206930:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684456428458 time 684456168042 state 0x1 ref 1 00000100:00100000:3.0:1789760746.206975:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684456428458 time 684467257427 state 0x0 ref 1 00000100:00100000:3.0:1789760746.206989:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565200000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.207037:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63111168, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e198 00010000:00010000:3.0:1789760746.207047:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a460 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.207063:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.207067:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.207073:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63111168->63115263] (req 63111168->63115263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.207087:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63111168->63115263] (req 63111168->63115263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760746.213368:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982716 is committed 00000100:00100000:3.0:1789760746.219201:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760746.224512:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982717 is committed 00000100:00100000:3.0:1789760746.244212:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565200384 00000100:00100000:3.0:1789760746.244221:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565200384 00000100:00100000:3.0:1789760746.244271:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684480758283 time 684491993365 state 0x0 ref 1 00000100:00100000:3.0:1789760746.244286:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684492253781 time 684491993365 state 0x1 ref 1 00000100:00100000:3.0:1789760746.244514:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684492253781 time 684504803845 state 0x0 ref 1 00000100:00100000:3.0:1789760746.244528:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565200384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.244574:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63123456, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e1b0 00010000:00010000:3.0:1789760746.244583:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.244600:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.244605:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.244611:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.244625:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.252902:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63123456 -> 63127552 00002000:00010000:3.0:1789760746.252908:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123312 -> 123320 00010000:00010000:3.0:1789760746.252930:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.252943:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.252952:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.252960:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.252975:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.252985:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.253005:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.253013:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a475 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63123456->63127551] (req 63123456->63127551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.253117:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565200384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8587us (9112us total) trans 4294982719 rc 0/0 00000100:00100000:3.0:1789760746.253128:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15422 00000100:00100000:3.0:1789760746.253136:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684492253781 time 684504803845 state 0x2 ref 0 00000100:00100000:3.0:1789760746.268223:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760746.275381:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63127552 -> 63131648 00002000:00010000:3.0:1789760746.275386:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123320 -> 123328 00010000:00010000:3.0:1789760746.275398:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275410:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275417:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275424:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.275429:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275437:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275457:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.275467:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674a47c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63127552->63131647] (req 63127552->63131647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.302820:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760746.342506:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760746.394676:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760746.431637:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63168512 -> 63172608 00002000:00010000:3.0:1789760746.431643:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123400 -> 123408 00010000:00010000:3.0:1789760746.431655:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431668:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431677:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431685:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.431690:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431699:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431738:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.431745:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674a4c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63168512->63172607] (req 63168512->63172607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.431897:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565201792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5975us (6485us total) trans 4294982730 rc 0/0 00000100:00100000:3.0:1789760746.432032:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15433 00000100:00100000:3.0:1789760746.432042:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684673085748 time 684686189738 state 0x2 ref 0 00000001:00080000:3.0:1789760746.462088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982732 is committed 00000100:00100000:3.0:1789760746.467828:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565202176 00000100:00100000:3.0:1789760746.467838:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565202176 00000100:00100000:3.0:1789760746.467893:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684699697904 time 684711841198 state 0x0 ref 1 00000100:00100000:3.0:1789760746.467921:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684712101614 time 684711841198 state 0x1 ref 1 00000100:00100000:3.0:1789760746.467944:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684712101614 time 684728235840 state 0x0 ref 1 00000100:00100000:3.0:1789760746.467956:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565202176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.468015:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63180800, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e220 00010000:00010000:3.0:1789760746.468035:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.468051:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.468056:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.468061:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63180800->63184895] (req 63180800->63184895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.468075:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63180800->63184895] (req 63180800->63184895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.485336:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565202304 00000100:00100000:3.0:1789760746.485346:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565202304 00000100:00100000:3.0:1789760746.485403:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684712101614 time 684728235840 state 0x0 ref 1 00000100:00100000:3.0:1789760746.485417:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684728496256 time 684728235840 state 0x1 ref 1 00000100:00100000:3.0:1789760746.485453:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684728496256 time 684745744713 state 0x0 ref 1 00000100:00100000:3.0:1789760746.485467:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565202304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.485514:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63184896, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e228 00010000:00010000:3.0:1789760746.485525:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.485541:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.485546:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.485553:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.485567:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.491444:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63184896 -> 63188992 00002000:00010000:3.0:1789760746.491448:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123432 -> 123440 00010000:00010000:3.0:1789760746.491461:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491473:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491487:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491494:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.491498:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491506:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491526:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.491532:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63184896->63188991] (req 63184896->63188991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.491660:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565202304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6191us (6409us total) trans 4294982734 rc 0/0 00000100:00100000:3.0:1789760746.491669:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15437 00000100:00100000:3.0:1789760746.491679:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684728496256 time 684745744713 state 0x2 ref 0 00000001:00080000:3.0:1789760746.512223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982735 is committed 00000100:00100000:3.0:1789760746.515942:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565202560 00000100:00100000:3.0:1789760746.515951:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565202560 00000100:00100000:3.0:1789760746.516019:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684746005129 time 684765885179 state 0x0 ref 1 00000100:00100000:3.0:1789760746.516037:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684766145595 time 684765885179 state 0x1 ref 1 00000100:00100000:3.0:1789760746.516059:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684766145595 time 684776350883 state 0x0 ref 1 00000100:00100000:3.0:1789760746.516070:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565202560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.516118:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63193088, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e238 00010000:00010000:3.0:1789760746.516128:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.516144:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.516148:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.516155:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.516169:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.524439:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63193088 -> 63197184 00002000:00010000:3.0:1789760746.524446:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123448 -> 123456 00010000:00010000:3.0:1789760746.524459:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524472:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524481:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524489:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.524494:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524503:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524524:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.524532:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a4ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63193088->63197183] (req 63193088->63197183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.524671:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565202560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8598us (8844us total) trans 4294982736 rc 0/0 00000100:00100000:3.0:1789760746.524682:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15439 00000100:00100000:3.0:1789760746.524692:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684766145595 time 684776350883 state 0x2 ref 0 00000100:00100000:3.0:1789760746.539249:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565202688 00000100:00100000:3.0:1789760746.539265:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565202688 00000100:00100000:3.0:1789760746.539402:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684766145595 time 684776350883 state 0x0 ref 1 00000100:00100000:3.0:1789760746.539419:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684776611299 time 684776350883 state 0x1 ref 1 00000100:00100000:3.0:1789760746.539561:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684776611299 time 684799851547 state 0x0 ref 1 00000100:00100000:3.0:1789760746.539579:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565202688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.539636:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63197184, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e240 00010000:00010000:3.0:1789760746.539645:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.539661:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.539665:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.539672:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.539687:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.546683:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63197184 -> 63201280 00002000:00010000:3.0:1789760746.546690:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123456 -> 123464 00010000:00010000:3.0:1789760746.546786:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546800:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546810:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546817:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.546823:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546832:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546851:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.546860:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a4f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63197184->63201279] (req 63197184->63201279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.566756:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565202944 00000100:00100000:3.0:1789760746.566768:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565202944 00000100:00100000:3.0:1789760746.566830:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684800111963 time 684812336850 state 0x0 ref 1 00000100:00100000:3.0:1789760746.566848:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684812597266 time 684812336850 state 0x1 ref 1 00000100:00100000:3.0:1789760746.566883:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684812597266 time 684827174252 state 0x0 ref 1 00000100:00100000:3.0:1789760746.566897:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565202944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.567023:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63205376, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e250 00010000:00010000:3.0:1789760746.567033:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a501 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.567050:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.567055:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.567062:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a501 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63205376->63209471] (req 63205376->63209471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.567077:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674a501 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63205376->63209471] (req 63205376->63209471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.680472:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684928613674 time 684940761759 state 0x0 ref 1 00000100:00100000:3.0:1789760746.680488:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565203840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.680595:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63234048, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e288 00010000:00010000:3.0:1789760746.680603:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.680615:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.680618:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.680622:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.680633:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760746.689790:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63234048 -> 63238144 00002000:00010000:3.0:1789760746.689796:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123528 -> 123536 00010000:00010000:3.0:1789760746.689809:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689822:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689832:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689840:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760746.689844:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689853:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689872:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.689880:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63234048->63238143] (req 63234048->63238143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.691499:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565203840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11005us (11280us total) trans 4294982746 rc 0/0 00000100:00100000:3.0:1789760746.691510:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15449 00000100:00100000:3.0:1789760746.691519:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684928613674 time 684940761759 state 0x2 ref 0 00000100:00100000:3.0:1789760746.728850:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565204224 00000100:00100000:3.0:1789760746.728863:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565204224 00000100:00100000:3.0:1789760746.729060:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684961256138 time 684972456665 state 0x0 ref 1 00000100:00100000:3.0:1789760746.729075:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684972717081 time 684972456665 state 0x1 ref 1 00000100:00100000:3.0:1789760746.729110:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 684972717081 time 684989401913 state 0x0 ref 1 00000100:00100000:3.0:1789760746.729123:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565204224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760746.729242:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63246336, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0x1e2a0 00010000:00010000:3.0:1789760746.729251:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a547 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.729267:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1789760746.729271:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.729277:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63246336->63250431] (req 63246336->63250431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.729291:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674a547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63246336->63250431] (req 63246336->63250431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760746.737337:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982749 is committed 00000001:00080000:3.0:1789760746.752558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982750 is committed 00000001:00080000:3.0:1789760746.771542:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982751 is committed 00000001:00080000:3.0:1789760746.824109:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982753 is committed 00000001:00080000:3.0:1789760746.912381:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982758 is committed 00000001:00080000:3.0:1789760746.927204:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982759 is committed 00002000:00010000:3.0:1789760747.018205:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63311872 -> 63315968 00002000:00010000:3.0:1789760747.018211:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123680 -> 123688 00010000:00010000:3.0:1789760747.018224:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018244:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018254:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018261:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.018266:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018275:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018294:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.018303:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674a5b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63311872->63315967] (req 63311872->63315967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.018463:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565206272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7169us (8773us total) trans 4294982765 rc 0/0 00000100:00100000:3.0:1789760747.018474:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15468 00000100:00100000:3.0:1789760747.018484:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685259126585 time 685271567869 state 0x2 ref 0 00000001:00080000:3.0:1789760747.030506:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982766 is committed 00000100:00100000:3.0:1789760747.038439:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565206528 00000100:00100000:3.0:1789760747.038450:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565206528 00000100:00100000:3.0:1789760747.038523:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685271828285 time 685285646898 state 0x0 ref 1 00000100:00100000:3.0:1789760747.038539:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685285907314 time 685285646898 state 0x1 ref 1 00000100:00100000:3.0:1789760747.038572:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685285907314 time 685298864295 state 0x0 ref 1 00000100:00100000:3.0:1789760747.038586:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565206528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.038634:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63320064, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e330 00010000:00010000:3.0:1789760747.038644:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.038660:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.038664:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.038671:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.038684:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760747.045651:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63320064 -> 63324160 00002000:00010000:3.0:1789760747.045657:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123696 -> 123704 00010000:00010000:3.0:1789760747.045670:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045682:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045692:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045698:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.045803:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045813:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045832:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.045839:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63320064->63324159] (req 63320064->63324159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.046087:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565206528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7499us (7838us total) trans 4294982767 rc 0/0 00000100:00100000:3.0:1789760747.046097:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15470 00000100:00100000:3.0:1789760747.046108:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685285907314 time 685298864295 state 0x2 ref 0 00000100:00100000:3.0:1789760747.052394:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565206656 00000100:00100000:3.0:1789760747.052403:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565206656 00000100:00100000:3.0:1789760747.052455:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685285907314 time 685298864295 state 0x0 ref 1 00000100:00100000:3.0:1789760747.052470:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685299124711 time 685298864295 state 0x1 ref 1 00000100:00100000:3.0:1789760747.052585:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685299124711 time 685312876314 state 0x0 ref 1 00000100:00100000:3.0:1789760747.052599:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565206656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.052646:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63324160, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e338 00010000:00010000:3.0:1789760747.052657:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.052673:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.052677:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.052684:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63324160->63328255] (req 63324160->63328255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.052698:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674a5cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63324160->63328255] (req 63324160->63328255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760747.057437:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982768 is committed 00000001:00080000:3.0:1789760747.071226:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982769 is committed 00000100:00100000:3.0:1789760747.081831:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565206912 00000100:00100000:3.0:1789760747.081841:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565206912 00000100:00100000:3.0:1789760747.081905:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685313136730 time 685326748315 state 0x0 ref 1 00000100:00100000:3.0:1789760747.081920:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685327008731 time 685326748315 state 0x1 ref 1 00000100:00100000:3.0:1789760747.081941:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685327008731 time 685342233961 state 0x0 ref 1 00000100:00100000:3.0:1789760747.081953:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565206912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.082010:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63332352, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e348 00010000:00010000:3.0:1789760747.082019:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a5da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.082035:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.082039:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.082046:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63332352->63336447] (req 63332352->63336447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.082060:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674a5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63332352->63336447] (req 63332352->63336447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760747.101573:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982771 is committed 00000001:00080000:3.0:1789760747.141495:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982774 is committed 00000001:00080000:3.0:1789760747.154443:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982775 is committed 00000001:00080000:3.0:1789760747.213867:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982779 is committed 00002000:00010000:3.0:1789760747.289684:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63385600 -> 63389696 00002000:00010000:3.0:1789760747.289690:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123824 -> 123832 00010000:00010000:3.0:1789760747.289719:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289732:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289741:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289752:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.289756:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289764:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289784:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.289792:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674a635 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63385600->63389695] (req 63385600->63389695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.289928:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565208576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13747us (14171us total) trans 4294982783 rc 0/0 00000100:00100000:3.0:1789760747.289939:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15486 00000100:00100000:3.0:1789760747.289947:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685519421621 time 685536457964 state 0x2 ref 0 00000100:00100000:3.0:1789760747.335649:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565208960 00000100:00100000:3.0:1789760747.335661:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565208960 00000100:00100000:3.0:1789760747.335745:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685561411878 time 685583877199 state 0x0 ref 1 00000100:00100000:3.0:1789760747.335760:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685584137615 time 685583877199 state 0x1 ref 1 00000100:00100000:3.0:1789760747.335788:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685584137615 time 685596080259 state 0x0 ref 1 00000100:00100000:3.0:1789760747.335802:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565208960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.335845:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63397888, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e3c8 00010000:00010000:3.0:1789760747.335854:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.335868:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.335872:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.335879:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.335892:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760747.342060:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63397888 -> 63401984 00002000:00010000:3.0:1789760747.342065:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123848 -> 123856 00010000:00010000:3.0:1789760747.342078:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342091:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342100:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342107:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.342113:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342122:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342140:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.342148:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a64a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63397888->63401983] (req 63397888->63401983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.342244:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565208960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6438us (6670us total) trans 4294982786 rc 0/0 00000100:00100000:3.0:1789760747.342255:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15489 00000100:00100000:3.0:1789760747.342265:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685584137615 time 685596080259 state 0x2 ref 0 00000100:00100000:3.0:1789760747.379693:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565209344 00000100:00100000:3.0:1789760747.379720:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565209344 00000100:00100000:3.0:1789760747.379784:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685607605388 time 685625057721 state 0x0 ref 1 00000100:00100000:3.0:1789760747.379800:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685625318137 time 685625057721 state 0x1 ref 1 00000100:00100000:3.0:1789760747.379824:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685625318137 time 685640117038 state 0x0 ref 1 00000100:00100000:3.0:1789760747.379836:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565209344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.379881:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63410176, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e3e0 00010000:00010000:3.0:1789760747.379891:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.379980:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.379985:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.380117:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.380133:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760747.389124:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63410176 -> 63414272 00002000:00010000:3.0:1789760747.389135:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123872 -> 123880 00010000:00010000:3.0:1789760747.389149:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389163:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389171:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389179:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.389184:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389193:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389213:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.389220:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a65f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63410176->63414271] (req 63410176->63414271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.389488:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565209344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9648us (10603us total) trans 4294982789 rc 0/0 00000100:00100000:3.0:1789760747.389498:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15492 00000100:00100000:3.0:1789760747.389507:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685625318137 time 685640117038 state 0x2 ref 0 00000100:00100000:3.0:1789760747.437116:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565209728 00000100:00100000:3.0:1789760747.437130:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565209728 00000100:00100000:3.0:1789760747.437197:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685658896056 time 685675269340 state 0x0 ref 1 00000100:00100000:3.0:1789760747.437214:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685675529756 time 685675269340 state 0x1 ref 1 00000100:00100000:3.0:1789760747.437252:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685675529756 time 685697544248 state 0x0 ref 1 00000100:00100000:3.0:1789760747.437266:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565209728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.437315:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63422464, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e3f8 00010000:00010000:3.0:1789760747.437326:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.437343:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.437347:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.437353:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.437367:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760747.451030:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63422464 -> 63426560 00002000:00010000:3.0:1789760747.451035:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123896 -> 123904 00010000:00010000:3.0:1789760747.451050:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451062:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451071:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451077:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.451082:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451090:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451109:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.451123:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a674 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63422464->63426559] (req 63422464->63426559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.451252:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565209728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13984us (16549us total) trans 4294982792 rc 0/0 00000100:00100000:3.0:1789760747.451263:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15495 00000100:00100000:3.0:1789760747.451272:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685675529756 time 685697544248 state 0x2 ref 0 00000100:00100000:3.0:1789760747.488978:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565210112 00000100:00100000:3.0:1789760747.488988:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565210112 00000100:00100000:3.0:1789760747.489045:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685718404208 time 685732498094 state 0x0 ref 1 00000100:00100000:3.0:1789760747.489061:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685732758510 time 685732498094 state 0x1 ref 1 00000100:00100000:3.0:1789760747.489093:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685732758510 time 685749385066 state 0x0 ref 1 00000100:00100000:3.0:1789760747.489106:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565210112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.489153:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63434752, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e410 00010000:00010000:3.0:1789760747.489162:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.489177:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789760747.489182:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.489187:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.489207:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760747.497028:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63434752 -> 63438848 00002000:00010000:3.0:1789760747.497037:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 123920 -> 123928 00010000:00010000:3.0:1789760747.497051:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497063:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497071:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497078:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760747.497083:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497091:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497110:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.497118:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a689 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63434752->63438847] (req 63434752->63438847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.497261:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565210112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8153us (8629us total) trans 4294982795 rc 0/0 00000100:00100000:3.0:1789760747.497272:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15498 00000100:00100000:3.0:1789760747.497281:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 685732758510 time 685749385066 state 0x2 ref 0 00000001:00080000:3.0:1789760747.560343:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982799 is committed 00000100:00100000:3.0:1789760747.829116:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565212800 00000100:00100000:3.0:1789760747.829126:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565212800 00000100:00100000:3.0:1789760747.829180:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686065844303 time 686078248915 state 0x0 ref 1 00000100:00100000:3.0:1789760747.829194:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686078509331 time 686078248915 state 0x1 ref 1 00000100:00100000:3.0:1789760747.829224:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686078509331 time 686089515625 state 0x0 ref 1 00000100:00100000:3.0:1789760747.829237:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565212800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760747.829283:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63520768, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0x1e4b8 00010000:00010000:3.0:1789760747.829293:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a71c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.829308:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760747.829312:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.829318:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63520768->63524863] (req 63520768->63524863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.829331:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63520768->63524863] (req 63520768->63524863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760747.904870:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982821 is committed 00000001:00080000:3.0:1789760747.917007:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982822 is committed 00000001:00080000:3.0:1789760747.937762:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982823 is committed 00000001:00080000:3.0:1789760747.949515:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982824 is committed 00000001:00080000:3.0:1789760747.961044:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982825 is committed 00002000:00010000:3.0:1789760748.179824:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63619072 -> 63623168 00002000:00010000:3.0:1789760748.179830:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124280 -> 124288 00010000:00010000:3.0:1789760748.179844:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179857:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179867:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179873:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.179878:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179886:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179906:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.179918:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674a7c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63619072->63623167] (req 63619072->63623167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.180084:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565215872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8141us (8460us total) trans 4294982840 rc 0/0 00000100:00100000:3.0:1789760748.180095:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15543 00000100:00100000:3.0:1789760748.180105:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686420960661 time 686432211759 state 0x2 ref 0 00002000:00010000:3.0:1789760748.364543:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63668224 -> 63672320 00002000:00010000:3.0:1789760748.364548:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124376 -> 124384 00010000:00010000:3.0:1789760748.364561:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364573:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364583:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364592:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.364600:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364610:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364634:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.364643:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674a818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63668224->63672319] (req 63668224->63672319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.364811:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565217408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9375us (10113us total) trans 4294982852 rc 0/0 00000100:00100000:3.0:1789760748.364820:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15555 00000100:00100000:3.0:1789760748.364831:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686604213642 time 686615709752 state 0x2 ref 0 00000100:00100000:3.0:1789760748.377734:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565217536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9610us (9862us total) trans 4294982853 rc 0/0 00000100:00100000:3.0:1789760748.377750:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15556 00000100:00100000:3.0:1789760748.377760:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686615970168 time 686628370639 state 0x2 ref 0 00000100:00100000:3.0:1789760748.396444:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565217792 00000100:00100000:3.0:1789760748.396496:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565217792 00000100:00100000:3.0:1789760748.396565:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686628631055 time 686642402788 state 0x0 ref 1 00000100:00100000:3.0:1789760748.396581:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686642663204 time 686642402788 state 0x1 ref 1 00000100:00100000:3.0:1789760748.396622:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686642663204 time 686656913301 state 0x0 ref 1 00000100:00100000:3.0:1789760748.396635:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565217792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.396696:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63680512, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e5f0 00010000:00010000:3.0:1789760748.396740:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.396758:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.396762:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.396768:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.396783:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760748.405207:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63680512 -> 63684608 00002000:00010000:3.0:1789760748.405212:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124400 -> 124408 00010000:00010000:3.0:1789760748.405363:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405377:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405385:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405392:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.405397:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405410:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405428:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.405437:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a82d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63680512->63684607] (req 63680512->63684607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.407614:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565217792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10969us (11265us total) trans 4294982855 rc 0/0 00000100:00100000:3.0:1789760748.407629:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15558 00000100:00100000:3.0:1789760748.407639:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686642663204 time 686656913301 state 0x2 ref 0 00000100:00100000:3.0:1789760748.416195:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565217920 00000100:00100000:3.0:1789760748.416209:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565217920 00000100:00100000:3.0:1789760748.416273:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686642663204 time 686656913301 state 0x0 ref 1 00000100:00100000:3.0:1789760748.416289:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686657173717 time 686656913301 state 0x1 ref 1 00000100:00100000:3.0:1789760748.416462:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686657173717 time 686676751487 state 0x0 ref 1 00000100:00100000:3.0:1789760748.416476:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565217920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.416523:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63684608, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e5f8 00010000:00010000:3.0:1789760748.416531:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.416547:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.416551:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.416557:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.416571:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760748.425617:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63684608 -> 63688704 00002000:00010000:3.0:1789760748.425622:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124408 -> 124416 00010000:00010000:3.0:1789760748.425636:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425649:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425659:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425667:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.425672:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425681:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425725:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.425733:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63684608->63688703] (req 63684608->63688703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.425824:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565217920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9346us (12901us total) trans 4294982856 rc 0/0 00000100:00100000:3.0:1789760748.425834:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15559 00000100:00100000:3.0:1789760748.425843:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686657173717 time 686676751487 state 0x2 ref 0 00000100:00100000:3.0:1789760748.439513:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565218176 00000100:00100000:3.0:1789760748.439522:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565218176 00000100:00100000:3.0:1789760748.439576:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686677011903 time 686692555094 state 0x0 ref 1 00000100:00100000:3.0:1789760748.439592:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686692815510 time 686692555094 state 0x1 ref 1 00000100:00100000:3.0:1789760748.439623:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686692815510 time 686699915296 state 0x0 ref 1 00000100:00100000:3.0:1789760748.439635:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565218176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.439682:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63692800, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e608 00010000:00010000:3.0:1789760748.439692:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.439745:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.439750:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.439756:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63692800->63696895] (req 63692800->63696895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.439769:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674a842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63692800->63696895] (req 63692800->63696895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.458598:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565218304 00000100:00100000:3.0:1789760748.458607:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565218304 00000100:00100000:3.0:1789760748.458659:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686692815510 time 686699915296 state 0x0 ref 1 00000100:00100000:3.0:1789760748.458675:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686700175712 time 686699915296 state 0x1 ref 1 00000100:00100000:3.0:1789760748.458770:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686700175712 time 686719061752 state 0x0 ref 1 00000100:00100000:3.0:1789760748.458783:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565218304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.458831:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63696896, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e610 00010000:00010000:3.0:1789760748.458840:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.458854:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.458859:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.458865:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63696896->63700991] (req 63696896->63700991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.458877:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674a849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63696896->63700991] (req 63696896->63700991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.574664:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565219072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9726us (10151us total) trans 4294982865 rc 0/0 00000100:00100000:3.0:1789760748.574681:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15568 00000100:00100000:3.0:1789760748.574694:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686804676264 time 686825209010 state 0x2 ref 0 00000100:00100000:3.0:1789760748.617050:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565219456 00000100:00100000:3.0:1789760748.617063:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565219456 00000100:00100000:3.0:1789760748.617140:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686841031854 time 686858699397 state 0x0 ref 1 00000100:00100000:3.0:1789760748.617158:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686858959813 time 686858699397 state 0x1 ref 1 00000100:00100000:3.0:1789760748.617197:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686858959813 time 686877488403 state 0x0 ref 1 00000100:00100000:3.0:1789760748.617211:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565219456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.617275:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63733760, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e658 00010000:00010000:3.0:1789760748.617287:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.617324:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.617330:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.617338:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.617356:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760748.626185:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63733760 -> 63737856 00002000:00010000:3.0:1789760748.626190:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124504 -> 124512 00010000:00010000:3.0:1789760748.626206:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626218:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626227:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626235:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.626240:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626249:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626270:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.626279:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63733760->63737855] (req 63733760->63737855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.626378:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565219456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9165us (9513us total) trans 4294982868 rc 0/0 00000100:00100000:3.0:1789760748.626390:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15571 00000100:00100000:3.0:1789760748.626401:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686858959813 time 686877488403 state 0x2 ref 0 00000100:00100000:3.0:1789760748.666967:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565219840 00000100:00100000:3.0:1789760748.666977:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565219840 00000100:00100000:3.0:1789760748.667032:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686897156385 time 686907455703 state 0x0 ref 1 00000100:00100000:3.0:1789760748.667048:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686907716119 time 686907455703 state 0x1 ref 1 00000100:00100000:3.0:1789760748.667080:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686907716119 time 686927371346 state 0x0 ref 1 00000100:00100000:3.0:1789760748.667092:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565219840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.667138:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63746048, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e670 00010000:00010000:3.0:1789760748.667148:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.667165:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.667169:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.667176:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.667189:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760748.673408:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63746048 -> 63750144 00002000:00010000:3.0:1789760748.673414:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124528 -> 124536 00010000:00010000:3.0:1789760748.673428:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673440:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673450:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673457:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.673462:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673470:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673490:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.673498:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a89d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63746048->63750143] (req 63746048->63750143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.673671:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565219840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6576us (6816us total) trans 4294982871 rc 0/0 00000100:00100000:3.0:1789760748.673681:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15574 00000100:00100000:3.0:1789760748.673692:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686907716119 time 686927371346 state 0x2 ref 0 00000100:00100000:3.0:1789760748.699916:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565220224 00000100:00100000:3.0:1789760748.699925:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565220224 00000100:00100000:3.0:1789760748.699991:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686938781182 time 686949842656 state 0x0 ref 1 00000100:00100000:3.0:1789760748.700007:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686950103072 time 686949842656 state 0x1 ref 1 00000100:00100000:3.0:1789760748.700039:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686950103072 time 686960331288 state 0x0 ref 1 00000100:00100000:3.0:1789760748.700052:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565220224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.700098:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63758336, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e688 00010000:00010000:3.0:1789760748.700107:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.700134:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1789760748.700139:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.700145:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.700158:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760748.705149:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63758336 -> 63762432 00002000:00010000:3.0:1789760748.705154:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124552 -> 124560 00010000:00010000:3.0:1789760748.705169:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705188:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705197:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705204:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760748.705209:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705219:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705240:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.705248:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63758336->63762431] (req 63758336->63762431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.705634:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565220224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5577us (5829us total) trans 4294982874 rc 0/0 00000100:00100000:3.0:1789760748.705645:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15577 00000100:00100000:3.0:1789760748.705654:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686950103072 time 686960331288 state 0x2 ref 0 00000001:00080000:3.0:1789760748.733519:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982876 is committed 00000100:00100000:3.0:1789760748.744756:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565220608 00000100:00100000:3.0:1789760748.744765:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565220608 00000100:00100000:3.0:1789760748.744821:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686974732402 time 686988691762 state 0x0 ref 1 00000100:00100000:3.0:1789760748.744836:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686988952178 time 686988691762 state 0x1 ref 1 00000100:00100000:3.0:1789760748.744867:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 686988952178 time 687005159151 state 0x0 ref 1 00000100:00100000:3.0:1789760748.744880:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565220608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760748.745032:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63770624, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0x1e6a0 00010000:00010000:3.0:1789760748.745043:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.745057:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1789760748.745062:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.745068:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63770624->63774719] (req 63770624->63774719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.745084:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674a8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63770624->63774719] (req 63770624->63774719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760748.835021:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982882 is committed 00000001:00080000:3.0:1789760748.847982:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982883 is committed 00000001:00080000:3.0:1789760748.955872:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982891 is committed 00000001:00080000:3.0:1789760749.037150:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982897 is committed 00000001:00080000:3.0:1789760749.055279:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982898 is committed 00000001:00080000:3.0:1789760749.188473:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982904 is committed 00000001:00080000:3.0:1789760749.220649:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982906 is committed 00000001:00080000:3.0:1789760749.235529:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982907 is committed 00000100:00100000:3.0:1789760749.245749:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760749.257576:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982908 is committed 00000100:00100000:3.0:1789760749.289359:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.324033:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760749.324059:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4227bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580060416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760749.324132:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789760749.325467:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760749.325472:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760749.325730:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7ec78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:769fd61a-9f51-46fc-af80-467e2ca172bc:3457:1876699580060544:0@lo:400:kworker.0 00000100:00080000:3.0:1789760749.326519:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760749.326543:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6fe2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3457:1876699580061056:0@lo:400:kworker.0 00000100:00080000:3.0:1789760749.327258:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760749.341438:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.352841:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.380341:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.391400:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760749.409173:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982919 is committed 00000100:00100000:3.0:1789760749.413223:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760749.417574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982920 is committed 00000100:00100000:3.0:1789760749.421193:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760749.425996:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982921 is committed 00000100:00100000:3.0:1789760749.445586:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.458543:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.485795:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.496669:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.514502:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565227136 00000100:00100000:3.0:1789760749.514515:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565227136 00000100:00100000:3.0:1789760749.514575:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687747021834 time 687759496992 state 0x0 ref 1 00000100:00100000:3.0:1789760749.514591:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687759757408 time 687759496992 state 0x1 ref 1 00000100:00100000:3.0:1789760749.514627:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687759757408 time 687774918819 state 0x0 ref 1 00000100:00100000:3.0:1789760749.514639:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565227136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760749.514913:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63979520, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0x1e838 00010000:00010000:3.0:1789760749.514923:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.514937:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1789760749.514953:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760749.514960:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.514974:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760749.520913:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63979520 -> 63983616 00002000:00010000:3.0:1789760749.520918:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124984 -> 124992 00010000:00010000:3.0:1789760749.520931:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.520953:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.520969:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.520977:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760749.520982:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.520991:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.521069:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.521077:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63979520->63983615] (req 63979520->63983615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.521204:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565227136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6563us (8304us total) trans 4294982928 rc 0/0 00000100:00100000:3.0:1789760749.521216:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15631 00000100:00100000:3.0:1789760749.521225:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687759757408 time 687774918819 state 0x2 ref 0 00000100:00100000:3.0:1789760749.524211:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.551556:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565227520 00000100:00100000:3.0:1789760749.551565:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565227520 00000100:00100000:3.0:1789760749.551624:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687785096079 time 687800897973 state 0x0 ref 1 00000100:00100000:3.0:1789760749.551643:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687801158389 time 687800897973 state 0x1 ref 1 00000100:00100000:3.0:1789760749.551671:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687801158389 time 687811963152 state 0x0 ref 1 00000100:00100000:3.0:1789760749.551683:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565227520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760749.551757:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63991808, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0x1e850 00010000:00010000:3.0:1789760749.551766:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.551782:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1789760749.551786:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760749.551792:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63991808->63995903] (req 63991808->63995903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.551805:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674aa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63991808->63995903] (req 63991808->63995903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.563843:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.602326:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760749.623348:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565228288 00000100:00100000:3.0:1789760749.623358:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565228288 00000100:00100000:3.0:1789760749.623420:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687863099949 time 687874450518 state 0x0 ref 1 00000100:00100000:3.0:1789760749.623449:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687874710934 time 687874450518 state 0x1 ref 1 00000100:00100000:3.0:1789760749.623479:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687874710934 time 687883770971 state 0x0 ref 1 00000100:00100000:3.0:1789760749.623492:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565228288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760749.623536:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64016384, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0x1e880 00010000:00010000:3.0:1789760749.623546:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.623562:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1789760749.623566:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760749.623573:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.623588:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760749.627417:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64016384 -> 64020480 00002000:00010000:3.0:1789760749.627491:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125056 -> 125064 00010000:00010000:3.0:1789760749.627507:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627520:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627529:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627537:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760749.627544:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627551:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627569:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.627576:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64016384->64020479] (req 64016384->64020479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.627785:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565228288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4290us (4518us total) trans 4294982937 rc 0/0 00000100:00100000:3.0:1789760749.627796:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15640 00000100:00100000:3.0:1789760749.627806:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687874710934 time 687883770971 state 0x2 ref 0 00000100:00100000:3.0:1789760749.655920:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565228672 00000100:00100000:3.0:1789760749.655929:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565228672 00000100:00100000:3.0:1789760749.655995:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687893429992 time 687904127187 state 0x0 ref 1 00000100:00100000:3.0:1789760749.656012:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687904387603 time 687904127187 state 0x1 ref 1 00000100:00100000:3.0:1789760749.656049:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 687904387603 time 687916340388 state 0x0 ref 1 00000100:00100000:3.0:1789760749.656063:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565228672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760749.656113:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64028672, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0x1e898 00010000:00010000:3.0:1789760749.656123:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.656139:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1789760749.656144:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760749.656150:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64028672->64032767] (req 64028672->64032767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.656164:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674aa80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64028672->64032767] (req 64028672->64032767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760749.766157:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982947 is committed 00000001:00080000:3.0:1789760749.778352:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982948 is committed 00000100:00080000:3.0:1789760750.013126:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760750.093858:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982967 is committed 00000100:00100000:3.0:1789760750.117079:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760750.143375:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294982970 is committed 00000100:00100000:3.0:1789760750.161492:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760750.210787:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565233152 00000100:00100000:3.0:1789760750.210798:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565233152 00000100:00100000:3.0:1789760750.210860:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688441442965 time 688454124325 state 0x0 ref 1 00000100:00100000:3.0:1789760750.210875:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688454384741 time 688454124325 state 0x1 ref 1 00000100:00100000:3.0:1789760750.210955:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688454384741 time 688471245709 state 0x0 ref 1 00000100:00100000:3.0:1789760750.210969:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565233152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.211017:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64172032, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1e9b0 00010000:00010000:3.0:1789760750.211027:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.211051:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1789760750.211056:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.211063:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.211077:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.216386:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64172032 -> 64176128 00002000:00010000:3.0:1789760750.216391:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125360 -> 125368 00010000:00010000:3.0:1789760750.216405:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216419:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216429:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216437:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.216442:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216450:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216480:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.216488:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64172032->64176127] (req 64172032->64176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.216588:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565233152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5618us (6558us total) trans 4294982975 rc 0/0 00000100:00100000:3.0:1789760750.216755:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15678 00000100:00100000:3.0:1789760750.216766:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688454384741 time 688471245709 state 0x2 ref 0 00000100:00100000:3.0:1789760750.246078:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565233536 00000100:00100000:3.0:1789760750.246088:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565233536 00000100:00100000:3.0:1789760750.246143:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688483833645 time 688494603662 state 0x0 ref 1 00000100:00100000:3.0:1789760750.246168:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688494864078 time 688494603662 state 0x1 ref 1 00000100:00100000:3.0:1789760750.246246:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688494864078 time 688506536121 state 0x0 ref 1 00000100:00100000:3.0:1789760750.246260:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565233536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.246316:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64184320, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1e9c8 00010000:00010000:3.0:1789760750.246325:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.246350:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1789760750.246355:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.246362:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.246375:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.252113:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64184320 -> 64188416 00002000:00010000:3.0:1789760750.252118:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125384 -> 125392 00010000:00010000:3.0:1789760750.252132:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252145:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252155:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252162:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.252166:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252175:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252195:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.252208:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64184320->64188415] (req 64184320->64188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.252452:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565233536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6189us (6479us total) trans 4294982978 rc 0/0 00000100:00100000:3.0:1789760750.252463:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15681 00000100:00100000:3.0:1789760750.252473:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688494864078 time 688506536121 state 0x2 ref 0 00000100:00100000:3.0:1789760750.277311:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565233920 00000100:00100000:3.0:1789760750.277321:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565233920 00000100:00100000:3.0:1789760750.277377:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688519105084 time 688528754201 state 0x0 ref 1 00000100:00100000:3.0:1789760750.277391:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688529014617 time 688528754201 state 0x1 ref 1 00000100:00100000:3.0:1789760750.277419:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688529014617 time 688537711040 state 0x0 ref 1 00000100:00100000:3.0:1789760750.277431:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565233920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.277477:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64196608, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1e9e0 00010000:00010000:3.0:1789760750.277486:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.277502:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1789760750.277506:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.277513:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.277531:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.281299:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64196608 -> 64200704 00002000:00010000:3.0:1789760750.281303:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125408 -> 125416 00010000:00010000:3.0:1789760750.281316:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281388:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281398:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281405:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.281410:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281420:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281438:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.281446:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ab9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64196608->64200703] (req 64196608->64200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.281532:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565233920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4098us (4298us total) trans 4294982981 rc 0/0 00000100:00100000:3.0:1789760750.281541:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15684 00000100:00100000:3.0:1789760750.281550:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688529014617 time 688537711040 state 0x2 ref 0 00000100:00100000:3.0:1789760750.319093:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565234304 00000100:00100000:3.0:1789760750.319104:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565234304 00000100:00100000:3.0:1789760750.319163:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688548892680 time 688566804663 state 0x0 ref 1 00000100:00100000:3.0:1789760750.319179:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688567065079 time 688566804663 state 0x1 ref 1 00000100:00100000:3.0:1789760750.319213:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688567065079 time 688579504834 state 0x0 ref 1 00000100:00100000:3.0:1789760750.319225:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565234304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.319275:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64208896, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1e9f8 00010000:00010000:3.0:1789760750.319297:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.319314:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1789760750.319319:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.319335:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.319351:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.327841:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64208896 -> 64212992 00002000:00010000:3.0:1789760750.327853:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125432 -> 125440 00010000:00010000:3.0:1789760750.327867:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327885:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327895:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327903:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.327908:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327917:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327934:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.327952:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64208896->64212991] (req 64208896->64212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.328046:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565234304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8819us (9109us total) trans 4294982984 rc 0/0 00000100:00100000:3.0:1789760750.328056:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15687 00000100:00100000:3.0:1789760750.328066:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688567065079 time 688579504834 state 0x2 ref 0 00000100:00100000:3.0:1789760750.366188:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565234688 00000100:00100000:3.0:1789760750.366200:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565234688 00000100:00100000:3.0:1789760750.366926:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688594365087 time 688614769248 state 0x0 ref 1 00000100:00100000:3.0:1789760750.366956:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688615029664 time 688614769248 state 0x1 ref 1 00000100:00100000:3.0:1789760750.366985:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688615029664 time 688627277219 state 0x0 ref 1 00000100:00100000:3.0:1789760750.367003:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565234688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.367383:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64221184, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1ea10 00010000:00010000:3.0:1789760750.367394:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.367410:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1789760750.367512:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.367518:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64221184->64225279] (req 64221184->64225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.367535:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674abc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64221184->64225279] (req 64221184->64225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.671642:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760750.717660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760750.726218:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64319488 -> 64323584 00002000:00010000:3.0:1789760750.726223:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125648 -> 125656 00010000:00010000:3.0:1789760750.726236:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726249:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726258:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726266:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.726270:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726289:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726308:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.726315:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ac71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64319488->64323583] (req 64319488->64323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.726402:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565237760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8195us (8749us total) trans 4294983011 rc 0/0 00000100:00100000:3.0:1789760750.726856:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15714 00000100:00100000:3.0:1789760750.726869:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 688964364358 time 688978486873 state 0x2 ref 0 00000100:00100000:3.0:1789760750.762299:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760750.791241:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760750.832948:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760750.870229:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565239296 00000100:00100000:3.0:1789760750.870240:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565239296 00000100:00100000:3.0:1789760750.870306:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689105068692 time 689118607353 state 0x0 ref 1 00000100:00100000:3.0:1789760750.870322:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689118867769 time 689118607353 state 0x1 ref 1 00000100:00100000:3.0:1789760750.870353:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689118867769 time 689130645296 state 0x0 ref 1 00000100:00100000:3.0:1789760750.870367:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565239296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.870414:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64368640, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1eb30 00010000:00010000:3.0:1789760750.870425:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.870442:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760750.870561:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.870570:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.870585:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.876245:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64368640 -> 64372736 00002000:00010000:3.0:1789760750.876251:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125744 -> 125752 00010000:00010000:3.0:1789760750.876265:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876381:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876393:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876405:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.876410:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876420:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876442:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.876449:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674acc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64368640->64372735] (req 64368640->64372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.876883:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565239296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6512us (7052us total) trans 4294983023 rc 0/0 00000100:00100000:3.0:1789760750.876894:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15726 00000100:00100000:3.0:1789760750.876904:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689118867769 time 689130645296 state 0x2 ref 0 00000100:00100000:3.0:1789760750.882432:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565239424 00000100:00100000:3.0:1789760750.882442:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565239424 00000100:00100000:3.0:1789760750.882509:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689118867769 time 689130645296 state 0x0 ref 1 00000100:00100000:3.0:1789760750.882525:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689130905712 time 689130645296 state 0x1 ref 1 00000100:00100000:3.0:1789760750.882559:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689130905712 time 689142850938 state 0x0 ref 1 00000100:00100000:3.0:1789760750.882571:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565239424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.882621:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64372736, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1eb38 00010000:00010000:3.0:1789760750.882631:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.882647:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760750.882651:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.882658:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.882672:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760750.888131:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64372736 -> 64376832 00002000:00010000:3.0:1789760750.888138:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125752 -> 125760 00010000:00010000:3.0:1789760750.888152:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888171:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888179:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888186:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760750.888191:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888200:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888221:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.888229:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674accc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64372736->64376831] (req 64372736->64376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760750.888479:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565239424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5904us (6559us total) trans 4294983024 rc 0/0 00000100:00100000:3.0:1789760750.888490:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15727 00000100:00100000:3.0:1789760750.888499:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689130905712 time 689142850938 state 0x2 ref 0 00000001:00080000:3.0:1789760750.915626:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983026 is committed 00000100:00100000:3.0:1789760750.921137:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565239808 00000100:00100000:3.0:1789760750.921147:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565239808 00000100:00100000:3.0:1789760750.921206:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689154594814 time 689171296195 state 0x0 ref 1 00000100:00100000:3.0:1789760750.921222:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689171556611 time 689171296195 state 0x1 ref 1 00000100:00100000:3.0:1789760750.921252:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689171556611 time 689181543774 state 0x0 ref 1 00000100:00100000:3.0:1789760750.921265:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565239808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760750.921320:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64385024, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0x1eb50 00010000:00010000:3.0:1789760750.921330:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ace1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.921346:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760750.921350:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.921357:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ace1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64385024->64389119] (req 64385024->64389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.921371:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ace1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64385024->64389119] (req 64385024->64389119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760750.928896:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983027 is committed 00000001:00080000:3.0:1789760750.963836:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983029 is committed 00000001:00080000:3.0:1789760750.974899:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983030 is committed 00000001:00080000:3.0:1789760750.985574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983031 is committed 00000100:00100000:3.0:1789760750.997729:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565240704 00000100:00100000:3.0:1789760750.997734:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565240704 00000100:00100000:3.0:1789760750.997774:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565240832 00000100:00100000:3.0:1789760750.997778:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565240832 00000100:00100000:3.0:1789760750.997806:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 437 00000100:00100000:3.0:1789760750.997815:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565240704:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1789760750.997898:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565240704:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 84us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.997906:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 437 00000100:00100000:3.0:1789760750.997924:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 438 00000100:00100000:3.0:1789760750.997942:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565240832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1789760750.997969:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565240832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.997976:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 438 00000100:00080000:3.0:1789760750.997992:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760751.002447:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983032 is committed 00000001:00080000:3.0:1789760751.012752:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983033 is committed 00000001:00080000:3.0:1789760751.025335:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983034 is committed 00000100:00100000:3.0:1789760751.031748:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565241216 00000100:00100000:3.0:1789760751.031767:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565241216 00000100:00100000:3.0:1789760751.031825:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689268978802 time 689279465963 state 0x0 ref 1 00000100:00100000:3.0:1789760751.031840:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689279726379 time 689279465963 state 0x1 ref 1 00000100:00100000:3.0:1789760751.031872:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689279726379 time 689292163785 state 0x0 ref 1 00000100:00100000:3.0:1789760751.031894:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565241216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.031953:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64417792, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1eb90 00010000:00010000:3.0:1789760751.031963:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ad19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.031979:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.031983:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.031989:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ad19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64417792->64421887] (req 64417792->64421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.032003:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ad19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64417792->64421887] (req 64417792->64421887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.052961:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760751.072131:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983037 is committed 00000100:00100000:3.0:1789760751.087232:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.139622:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.203253:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760751.213585:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64458752 -> 64462848 00002000:00010000:3.0:1789760751.213590:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125920 -> 125928 00010000:00010000:3.0:1789760751.213604:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213616:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213626:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213634:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.213639:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213649:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213669:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.213677:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ad5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64458752->64462847] (req 64458752->64462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.213994:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565242496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10246us (10746us total) trans 4294983045 rc 0/0 00000100:00100000:3.0:1789760751.214005:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15748 00000100:00100000:3.0:1789760751.214014:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689445896866 time 689463992467 state 0x2 ref 0 00000100:00100000:3.0:1789760751.271781:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.298692:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.314341:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.321614:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565243264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6367us (7277us total) trans 4294983051 rc 0/0 00000100:00100000:3.0:1789760751.321625:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15754 00000100:00100000:3.0:1789760751.321645:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689559518833 time 689575521424 state 0x2 ref 0 00000100:00100000:3.0:1789760751.348233:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760751.360950:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565243648 00000100:00100000:3.0:1789760751.360961:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565243648 00000100:00100000:3.0:1789760751.361095:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689593045445 time 689609559611 state 0x0 ref 1 00000100:00100000:3.0:1789760751.361114:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689609820027 time 689609559611 state 0x1 ref 1 00000100:00100000:3.0:1789760751.361257:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689609820027 time 689621547303 state 0x0 ref 1 00000100:00100000:3.0:1789760751.361272:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565243648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.361332:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64495616, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ec28 00010000:00010000:3.0:1789760751.361341:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.361357:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.361362:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.361370:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.361385:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.370545:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64495616 -> 64499712 00002000:00010000:3.0:1789760751.370557:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 125992 -> 126000 00010000:00010000:3.0:1789760751.370572:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370585:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370601:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370609:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.370614:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370622:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370641:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.370649:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ad9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64495616->64499711] (req 64495616->64499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.461851:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64520192 -> 64524288 00002000:00010000:3.0:1789760751.461857:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126040 -> 126048 00010000:00010000:3.0:1789760751.461871:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461884:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461892:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461900:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.461905:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461914:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461942:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.461950:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674adc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64520192->64524287] (req 64520192->64524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.462040:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565244416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5834us (6046us total) trans 4294983060 rc 0/0 00000100:00100000:3.0:1789760751.462050:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15763 00000100:00100000:3.0:1789760751.462060:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689705038043 time 689716482555 state 0x2 ref 0 00000100:00100000:3.0:1789760751.506935:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565244800 00000100:00100000:3.0:1789760751.506945:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565244800 00000100:00100000:3.0:1789760751.507003:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689727381248 time 689743414172 state 0x0 ref 1 00000100:00100000:3.0:1789760751.507018:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689743674588 time 689743414172 state 0x1 ref 1 00000100:00100000:3.0:1789760751.507051:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689743674588 time 689767342719 state 0x0 ref 1 00000100:00100000:3.0:1789760751.507067:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565244800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.507123:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64532480, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ec70 00010000:00010000:3.0:1789760751.507133:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.507147:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.507152:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.507157:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.507170:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.514067:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64532480 -> 64536576 00002000:00010000:3.0:1789760751.514072:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126064 -> 126072 00010000:00010000:3.0:1789760751.514086:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514098:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514111:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514118:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.514124:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514132:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514151:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.514160:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674addd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64532480->64536575] (req 64532480->64536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.514305:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565244800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7237us (7477us total) trans 4294983063 rc 0/0 00000100:00100000:3.0:1789760751.514316:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15766 00000100:00100000:3.0:1789760751.514326:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689743674588 time 689767342719 state 0x2 ref 0 00000100:00100000:3.0:1789760751.556893:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565245184 00000100:00100000:3.0:1789760751.556903:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565245184 00000100:00100000:3.0:1789760751.557048:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689780542538 time 689798416005 state 0x0 ref 1 00000100:00100000:3.0:1789760751.557063:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689798676421 time 689798416005 state 0x1 ref 1 00000100:00100000:3.0:1789760751.557102:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689798676421 time 689817386930 state 0x0 ref 1 00000100:00100000:3.0:1789760751.557116:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565245184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.557163:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64544768, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ec88 00010000:00010000:3.0:1789760751.557173:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.557187:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.557191:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.557198:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.557212:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.565744:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64544768 -> 64548864 00002000:00010000:3.0:1789760751.565754:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126088 -> 126096 00010000:00010000:3.0:1789760751.565769:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565783:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565792:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565800:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.565805:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565815:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565835:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.565843:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674adf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64544768->64548863] (req 64544768->64548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.565949:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565245184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8832us (9138us total) trans 4294983066 rc 0/0 00000100:00100000:3.0:1789760751.565960:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15769 00000100:00100000:3.0:1789760751.565970:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689798676421 time 689817386930 state 0x2 ref 0 00000100:00100000:3.0:1789760751.606209:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565245568 00000100:00100000:3.0:1789760751.606218:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565245568 00000100:00100000:3.0:1789760751.606273:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689835614851 time 689850301653 state 0x0 ref 1 00000100:00100000:3.0:1789760751.606288:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689850562069 time 689850301653 state 0x1 ref 1 00000100:00100000:3.0:1789760751.606484:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689850562069 time 689866774897 state 0x0 ref 1 00000100:00100000:3.0:1789760751.606498:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565245568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.606559:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64557056, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1eca0 00010000:00010000:3.0:1789760751.606569:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.606584:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.606589:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.606597:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.606621:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.612998:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64557056 -> 64561152 00002000:00010000:3.0:1789760751.613004:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126112 -> 126120 00010000:00010000:3.0:1789760751.613018:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613032:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613041:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613049:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.613054:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613064:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613089:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.613103:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64557056->64561151] (req 64557056->64561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.613217:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565245568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6716us (7264us total) trans 4294983069 rc 0/0 00000100:00100000:3.0:1789760751.613226:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15772 00000100:00100000:3.0:1789760751.613237:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689850562069 time 689866774897 state 0x2 ref 0 00002000:00010000:3.0:1789760751.626228:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64561152 -> 64565248 00002000:00010000:3.0:1789760751.626239:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126120 -> 126128 00010000:00010000:3.0:1789760751.626254:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626274:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626283:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626291:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.626295:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626303:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626328:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.626336:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674ae0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64561152->64565247] (req 64561152->64565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.626432:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565245696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9687us (9948us total) trans 4294983070 rc 0/0 00000100:00100000:3.0:1789760751.626441:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15773 00000100:00100000:3.0:1789760751.626449:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689867035313 time 689876993135 state 0x2 ref 0 00000100:00100000:3.0:1789760751.653504:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565245952 00000100:00100000:3.0:1789760751.653514:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565245952 00000100:00100000:3.0:1789760751.653568:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689877253551 time 689895701615 state 0x0 ref 1 00000100:00100000:3.0:1789760751.653584:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689895962031 time 689895701615 state 0x1 ref 1 00000100:00100000:3.0:1789760751.653616:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689895962031 time 689913908177 state 0x0 ref 1 00000100:00100000:3.0:1789760751.653629:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565245952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.653685:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64569344, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ecb8 00010000:00010000:3.0:1789760751.653696:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.653753:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.653758:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.653764:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.653778:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.661201:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64569344 -> 64573440 00002000:00010000:3.0:1789760751.661206:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126136 -> 126144 00010000:00010000:3.0:1789760751.661219:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661233:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661243:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661251:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.661256:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661265:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661340:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.661354:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64569344->64573439] (req 64569344->64573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.661439:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565245952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7809us (8063us total) trans 4294983072 rc 0/0 00000100:00100000:3.0:1789760751.661449:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15775 00000100:00100000:3.0:1789760751.661459:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689895962031 time 689913908177 state 0x2 ref 0 00000100:00100000:3.0:1789760751.665461:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565246080 00000100:00100000:3.0:1789760751.665472:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565246080 00000100:00100000:3.0:1789760751.665528:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689895962031 time 689913908177 state 0x0 ref 1 00000100:00100000:3.0:1789760751.665542:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689914168593 time 689913908177 state 0x1 ref 1 00000100:00100000:3.0:1789760751.665579:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689914168593 time 689925870374 state 0x0 ref 1 00000100:00100000:3.0:1789760751.665593:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565246080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.665644:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64573440, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ecc0 00010000:00010000:3.0:1789760751.665654:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.665669:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.665674:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.665681:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.665736:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.671975:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64573440 -> 64577536 00002000:00010000:3.0:1789760751.671981:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126144 -> 126152 00010000:00010000:3.0:1789760751.671993:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672007:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672015:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672023:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.672028:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672037:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672056:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.672063:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64573440->64577535] (req 64573440->64577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.672153:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565246080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6558us (7092us total) trans 4294983073 rc 0/0 00000100:00100000:3.0:1789760751.672162:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15776 00000100:00100000:3.0:1789760751.672171:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689914168593 time 689925870374 state 0x2 ref 0 00000100:00100000:3.0:1789760751.693124:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565246336 00000100:00100000:3.0:1789760751.693134:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565246336 00000100:00100000:3.0:1789760751.693190:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689926130790 time 689938973640 state 0x0 ref 1 00000100:00100000:3.0:1789760751.693206:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689939234056 time 689938973640 state 0x1 ref 1 00000100:00100000:3.0:1789760751.693239:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689939234056 time 689953530771 state 0x0 ref 1 00000100:00100000:3.0:1789760751.693252:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565246336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.693301:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64581632, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ecd0 00010000:00010000:3.0:1789760751.693310:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.693327:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.693332:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.693338:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64581632->64585727] (req 64581632->64585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.693353:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ae31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64581632->64585727] (req 64581632->64585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.717295:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565246464 00000100:00100000:3.0:1789760751.717305:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565246464 00000100:00100000:3.0:1789760751.717362:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689939234056 time 689953530771 state 0x0 ref 1 00000100:00100000:3.0:1789760751.717378:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689953791187 time 689953530771 state 0x1 ref 1 00000100:00100000:3.0:1789760751.717406:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689953791187 time 689977697512 state 0x0 ref 1 00000100:00100000:3.0:1789760751.717419:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565246464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.717481:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64585728, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ecd8 00010000:00010000:3.0:1789760751.717491:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.717524:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1789760751.717529:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.717535:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.717550:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.726260:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64585728 -> 64589824 00002000:00010000:3.0:1789760751.726269:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126168 -> 126176 00010000:00010000:3.0:1789760751.726295:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726314:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726324:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726332:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.726337:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726347:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726367:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.726375:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ae38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64585728->64589823] (req 64585728->64589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.726982:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565246464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9560us (9884us total) trans 4294983076 rc 0/0 00000100:00100000:3.0:1789760751.726993:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15779 00000100:00100000:3.0:1789760751.727003:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689953791187 time 689977697512 state 0x2 ref 0 00002000:00010000:3.0:1789760751.764466:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64589824 -> 64593920 00002000:00010000:3.0:1789760751.764479:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126176 -> 126184 00010000:00010000:3.0:1789760751.764494:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.764508:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.764517:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.764524:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.764529:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.764538:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.765395:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.765406:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ae3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64589824->64593919] (req 64589824->64593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.765775:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565246592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18419us (23164us total) trans 4294983077 rc 0/0 00000100:00100000:3.0:1789760751.765786:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15780 00000100:00100000:3.0:1789760751.765795:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 689977957928 time 690007630797 state 0x2 ref 0 00000100:00100000:3.0:1789760751.792582:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565246848 00000100:00100000:3.0:1789760751.792592:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565246848 00000100:00100000:3.0:1789760751.792644:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690007891213 time 690032687802 state 0x0 ref 1 00000100:00100000:3.0:1789760751.792660:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690032948218 time 690032687802 state 0x1 ref 1 00000100:00100000:3.0:1789760751.792689:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690032948218 time 690052981735 state 0x0 ref 1 00000100:00100000:3.0:1789760751.792720:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565246848:12345-192.168.203.47@tcp:4:dd.0 00000001:00080000:3.0:1789760751.798506:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983079 is committed 00000100:00100000:3.0:1789760751.809688:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565246976 00000100:00100000:3.0:1789760751.809696:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565246976 00000100:00100000:3.0:1789760751.809790:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690032948218 time 690052981735 state 0x0 ref 1 00000100:00100000:3.0:1789760751.809806:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690053242151 time 690052981735 state 0x1 ref 1 00000100:00100000:3.0:1789760751.809834:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690053242151 time 690070126619 state 0x0 ref 1 00000100:00100000:3.0:1789760751.809846:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565246976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.809902:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64602112, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ecf8 00010000:00010000:3.0:1789760751.809911:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.809938:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1789760751.809943:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.809949:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.809963:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760751.816617:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64602112 -> 64606208 00002000:00010000:3.0:1789760751.816627:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126200 -> 126208 00010000:00010000:3.0:1789760751.816640:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816653:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816664:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816671:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760751.816676:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816685:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816728:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.816737:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64602112->64606207] (req 64602112->64606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.816839:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565246976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6989us (7742us total) trans 4294983080 rc 0/0 00000100:00100000:3.0:1789760751.816849:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15783 00000100:00100000:3.0:1789760751.816859:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690053242151 time 690070126619 state 0x2 ref 0 00000100:00100000:3.0:1789760751.859498:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565247360 00000100:00100000:3.0:1789760751.859507:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565247360 00000100:00100000:3.0:1789760751.859561:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690084310794 time 690107757673 state 0x0 ref 1 00000100:00100000:3.0:1789760751.859577:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690108018089 time 690107757673 state 0x1 ref 1 00000100:00100000:3.0:1789760751.859607:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690108018089 time 690119899251 state 0x0 ref 1 00000100:00100000:3.0:1789760751.859620:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565247360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760751.859668:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64614400, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0x1ed10 00010000:00010000:3.0:1789760751.859678:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.859696:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1789760751.859700:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.859816:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64614400->64618495] (req 64614400->64618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.859832:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ae69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64614400->64618495] (req 64614400->64618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760751.940015:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983088 is committed 00000100:00100000:3.0:1789760751.961649:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.005278:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.041594:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.063227:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.087102:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.126392:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.130190:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983105 is committed 00000001:00080000:3.0:1789760752.142696:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983106 is committed 00000001:00080000:3.0:1789760752.153934:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983107 is committed 00000100:00100000:3.0:1789760752.164366:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760752.190699:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64720896 -> 64724992 00002000:00010000:3.0:1789760752.190725:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126432 -> 126440 00010000:00010000:3.0:1789760752.190738:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190752:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190761:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190768:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760752.190772:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190785:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190808:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.190815:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674af1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64720896->64724991] (req 64720896->64724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.191018:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565250688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6721us (6973us total) trans 4294983109 rc 0/0 00000100:00100000:3.0:1789760752.191029:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15812 00000100:00100000:3.0:1789760752.191038:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690425179143 time 690444571309 state 0x2 ref 0 00000100:00100000:3.0:1789760752.195136:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.202125:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565250816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5884us (6991us total) trans 4294983110 rc 0/0 00000100:00100000:3.0:1789760752.202136:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15813 00000100:00100000:3.0:1789760752.202145:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690444831725 time 690456513791 state 0x2 ref 0 00000100:00100000:3.0:1789760752.232696:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.256671:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.266117:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983115 is committed 00000100:00100000:3.0:1789760752.275887:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565251584 00000100:00100000:3.0:1789760752.275898:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565251584 00000100:00100000:3.0:1789760752.275962:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690506239898 time 690517402188 state 0x0 ref 1 00000100:00100000:3.0:1789760752.275978:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690517662604 time 690517402188 state 0x1 ref 1 00000100:00100000:3.0:1789760752.276008:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690517662604 time 690536299994 state 0x0 ref 1 00000100:00100000:3.0:1789760752.276021:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565251584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760752.276067:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64749568, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0x1ee18 00010000:00010000:3.0:1789760752.276076:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674af50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.276091:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1789760752.276096:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760752.276101:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674af50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64749568->64753663] (req 64749568->64753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.276115:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674af50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64749568->64753663] (req 64749568->64753663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760752.293253:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983117 is committed 00000100:00100000:3.0:1789760752.297177:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565251840 00000100:00100000:3.0:1789760752.297187:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565251840 00000100:00100000:3.0:1789760752.297241:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690536560410 time 690548865282 state 0x0 ref 1 00000100:00100000:3.0:1789760752.297253:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690549125698 time 690548865282 state 0x1 ref 1 00000100:00100000:3.0:1789760752.297283:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690549125698 time 690557575303 state 0x0 ref 1 00000100:00100000:3.0:1789760752.297340:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565251840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760752.297389:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64757760, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0x1ee28 00010000:00010000:3.0:1789760752.297399:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674af5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.297414:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1789760752.297419:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760752.297574:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674af5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64757760->64761855] (req 64757760->64761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.297592:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674af5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64757760->64761855] (req 64757760->64761855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760752.457667:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983128 is committed 00002000:00010000:3.0:1789760752.507570:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64811008 -> 64815104 00002000:00010000:3.0:1789760752.507575:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126608 -> 126616 00010000:00010000:3.0:1789760752.507589:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507600:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507609:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507616:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760752.507626:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507635:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507653:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.507661:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674afb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64811008->64815103] (req 64811008->64815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.507769:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565253504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5928us (6236us total) trans 4294983131 rc 0/0 00000100:00100000:3.0:1789760752.507779:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15834 00000100:00100000:3.0:1789760752.507793:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690748218991 time 690762113688 state 0x2 ref 0 00000100:00100000:3.0:1789760752.562320:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.607113:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565254272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4894us (5170us total) trans 4294983137 rc 0/0 00000100:00100000:3.0:1789760752.607122:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15840 00000100:00100000:3.0:1789760752.607132:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 690849838578 time 690862493719 state 0x2 ref 0 00000001:00080000:3.0:1789760752.616074:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983138 is committed 00000001:00080000:3.0:1789760752.627407:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983139 is committed 00000100:00100000:3.0:1789760752.631092:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.635818:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983140 is committed 00000001:00080000:3.0:1789760752.646928:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983141 is committed 00000001:00080000:3.0:1789760752.669768:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983142 is committed 00000100:00100000:3.0:1789760752.684485:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.708157:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.721117:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.732691:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.755360:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.782100:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760752.788866:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64880640 -> 64884736 00002000:00010000:3.0:1789760752.788871:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126744 -> 126752 00010000:00010000:3.0:1789760752.788885:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788897:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788907:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788914:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760752.788929:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788939:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788957:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.788971:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674b030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64880640->64884735] (req 64880640->64884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.789153:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565255680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6566us (7057us total) trans 4294983148 rc 0/0 00000100:00100000:3.0:1789760752.789162:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15851 00000100:00100000:3.0:1789760752.789171:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691016616168 time 691042863725 state 0x2 ref 0 00000100:00100000:3.0:1789760752.796138:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.804376:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983149 is committed 00000100:00100000:3.0:1789760752.809877:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.816203:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983150 is committed 00000100:00100000:3.0:1789760752.821137:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.831693:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983151 is committed 00000100:00100000:3.0:1789760752.840962:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.856991:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.873547:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983153 is committed 00000100:00100000:3.0:1789760752.874261:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565256320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13729us (17274us total) trans 4294983153 rc 0/0 00000100:00100000:3.0:1789760752.874341:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15856 00000100:00100000:3.0:1789760752.875410:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691101785166 time 691120808252 state 0x2 ref 0 00000100:00100000:3.0:1789760752.878682:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.885668:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983154 is committed 00000100:00100000:3.0:1789760752.893751:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565256576 00000100:00100000:3.0:1789760752.893761:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565256576 00000100:00100000:3.0:1789760752.893820:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691121068668 time 691139582868 state 0x0 ref 1 00000100:00100000:3.0:1789760752.893837:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691139843284 time 691139582868 state 0x1 ref 1 00000100:00100000:3.0:1789760752.893876:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691139843284 time 691154168542 state 0x0 ref 1 00000100:00100000:3.0:1789760752.893889:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565256576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760752.893951:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64909312, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0x1ef50 00010000:00010000:3.0:1789760752.893961:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.893978:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760752.893983:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760752.893990:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64909312->64913407] (req 64909312->64913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.894005:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64909312->64913407] (req 64909312->64913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760752.900240:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983155 is committed 00000100:00100000:3.0:1789760752.906795:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760752.913787:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983156 is committed 00000001:00080000:3.0:1789760752.927530:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983157 is committed 00000100:00100000:3.0:1789760752.935180:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.946819:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.983440:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760752.996150:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565257472 00000100:00100000:3.0:1789760752.996159:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565257472 00000100:00100000:3.0:1789760752.996213:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691227245791 time 691244106547 state 0x0 ref 1 00000100:00100000:3.0:1789760752.996227:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691244366963 time 691244106547 state 0x1 ref 1 00000100:00100000:3.0:1789760752.996257:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691244366963 time 691256549449 state 0x0 ref 1 00000100:00100000:3.0:1789760752.996376:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565257472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760752.996424:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64937984, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0x1ef88 00010000:00010000:3.0:1789760752.996433:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.996448:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760752.996452:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760752.996458:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.996473:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760753.005824:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64937984 -> 64942080 00002000:00010000:3.0:1789760753.005835:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126856 -> 126864 00010000:00010000:3.0:1789760753.005848:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005861:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005875:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005883:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760753.005887:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005896:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005926:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.005935:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64937984->64942079] (req 64937984->64942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.006101:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565257472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9724us (10147us total) trans 4294983162 rc 0/0 00000100:00100000:3.0:1789760753.006111:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15865 00000100:00100000:3.0:1789760753.006120:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691244366963 time 691256549449 state 0x2 ref 0 00000100:00100000:3.0:1789760753.023895:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565257728 00000100:00100000:3.0:1789760753.023905:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565257728 00000100:00100000:3.0:1789760753.023967:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691256809865 time 691272166813 state 0x0 ref 1 00000100:00100000:3.0:1789760753.023982:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691272427229 time 691272166813 state 0x1 ref 1 00000100:00100000:3.0:1789760753.024010:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691272427229 time 691284302218 state 0x0 ref 1 00000100:00100000:3.0:1789760753.024022:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565257728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760753.024071:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64946176, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0x1ef98 00010000:00010000:3.0:1789760753.024080:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.024094:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760753.024099:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.024105:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.024118:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760753.031150:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64946176 -> 64950272 00002000:00010000:3.0:1789760753.031155:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126872 -> 126880 00010000:00010000:3.0:1789760753.031168:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031179:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031189:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031200:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760753.031205:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031214:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031232:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.031244:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64946176->64950271] (req 64946176->64950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.031335:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565257728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7311us (7574us total) trans 4294983164 rc 0/0 00000100:00100000:3.0:1789760753.031346:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15867 00000100:00100000:3.0:1789760753.031355:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691272427229 time 691284302218 state 0x2 ref 0 00000100:00100000:3.0:1789760753.039555:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565257856 00000100:00100000:3.0:1789760753.039564:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565257856 00000100:00100000:3.0:1789760753.039616:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691272427229 time 691284302218 state 0x0 ref 1 00000100:00100000:3.0:1789760753.039631:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691284562634 time 691284302218 state 0x1 ref 1 00000100:00100000:3.0:1789760753.039666:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691284562634 time 691299957102 state 0x0 ref 1 00000100:00100000:3.0:1789760753.039682:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565257856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760753.039766:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64950272, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0x1efa0 00010000:00010000:3.0:1789760753.039775:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b0a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.039791:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760753.039796:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.039802:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b0a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64950272->64954367] (req 64950272->64954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.039816:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b0a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64950272->64954367] (req 64950272->64954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760753.045810:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983165 is committed 00000100:00100000:3.0:1789760753.065110:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565258112 00000100:00100000:3.0:1789760753.065123:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565258112 00000100:00100000:3.0:1789760753.076481:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760753.082968:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983168 is committed 00000001:00080000:3.0:1789760753.098826:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983169 is committed 00000001:00080000:3.0:1789760753.107753:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983170 is committed 00000100:00100000:3.0:1789760753.115391:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760753.119832:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983171 is committed 00000001:00080000:3.0:1789760753.137411:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983172 is committed 00000100:00100000:3.0:1789760753.163537:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760753.184222:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983175 is committed 00000100:00100000:3.0:1789760753.187215:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760753.202952:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565259392 00000100:00100000:3.0:1789760753.202961:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565259392 00000100:00100000:3.0:1789760753.203014:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691437184081 time 691447695999 state 0x0 ref 1 00000100:00100000:3.0:1789760753.203029:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691447956415 time 691447695999 state 0x1 ref 1 00000100:00100000:3.0:1789760753.203057:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691447956415 time 691463349085 state 0x0 ref 1 00000100:00100000:3.0:1789760753.203069:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565259392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760753.203115:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 64999424, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0x1f000 00010000:00010000:3.0:1789760753.203124:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.203139:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760753.203143:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.203150:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.203164:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760753.207115:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 64999424 -> 65003520 00002000:00010000:3.0:1789760753.207121:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126976 -> 126984 00010000:00010000:3.0:1789760753.207134:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207145:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207159:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207167:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760753.207172:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207182:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207201:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.207209:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b0fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [64999424->65003519] (req 64999424->65003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.207318:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565259392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4246us (4464us total) trans 4294983177 rc 0/0 00000100:00100000:3.0:1789760753.207328:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15880 00000100:00100000:3.0:1789760753.207339:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691447956415 time 691463349085 state 0x2 ref 0 00000100:00100000:3.0:1789760753.246751:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565259776 00000100:00100000:3.0:1789760753.246760:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565259776 00000100:00100000:3.0:1789760753.246826:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691485221695 time 691495945147 state 0x0 ref 1 00000100:00100000:3.0:1789760753.246842:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691496205563 time 691495945147 state 0x1 ref 1 00000100:00100000:3.0:1789760753.246874:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 691496205563 time 691507165869 state 0x0 ref 1 00000100:00100000:3.0:1789760753.246886:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565259776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760753.246947:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65011712, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0x1f018 00010000:00010000:3.0:1789760753.246957:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b110 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.246972:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1789760753.246976:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.246982:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->65015807] (req 65011712->65015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.246996:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->65015807] (req 65011712->65015807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760753.298052:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983182 is committed 00000001:00080000:3.0:1789760753.443527:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983191 is committed 00000001:00080000:3.0:1789760753.459769:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983192 is committed 00000001:00080000:3.0:1789760753.479889:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983193 is committed 00000001:00080000:3.0:1789760753.497833:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983194 is committed 00000001:00080000:3.0:1789760753.526502:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983195 is committed 00000001:00080000:3.0:1789760753.631617:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983201 is committed 00000001:00080000:3.0:1789760753.651437:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983202 is committed 00000001:00080000:3.0:1789760753.663221:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983203 is committed 00000001:00080000:3.0:1789760753.756622:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983207 is committed 00000001:00080000:3.0:1789760753.840926:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983212 is committed 00000001:00080000:3.0:1789760753.857788:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983213 is committed 00000001:00080000:3.0:1789760753.875006:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983214 is committed 00000001:00080000:3.0:1789760753.898195:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983215 is committed 00000001:00080000:3.0:1789760753.996467:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983220 is committed 00000100:00080000:3.0:1789760754.007080:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760754.012616:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983221 is committed 00000001:00080000:3.0:1789760754.031391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983222 is committed 00000001:00080000:3.0:1789760754.044772:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983223 is committed 00000001:00080000:3.0:1789760754.072791:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983225 is committed 00000001:00080000:3.0:1789760754.200622:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983232 is committed 00000001:00080000:3.0:1789760754.237644:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983234 is committed 00000001:00080000:3.0:1789760754.252204:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983235 is committed 00000001:00080000:3.0:1789760754.270128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983236 is committed 00000100:00100000:3.0:1789760754.308489:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.319600:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.327944:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983240 is committed 00000100:00100000:3.0:1789760754.361837:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.383468:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.412796:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983244 is committed 00000100:00100000:3.0:1789760754.416931:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.423369:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983245 is committed 00000100:00100000:3.0:1789760754.429325:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.444290:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760754.444314:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580061312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760754.444384:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760754.446444:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580061312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760754.446474:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3458:1876699580061696:0@lo:400:kworker.0 00000100:00100000:3.0:1789760754.446522:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760754.450161:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f1ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3457:1876699580061568:0@lo:400:kworker.0 00000100:00100000:3.0:1789760754.450687:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3458:1876699580061696:0@lo:400:kworker.0 00000001:00080000:3.0:1789760754.457573:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983246 is committed 00000001:00080000:3.0:1789760754.468526:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983247 is committed 00000100:00100000:3.0:1789760754.479137:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.485124:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983248 is committed 00000100:00100000:3.0:1789760754.497094:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.546787:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.568388:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.590825:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.629200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983256 is committed 00000100:00100000:3.0:1789760754.636032:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.643257:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983257 is committed 00000001:00080000:3.0:1789760754.660435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983258 is committed 00000001:00080000:3.0:1789760754.789114:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983265 is committed 00000100:00100000:3.0:1789760754.865204:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760754.895304:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983270 is committed 00000100:00100000:3.0:1789760754.918259:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760754.961793:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65396736 -> 65400832 00002000:00010000:3.0:1789760754.961799:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 127752 -> 127760 00010000:00010000:3.0:1789760754.961816:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.961831:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.961842:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.961933:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760754.962054:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.962067:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.962092:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.962102:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674b3a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65396736->65400831] (req 65396736->65400831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.962229:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565271808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11124us (13941us total) trans 4294983274 rc 0/0 00000100:00100000:3.0:1789760754.962242:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15977 00000100:00100000:3.0:1789760754.962254:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693194721897 time 693211378164 state 0x2 ref 0 00000100:00100000:3.0:1789760754.967451:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760754.994185:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565272192 00000100:00100000:3.0:1789760754.994348:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565272192 00000100:00100000:3.0:1789760754.994497:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693228372614 time 693241750109 state 0x0 ref 1 00000100:00100000:3.0:1789760754.994517:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693242010525 time 693241750109 state 0x1 ref 1 00000100:00100000:3.0:1789760754.994616:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693242010525 time 693254906497 state 0x0 ref 1 00000100:00100000:3.0:1789760754.994633:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565272192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760754.994735:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65409024, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f320 00010000:00010000:3.0:1789760754.994747:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b3b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.994767:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1789760754.994772:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.994781:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b3b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65409024->65413119] (req 65409024->65413119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.994798:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b3b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65409024->65413119] (req 65409024->65413119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760755.003436:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983277 is committed 00000001:00080000:3.0:1789760755.038282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983279 is committed 00000100:00100000:3.0:1789760755.050378:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565272576 00000100:00100000:3.0:1789760755.050392:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565272576 00000100:00100000:3.0:1789760755.050494:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693268698998 time 693290812756 state 0x0 ref 1 00000100:00100000:3.0:1789760755.050511:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693291073172 time 693290812756 state 0x1 ref 1 00000100:00100000:3.0:1789760755.050544:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693291073172 time 693310835837 state 0x0 ref 1 00000100:00100000:3.0:1789760755.050559:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565272576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760755.050628:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65421312, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f338 00010000:00010000:3.0:1789760755.050640:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.050659:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1789760755.050665:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.050672:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.050689:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760755.062921:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65421312 -> 65425408 00002000:00010000:3.0:1789760755.062930:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 127800 -> 127808 00010000:00010000:3.0:1789760755.062947:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.062963:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.062974:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.062982:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760755.062988:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.062998:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.063023:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.063032:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65421312->65425407] (req 65421312->65425407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760755.075694:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983281 is committed 00000100:00100000:3.0:1789760755.082195:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.092558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983282 is committed 00000001:00080000:3.0:1789760755.104168:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983283 is committed 00000001:00080000:3.0:1789760755.120316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983284 is committed 00000100:00100000:3.0:1789760755.124579:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.171996:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760755.173653:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65454080, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f378 00010000:00010000:3.0:1789760755.173673:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.173689:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1789760755.173694:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.173700:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.173862:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760755.181586:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65454080 -> 65458176 00002000:00010000:3.0:1789760755.181592:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 127864 -> 127872 00010000:00010000:3.0:1789760755.181609:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181623:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181633:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181640:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760755.181646:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181827:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181974:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.181984:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b404 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65454080->65458175] (req 65454080->65458175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.182091:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565273600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8976us (10105us total) trans 4294983288 rc 0/0 00000100:00100000:3.0:1789760755.182102:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 15991 00000100:00100000:3.0:1789760755.182112:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693416230410 time 693433390535 state 0x2 ref 0 00000100:00100000:3.0:1789760755.200359:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.210164:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.245667:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.270188:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.305790:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.321371:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983296 is committed 00000001:00080000:3.0:1789760755.339400:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983297 is committed 00000100:00100000:3.0:1789760755.372340:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.406550:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983300 is committed 00000100:00100000:3.0:1789760755.432380:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.472999:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983304 is committed 00000001:00080000:3.0:1789760755.484037:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983305 is committed 00000001:00080000:3.0:1789760755.509025:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983307 is committed 00000100:00100000:3.0:1789760755.514140:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.519949:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983308 is committed 00000001:00080000:3.0:1789760755.550667:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983310 is committed 00000001:00080000:3.0:1789760755.574173:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983312 is committed 00000001:00080000:3.0:1789760755.583102:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983313 is committed 00000100:00100000:3.0:1789760755.588928:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.594429:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983314 is committed 00000100:00100000:3.0:1789760755.599217:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.607355:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983315 is committed 00000100:00100000:3.0:1789760755.634441:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.650330:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565277440 00000100:00100000:3.0:1789760755.650345:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565277440 00000100:00100000:3.0:1789760755.650416:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693873306398 time 693895063392 state 0x0 ref 1 00000100:00100000:3.0:1789760755.650436:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693895323808 time 693895063392 state 0x1 ref 1 00000100:00100000:3.0:1789760755.650473:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 693895323808 time 693910764435 state 0x0 ref 1 00000100:00100000:3.0:1789760755.650489:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565277440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760755.650551:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65576960, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f468 00010000:00010000:3.0:1789760755.650564:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b4d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.650584:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1789760755.650590:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.650597:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65576960->65581055] (req 65576960->65581055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.650615:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65576960->65581055] (req 65576960->65581055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.686592:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.737461:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.838526:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.845698:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983331 is committed 00000001:00080000:3.0:1789760755.863822:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983332 is committed 00000100:00100000:3.0:1789760755.868558:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565279360 00000100:00100000:3.0:1789760755.868570:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565279360 00000100:00100000:3.0:1789760755.868808:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694099617344 time 694111751973 state 0x0 ref 1 00000100:00100000:3.0:1789760755.868827:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694112012389 time 694111751973 state 0x1 ref 1 00000100:00100000:3.0:1789760755.869137:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694112012389 time 694129428008 state 0x0 ref 1 00000100:00100000:3.0:1789760755.869155:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565279360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760755.869219:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65638400, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f4e0 00010000:00010000:3.0:1789760755.869231:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.869262:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760755.869267:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.869275:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.869292:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760755.875778:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65638400 -> 65642496 00002000:00010000:3.0:1789760755.875785:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128224 -> 128232 00010000:00010000:3.0:1789760755.875802:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875817:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875827:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875919:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760755.875925:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875935:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875961:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.875969:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b53f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65638400->65642495] (req 65638400->65642495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.876159:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565279360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7000us (8195us total) trans 4294983333 rc 0/0 00000100:00100000:3.0:1789760755.876172:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16036 00000100:00100000:3.0:1789760755.876186:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694112012389 time 694129428008 state 0x2 ref 0 00000100:00100000:3.0:1789760755.886502:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760755.911096:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565279744 00000100:00100000:3.0:1789760755.911110:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565279744 00000100:00100000:3.0:1789760755.911184:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694147467494 time 694157576378 state 0x0 ref 1 00000100:00100000:3.0:1789760755.911204:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694157836794 time 694157576378 state 0x1 ref 1 00000100:00100000:3.0:1789760755.911237:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694157836794 time 694171528488 state 0x0 ref 1 00000100:00100000:3.0:1789760755.911262:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565279744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760755.911326:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65650688, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0x1f4f8 00010000:00010000:3.0:1789760755.911337:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.911357:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760755.911362:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.911378:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65650688->65654783] (req 65650688->65654783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.911396:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674b554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65650688->65654783] (req 65650688->65654783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760755.951931:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983337 is committed 00000001:00080000:3.0:1789760755.963437:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983338 is committed 00000100:00100000:3.0:1789760755.980829:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760755.987339:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983339 is committed 00000100:00100000:3.0:1789760756.020977:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.026127:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983341 is committed 00000100:00100000:3.0:1789760756.031359:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.040595:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983342 is committed 00000100:00100000:3.0:1789760756.048963:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565280640 00000100:00100000:3.0:1789760756.048976:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565280640 00000100:00100000:3.0:1789760756.049051:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694281861112 time 694296424848 state 0x0 ref 1 00000100:00100000:3.0:1789760756.049069:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694296685264 time 694296424848 state 0x1 ref 1 00000100:00100000:3.0:1789760756.049095:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694296685264 time 694309387720 state 0x0 ref 1 00000100:00100000:3.0:1789760756.049107:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565280640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.049166:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65679360, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f530 00010000:00010000:3.0:1789760756.049176:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.049195:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.049200:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.049208:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65679360->65683455] (req 65679360->65683455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.049225:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674b585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65679360->65683455] (req 65679360->65683455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760756.053675:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983343 is committed 00000100:00100000:3.0:1789760756.061886:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.069314:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983344 is committed 00000100:00100000:3.0:1789760756.074128:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.078562:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983345 is committed 00000100:00100000:3.0:1789760756.090646:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.095142:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983346 is committed 00000100:00100000:3.0:1789760756.116040:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760756.116092:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760756.116134:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760756.116911:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760756.134750:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983348 is committed 00000100:00100000:3.0:1789760756.146564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565281792 00000100:00100000:3.0:1789760756.146579:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565281792 00000100:00100000:3.0:1789760756.146655:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694360993026 time 694390318734 state 0x0 ref 1 00000100:00100000:3.0:1789760756.146672:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694390579150 time 694390318734 state 0x1 ref 1 00000100:00100000:3.0:1789760756.146732:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694390579150 time 694407022287 state 0x0 ref 1 00000100:00100000:3.0:1789760756.146747:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565281792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.146811:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65703936, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f560 00010000:00010000:3.0:1789760756.146823:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.146841:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.146846:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.146853:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.146869:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760756.153959:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65703936 -> 65708032 00002000:00010000:3.0:1789760756.153965:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128352 -> 128360 00010000:00010000:3.0:1789760756.153984:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154152:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154162:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154171:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760756.154176:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154186:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154336:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.154346:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65703936->65708031] (req 65703936->65708031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.154584:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565281792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7833us (8640us total) trans 4294983349 rc 0/0 00000100:00100000:3.0:1789760756.154598:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16052 00000100:00100000:3.0:1789760756.154611:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694390579150 time 694407022287 state 0x2 ref 0 00000100:00100000:3.0:1789760756.208321:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565282176 00000100:00100000:3.0:1789760756.208335:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565282176 00000100:00100000:3.0:1789760756.208419:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694427188478 time 694452097469 state 0x0 ref 1 00000100:00100000:3.0:1789760756.208437:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694452357885 time 694452097469 state 0x1 ref 1 00000100:00100000:3.0:1789760756.208471:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694452357885 time 694468763336 state 0x0 ref 1 00000100:00100000:3.0:1789760756.208485:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.208547:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65716224, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f578 00010000:00010000:3.0:1789760756.208558:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.208577:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.208582:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.208589:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.208604:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760756.220320:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65716224 -> 65720320 00002000:00010000:3.0:1789760756.220326:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128376 -> 128384 00010000:00010000:3.0:1789760756.221301:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221323:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221348:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221357:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760756.221363:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221435:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221466:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.221475:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65716224->65720319] (req 65716224->65720319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.221624:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13134us (13669us total) trans 4294983352 rc 0/0 00000100:00100000:3.0:1789760756.221636:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16055 00000100:00100000:3.0:1789760756.221648:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694452357885 time 694468763336 state 0x2 ref 0 00000100:00100000:3.0:1789760756.241374:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565282432 00000100:00100000:3.0:1789760756.241389:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565282432 00000100:00100000:3.0:1789760756.241471:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694469023752 time 694485203302 state 0x0 ref 1 00000100:00100000:3.0:1789760756.241491:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694485463718 time 694485203302 state 0x1 ref 1 00000100:00100000:3.0:1789760756.241527:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694485463718 time 694501818888 state 0x0 ref 1 00000100:00100000:3.0:1789760756.241543:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.241611:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65724416, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f588 00010000:00010000:3.0:1789760756.241622:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.241643:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.241648:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.241656:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.241672:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760756.249017:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65724416 -> 65728512 00002000:00010000:3.0:1789760756.249026:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128392 -> 128400 00010000:00010000:3.0:1789760756.249144:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249161:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249172:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249186:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760756.249192:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249204:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249230:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.249239:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65724416->65728511] (req 65724416->65728511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.249373:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7826us (8543us total) trans 4294983354 rc 0/0 00000100:00100000:3.0:1789760756.249386:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16057 00000100:00100000:3.0:1789760756.249398:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694485463718 time 694501818888 state 0x2 ref 0 00000100:00100000:3.0:1789760756.259559:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565282560 00000100:00100000:3.0:1789760756.259573:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565282560 00000100:00100000:3.0:1789760756.259650:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694485463718 time 694501818888 state 0x0 ref 1 00000100:00100000:3.0:1789760756.259669:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694502079304 time 694501818888 state 0x1 ref 1 00000100:00100000:3.0:1789760756.259839:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694502079304 time 694520129161 state 0x0 ref 1 00000100:00100000:3.0:1789760756.299539:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565282816 00000100:00100000:3.0:1789760756.299556:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565282816 00000100:00100000:3.0:1789760756.299620:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694520389577 time 694535203799 state 0x0 ref 1 00000100:00100000:3.0:1789760756.299647:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694535464215 time 694535203799 state 0x1 ref 1 00000100:00100000:3.0:1789760756.299669:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694535464215 time 694559961490 state 0x0 ref 1 00000100:00100000:3.0:1789760756.299683:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.299860:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65736704, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f5a0 00010000:00010000:3.0:1789760756.299869:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.299884:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.299889:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.299908:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.299923:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760756.309400:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65736704 -> 65740800 00002000:00010000:3.0:1789760756.309405:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128416 -> 128424 00010000:00010000:3.0:1789760756.309418:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309436:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309446:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309454:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760756.309458:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309468:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309489:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.309497:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65736704->65740799] (req 65736704->65740799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.309588:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565282816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9905us (14779us total) trans 4294983357 rc 0/0 00000100:00100000:3.0:1789760756.309598:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16060 00000100:00100000:3.0:1789760756.309607:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694535464215 time 694559961490 state 0x2 ref 0 00000001:00080000:3.0:1789760756.332166:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983358 is committed 00000100:00100000:3.0:1789760756.380243:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565283200 00000100:00100000:3.0:1789760756.380262:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565283200 00000100:00100000:3.0:1789760756.380398:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694583468371 time 694616990358 state 0x0 ref 1 00000100:00100000:3.0:1789760756.380417:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694617250774 time 694616990358 state 0x1 ref 1 00000100:00100000:3.0:1789760756.380756:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 694617250774 time 694641045884 state 0x0 ref 1 00000100:00100000:3.0:1789760756.380776:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565283200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.380845:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65748992, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f5b8 00010000:00010000:3.0:1789760756.380857:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.380876:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=694s v=(0 0) 00010000:00010000:3.0:1789760756.380881:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.380889:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65748992->65753087] (req 65748992->65753087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.380917:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674b5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65748992->65753087] (req 65748992->65753087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.514753:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.573795:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983369 is committed 00000100:00100000:3.0:1789760756.579916:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.588528:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983370 is committed 00000100:00100000:3.0:1789760756.739604:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760756.788555:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.794460:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983381 is committed 00000100:00100000:3.0:1789760756.797658:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.805208:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983382 is committed 00000100:00100000:3.0:1789760756.811330:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565286144 00000100:00100000:3.0:1789760756.811344:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565286144 00000100:00100000:3.0:1789760756.811419:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695049306554 time 695058263168 state 0x0 ref 1 00000100:00100000:3.0:1789760756.811439:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695058523584 time 695058263168 state 0x1 ref 1 00000100:00100000:3.0:1789760756.811472:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695058523584 time 695071763441 state 0x0 ref 1 00000100:00100000:3.0:1789760756.811486:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565286144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760756.811552:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65843200, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0x1f670 00010000:00010000:3.0:1789760756.811562:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b69d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.811582:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=695s v=(0 0) 00010000:00010000:3.0:1789760756.811586:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.811593:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65843200->65847295] (req 65843200->65847295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.811610:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674b69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65843200->65847295] (req 65843200->65847295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760756.818047:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983383 is committed 00000100:00100000:3.0:1789760756.826167:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760756.858795:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565286528 00000100:00100000:3.0:1789760756.858821:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565286528 00000001:00080000:3.0:1789760756.866263:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983386 is committed 00000001:00080000:3.0:1789760756.890213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983387 is committed 00000100:00100000:3.0:1789760756.897352:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760756.905144:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983388 is committed 00000001:00080000:3.0:1789760756.957390:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983390 is committed 00000001:00080000:3.0:1789760757.000490:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983392 is committed 00000100:00100000:3.0:1789760757.009644:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7eee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580062080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760757.009800:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789760757.014664:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760757.027165:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983393 is committed 00000001:00080000:3.0:1789760757.041280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983394 is committed 00000001:00080000:3.0:1789760757.068539:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983395 is committed 00000100:00100000:3.0:1789760757.070106:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565287680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8930us (9391us total) trans 4294983395 rc 0/0 00000100:00100000:3.0:1789760757.070123:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16098 00000100:00100000:3.0:1789760757.070136:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695293660621 time 695321441975 state 0x2 ref 0 00000100:00100000:3.0:1789760757.076675:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.121411:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565288064 00000100:00100000:3.0:1789760757.121479:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565288064 00000100:00100000:3.0:1789760757.121631:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695337815745 time 695362043149 state 0x0 ref 1 00000100:00100000:3.0:1789760757.121649:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695362303565 time 695362043149 state 0x1 ref 1 00000100:00100000:3.0:1789760757.121690:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695362303565 time 695381981847 state 0x0 ref 1 00000100:00100000:3.0:1789760757.121756:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565288064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760757.121822:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65904640, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0x1f6e8 00010000:00010000:3.0:1789760757.121833:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.121853:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=695s v=(0 0) 00010000:00010000:3.0:1789760757.121858:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.121865:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.121883:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760757.130944:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65904640 -> 65908736 00002000:00010000:3.0:1789760757.130952:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 128744 -> 128752 00010000:00010000:3.0:1789760757.130969:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.130984:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.130994:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.131003:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760757.131009:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.131025:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.131106:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.131117:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65904640->65908735] (req 65904640->65908735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.131265:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565288064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9555us (12974us total) trans 4294983398 rc 0/0 00000100:00100000:3.0:1789760757.131279:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16101 00000100:00100000:3.0:1789760757.131292:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695362303565 time 695381981847 state 0x2 ref 0 00000100:00100000:3.0:1789760757.135569:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760757.166398:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983400 is committed 00000100:00100000:3.0:1789760757.170808:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565288448 00000100:00100000:3.0:1789760757.170820:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565288448 00000100:00100000:3.0:1789760757.170907:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695396691310 time 695416046506 state 0x0 ref 1 00000100:00100000:3.0:1789760757.170927:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695416306922 time 695416046506 state 0x1 ref 1 00000100:00100000:3.0:1789760757.171117:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695416306922 time 695431407572 state 0x0 ref 1 00000100:00100000:3.0:1789760757.171134:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565288448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760757.171199:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65916928, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0x1f700 00010000:00010000:3.0:1789760757.171210:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b71b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.171229:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=695s v=(0 0) 00010000:00010000:3.0:1789760757.171235:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.171242:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b71b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65916928->65921023] (req 65916928->65921023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.171258:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674b71b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65916928->65921023] (req 65916928->65921023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.180629:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760757.204090:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983403 is committed 00000001:00080000:3.0:1789760757.227364:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983404 is committed 00000100:00100000:3.0:1789760757.236592:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760757.258858:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983406 is committed 00000100:00100000:3.0:1789760757.266148:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.308551:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.352765:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.414331:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.469582:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760757.515167:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760757.688537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983431 is committed 00000001:00080000:3.0:1789760757.702732:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983432 is committed 00000001:00080000:3.0:1789760757.715396:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983433 is committed 00000100:00100000:3.0:1789760757.722343:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695969365098 time 695982630900 state 0x0 ref 1 00000100:00100000:3.0:1789760757.722364:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565292672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760757.722435:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66052096, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0x1f808 00010000:00010000:3.0:1789760757.722446:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.722466:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=695s v=(0 0) 00010000:00010000:3.0:1789760757.722471:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.722479:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.722496:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760757.729162:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66052096 -> 66056192 00002000:00010000:3.0:1789760757.729168:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129032 -> 129040 00010000:00010000:3.0:1789760757.729186:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729200:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729210:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729218:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760757.729225:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729235:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729261:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.729270:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b802 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66052096->66056191] (req 66052096->66056191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.729402:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565292672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7037us (8104us total) trans 4294983434 rc 0/0 00000100:00100000:3.0:1789760757.729415:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16137 00000100:00100000:3.0:1789760757.729427:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695969365098 time 695982630900 state 0x2 ref 0 00000100:00100000:3.0:1789760757.766151:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565293056 00000100:00100000:3.0:1789760757.766163:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565293056 00000100:00100000:3.0:1789760757.766247:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 695997302724 time 696010728904 state 0x0 ref 1 00000100:00100000:3.0:1789760757.766267:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696010989320 time 696010728904 state 0x1 ref 1 00000100:00100000:3.0:1789760757.766305:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696010989320 time 696026597570 state 0x0 ref 1 00000100:00100000:3.0:1789760757.766320:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565293056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760757.766382:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66064384, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0x1f820 00010000:00010000:3.0:1789760757.766394:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.766415:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760757.766420:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.766427:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.766443:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760757.772132:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66064384 -> 66068480 00002000:00010000:3.0:1789760757.772138:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129056 -> 129064 00010000:00010000:3.0:1789760757.772155:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772169:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772180:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772188:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760757.772194:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772204:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772239:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.772248:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66064384->66068479] (req 66064384->66068479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.772417:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565293056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6093us (6462us total) trans 4294983437 rc 0/0 00000100:00100000:3.0:1789760757.772430:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16140 00000100:00100000:3.0:1789760757.772442:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696010989320 time 696026597570 state 0x2 ref 0 00000001:00080000:3.0:1789760757.978446:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983448 is committed 00000100:00080000:3.0:1789760758.013405:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760758.031749:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565294848 00000100:00100000:3.0:1789760758.031762:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565294848 00000100:00100000:3.0:1789760758.031839:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696243754182 time 696272388913 state 0x0 ref 1 00000100:00100000:3.0:1789760758.031858:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696272649329 time 696272388913 state 0x1 ref 1 00000100:00100000:3.0:1789760758.031897:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696272649329 time 696292188312 state 0x0 ref 1 00000100:00100000:3.0:1789760758.031911:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565294848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.031976:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66121728, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f890 00010000:00010000:3.0:1789760758.031987:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.032014:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.032020:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.032027:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.032044:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.042914:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66121728 -> 66125824 00002000:00010000:3.0:1789760758.042921:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129168 -> 129176 00010000:00010000:3.0:1789760758.042938:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.042954:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.042965:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.042975:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.042981:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.042991:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.043025:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.043034:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b879 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66121728->66125823] (req 66121728->66125823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.043157:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565294848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11242us (11568us total) trans 4294983451 rc 0/0 00000100:00100000:3.0:1789760758.043169:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16154 00000100:00100000:3.0:1789760758.043181:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696272649329 time 696292188312 state 0x2 ref 0 00000001:00080000:3.0:1789760758.072945:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983453 is committed 00000100:00100000:3.0:1789760758.079187:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565295232 00000100:00100000:3.0:1789760758.079200:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565295232 00000100:00100000:3.0:1789760758.079286:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696306741881 time 696323359464 state 0x0 ref 1 00000100:00100000:3.0:1789760758.079471:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696323619880 time 696323359464 state 0x1 ref 1 00000100:00100000:3.0:1789760758.079515:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696323619880 time 696339806131 state 0x0 ref 1 00000100:00100000:3.0:1789760758.079530:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565295232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.079593:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66134016, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f8a8 00010000:00010000:3.0:1789760758.079605:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.079630:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.079635:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.079642:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.079658:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.094686:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66134016 -> 66138112 00002000:00010000:3.0:1789760758.094702:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129192 -> 129200 00010000:00010000:3.0:1789760758.094738:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094754:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094765:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094774:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.094780:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094791:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094822:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.094831:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b88e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66134016->66138111] (req 66134016->66138111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.094975:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565295232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15442us (16284us total) trans 4294983454 rc 0/0 00000100:00100000:3.0:1789760758.094989:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16157 00000100:00100000:3.0:1789760758.095001:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696323619880 time 696339806131 state 0x2 ref 0 00000100:00100000:3.0:1789760758.151563:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565295616 00000100:00100000:3.0:1789760758.151577:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565295616 00000100:00100000:3.0:1789760758.151665:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696363351342 time 696388949604 state 0x0 ref 1 00000100:00100000:3.0:1789760758.151685:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696389210020 time 696388949604 state 0x1 ref 1 00000100:00100000:3.0:1789760758.151764:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696389210020 time 696412055084 state 0x0 ref 1 00000100:00100000:3.0:1789760758.151779:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565295616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.151844:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66146304, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f8c0 00010000:00010000:3.0:1789760758.151857:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b8a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.151891:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.151897:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.151905:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b8a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66146304->66150399] (req 66146304->66150399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.151921:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674b8a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66146304->66150399] (req 66146304->66150399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.214094:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66154496 -> 66158592 00002000:00010000:3.0:1789760758.214100:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129232 -> 129240 00010000:00010000:3.0:1789760758.214117:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214131:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214141:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214150:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.214156:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214167:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214191:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.214205:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674b8b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66154496->66158591] (req 66154496->66158591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.214391:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565295872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13656us (16058us total) trans 4294983459 rc 0/0 00000100:00100000:3.0:1789760758.214403:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16162 00000100:00100000:3.0:1789760758.214414:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696441171411 time 696460992089 state 0x2 ref 0 00000100:00100000:3.0:1789760758.252674:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.294276:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565296512 00000100:00100000:3.0:1789760758.294289:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565296512 00000100:00100000:3.0:1789760758.294365:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696513835012 time 696535345173 state 0x0 ref 1 00000100:00100000:3.0:1789760758.294383:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696535605589 time 696535345173 state 0x1 ref 1 00000100:00100000:3.0:1789760758.294428:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696535605589 time 696554719279 state 0x0 ref 1 00000100:00100000:3.0:1789760758.294442:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565296512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.294505:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66174976, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f8f8 00010000:00010000:3.0:1789760758.294517:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.294537:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.294542:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.294551:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.294569:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.304892:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66174976 -> 66179072 00002000:00010000:3.0:1789760758.304898:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129272 -> 129280 00010000:00010000:3.0:1789760758.304916:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.304931:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.304948:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.304957:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.304963:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.304974:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.305001:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.305010:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b8d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66174976->66179071] (req 66174976->66179071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.305133:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565296512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10685us (10961us total) trans 4294983464 rc 0/0 00000100:00100000:3.0:1789760758.305145:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16167 00000100:00100000:3.0:1789760758.305157:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696535605589 time 696554719279 state 0x2 ref 0 00000100:00100000:3.0:1789760758.310920:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565296640 00000100:00100000:3.0:1789760758.310933:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565296640 00000100:00100000:3.0:1789760758.311023:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696535605589 time 696554719279 state 0x0 ref 1 00000100:00100000:3.0:1789760758.311043:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696554979695 time 696554719279 state 0x1 ref 1 00000100:00100000:3.0:1789760758.311082:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696554979695 time 696571373188 state 0x0 ref 1 00000100:00100000:3.0:1789760758.311097:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565296640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.311167:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66179072, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f900 00010000:00010000:3.0:1789760758.311190:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.311211:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.311217:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.311232:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.311250:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.318286:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66179072 -> 66183168 00002000:00010000:3.0:1789760758.318293:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129280 -> 129288 00010000:00010000:3.0:1789760758.318314:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318329:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318338:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318346:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.318351:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318362:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318387:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.318396:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66179072->66183167] (req 66179072->66183167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.318580:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565296640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7478us (7803us total) trans 4294983465 rc 0/0 00000100:00100000:3.0:1789760758.318593:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16168 00000100:00100000:3.0:1789760758.318607:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696554979695 time 696571373188 state 0x2 ref 0 00000100:00100000:3.0:1789760758.337221:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565296896 00000100:00100000:3.0:1789760758.337234:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565296896 00000100:00100000:3.0:1789760758.337317:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696571633604 time 696586075617 state 0x0 ref 1 00000100:00100000:3.0:1789760758.337338:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696586336033 time 696586075617 state 0x1 ref 1 00000100:00100000:3.0:1789760758.337376:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696586336033 time 696597667161 state 0x0 ref 1 00000100:00100000:3.0:1789760758.337391:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565296896:12345-192.168.203.47@tcp:4:dd.0 00000100:00100000:3.0:1789760758.357752:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565297024 00000100:00100000:3.0:1789760758.357890:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565297024 00000100:00100000:3.0:1789760758.358097:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696586336033 time 696597667161 state 0x0 ref 1 00000100:00100000:3.0:1789760758.358117:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696597927577 time 696597667161 state 0x1 ref 1 00000100:00100000:3.0:1789760758.358168:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696597927577 time 696618459558 state 0x0 ref 1 00000100:00100000:3.0:1789760758.358183:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565297024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.358233:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66191360, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f918 00010000:00010000:3.0:1789760758.358242:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.358256:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.358261:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.358268:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.358282:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.368481:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66191360 -> 66195456 00002000:00010000:3.0:1789760758.368486:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129304 -> 129312 00010000:00010000:3.0:1789760758.368500:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368512:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368521:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368529:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.368534:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368543:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368564:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.368576:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b8f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66191360->66195455] (req 66191360->66195455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.368697:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565297024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10514us (11257us total) trans 4294983468 rc 0/0 00000100:00100000:3.0:1789760758.368777:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16171 00000100:00100000:3.0:1789760758.368787:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696597927577 time 696618459558 state 0x2 ref 0 00000100:00100000:3.0:1789760758.404379:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565297408 00000100:00100000:3.0:1789760758.404391:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565297408 00000100:00100000:3.0:1789760758.404470:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696640393924 time 696652069837 state 0x0 ref 1 00000100:00100000:3.0:1789760758.404492:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696652330253 time 696652069837 state 0x1 ref 1 00000100:00100000:3.0:1789760758.404528:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696652330253 time 696664819566 state 0x0 ref 1 00000100:00100000:3.0:1789760758.404542:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565297408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.404607:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66203648, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f930 00010000:00010000:3.0:1789760758.404619:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.404637:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.404643:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.404651:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.404674:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.410804:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66203648 -> 66207744 00002000:00010000:3.0:1789760758.410811:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129328 -> 129336 00010000:00010000:3.0:1789760758.410829:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410843:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410853:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410860:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.410866:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410887:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410913:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.410922:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66203648->66207743] (req 66203648->66207743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.411041:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565297408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6495us (6781us total) trans 4294983471 rc 0/0 00000100:00100000:3.0:1789760758.411054:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16174 00000100:00100000:3.0:1789760758.411065:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696652330253 time 696664819566 state 0x2 ref 0 00000100:00100000:3.0:1789760758.423113:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.445051:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565297664 00000100:00100000:3.0:1789760758.445066:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565297664 00000100:00100000:3.0:1789760758.445144:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696665079982 time 696683830554 state 0x0 ref 1 00000100:00100000:3.0:1789760758.445164:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696684090970 time 696683830554 state 0x1 ref 1 00000100:00100000:3.0:1789760758.445208:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696684090970 time 696705498899 state 0x0 ref 1 00000100:00100000:3.0:1789760758.445221:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565297664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.445282:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66211840, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f940 00010000:00010000:3.0:1789760758.445294:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.445312:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.445317:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.445325:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.445342:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.451902:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66211840 -> 66215936 00002000:00010000:3.0:1789760758.451909:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129344 -> 129352 00010000:00010000:3.0:1789760758.451927:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.451941:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.451952:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.451960:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.451965:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.451976:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.452000:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.452007:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66211840->66215935] (req 66211840->66215935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.452125:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565297664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6900us (7214us total) trans 4294983473 rc 0/0 00000100:00100000:3.0:1789760758.452137:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16176 00000100:00100000:3.0:1789760758.452149:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696684090970 time 696705498899 state 0x2 ref 0 00000100:00100000:3.0:1789760758.461378:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565297792 00000100:00100000:3.0:1789760758.461393:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565297792 00000100:00100000:3.0:1789760758.461471:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696684090970 time 696705498899 state 0x0 ref 1 00000100:00100000:3.0:1789760758.463104:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696705759315 time 696705498899 state 0x1 ref 1 00000100:00100000:3.0:1789760758.498163:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565298048 00000100:00100000:3.0:1789760758.498173:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565298048 00000100:00100000:3.0:1789760758.498237:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696724069562 time 696745903331 state 0x0 ref 1 00000100:00100000:3.0:1789760758.498253:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696746163747 time 696745903331 state 0x1 ref 1 00000100:00100000:3.0:1789760758.498283:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696746163747 time 696758575190 state 0x0 ref 1 00000100:00100000:3.0:1789760758.498296:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565298048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.498340:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66224128, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f958 00010000:00010000:3.0:1789760758.498348:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.498363:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.498368:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.498373:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.498392:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.503822:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66224128 -> 66228224 00002000:00010000:3.0:1789760758.503829:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129368 -> 129376 00010000:00010000:3.0:1789760758.503847:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503862:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503871:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503890:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.503897:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503906:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503931:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.503939:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66224128->66228223] (req 66224128->66228223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.504074:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565298048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5773us (6221us total) trans 4294983476 rc 0/0 00000100:00100000:3.0:1789760758.504086:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16179 00000100:00100000:3.0:1789760758.504099:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696746163747 time 696758575190 state 0x2 ref 0 00000100:00100000:3.0:1789760758.510059:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565298176 00000100:00100000:3.0:1789760758.510075:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565298176 00000100:00100000:3.0:1789760758.510154:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696746163747 time 696758575190 state 0x0 ref 1 00000100:00100000:3.0:1789760758.510174:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696758835606 time 696758575190 state 0x1 ref 1 00000100:00100000:3.0:1789760758.510211:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696758835606 time 696770502866 state 0x0 ref 1 00000100:00100000:3.0:1789760758.510239:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565298176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.510318:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66228224, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f960 00010000:00010000:3.0:1789760758.510333:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b92f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.510354:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.510359:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.510368:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66228224->66232319] (req 66228224->66232319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.510387:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66228224->66232319] (req 66228224->66232319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760758.521274:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983477 is committed 00000001:00080000:3.0:1789760758.534341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983478 is committed 00000100:00100000:3.0:1789760758.541574:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565298432 00000100:00100000:3.0:1789760758.541584:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565298432 00000100:00100000:3.0:1789760758.542321:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696770763282 time 696787478003 state 0x0 ref 1 00000100:00100000:3.0:1789760758.542341:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696787738419 time 696787478003 state 0x1 ref 1 00000100:00100000:3.0:1789760758.542542:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696787738419 time 696802824964 state 0x0 ref 1 00000100:00100000:3.0:1789760758.542560:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565298432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.542609:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66236416, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f970 00010000:00010000:3.0:1789760758.542619:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.542634:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.542639:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.542645:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.542660:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.550376:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66236416 -> 66240512 00002000:00010000:3.0:1789760758.550382:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129392 -> 129400 00010000:00010000:3.0:1789760758.550396:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550409:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550418:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550427:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.550432:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550442:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550462:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.550469:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b93d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66236416->66240511] (req 66236416->66240511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.550562:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565298432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8003us (9312us total) trans 4294983479 rc 0/0 00000100:00100000:3.0:1789760758.550572:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16182 00000100:00100000:3.0:1789760758.550582:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696787738419 time 696802824964 state 0x2 ref 0 00000001:00080000:3.0:1789760758.560070:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983480 is committed 00000001:00080000:3.0:1789760758.569757:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983481 is committed 00000100:00100000:3.0:1789760758.574062:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565298816 00000100:00100000:3.0:1789760758.574072:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565298816 00000100:00100000:3.0:1789760758.574126:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696815591745 time 696824561641 state 0x0 ref 1 00000100:00100000:3.0:1789760758.574140:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696824822057 time 696824561641 state 0x1 ref 1 00000100:00100000:3.0:1789760758.574169:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696824822057 time 696834460572 state 0x0 ref 1 00000100:00100000:3.0:1789760758.574180:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565298816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.574225:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66248704, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f988 00010000:00010000:3.0:1789760758.574239:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.574254:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.574258:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.574264:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.574277:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.579071:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66248704 -> 66252800 00002000:00010000:3.0:1789760758.579076:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129416 -> 129424 00010000:00010000:3.0:1789760758.579090:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579103:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579113:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579121:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.579126:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579135:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579154:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.579162:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66248704->66252799] (req 66248704->66252799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.579327:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565298816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5144us (5354us total) trans 4294983482 rc 0/0 00000100:00100000:3.0:1789760758.579337:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16185 00000100:00100000:3.0:1789760758.579346:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696824822057 time 696834460572 state 0x2 ref 0 00000100:00100000:3.0:1789760758.611366:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565299200 00000100:00100000:3.0:1789760758.611377:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565299200 00000100:00100000:3.0:1789760758.611431:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696847329639 time 696861840811 state 0x0 ref 1 00000100:00100000:3.0:1789760758.611457:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696862101227 time 696861840811 state 0x1 ref 1 00000100:00100000:3.0:1789760758.611525:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696862101227 time 696871816297 state 0x0 ref 1 00000100:00100000:3.0:1789760758.611540:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565299200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.611586:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66260992, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f9a0 00010000:00010000:3.0:1789760758.611595:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.611611:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=696s v=(0 0) 00010000:00010000:3.0:1789760758.611616:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.611622:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66260992->66265087] (req 66260992->66265087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.611635:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66260992->66265087] (req 66260992->66265087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760758.620098:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983485 is committed 00000001:00080000:3.0:1789760758.636216:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983486 is committed 00000001:00080000:3.0:1789760758.650630:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983487 is committed 00000001:00080000:3.0:1789760758.667118:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983488 is committed 00000001:00080000:3.0:1789760758.683741:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983489 is committed 00000001:00080000:3.0:1789760758.693198:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983490 is committed 00000001:00080000:3.0:1789760758.710061:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983491 is committed 00000100:00100000:3.0:1789760758.746952:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.764925:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565300480 00000100:00100000:3.0:1789760758.764934:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565300480 00000100:00100000:3.0:1789760758.764987:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 696992566433 time 697007549451 state 0x0 ref 1 00000100:00100000:3.0:1789760758.765001:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697007809867 time 697007549451 state 0x1 ref 1 00000100:00100000:3.0:1789760758.765033:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697007809867 time 697025325055 state 0x0 ref 1 00000100:00100000:3.0:1789760758.765046:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565300480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.765092:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66301952, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1f9f0 00010000:00010000:3.0:1789760758.765102:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b9ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.765116:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760758.765121:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.765127:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b9ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66301952->66306047] (req 66301952->66306047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.765141:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674b9ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66301952->66306047] (req 66301952->66306047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760758.769189:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983495 is committed 00000001:00080000:3.0:1789760758.777989:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983496 is committed 00000100:00100000:3.0:1789760758.820591:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.832115:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565301120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10968us (11522us total) trans 4294983500 rc 0/0 00000100:00100000:3.0:1789760758.832129:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16203 00000100:00100000:3.0:1789760758.832139:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697070023366 time 697081419305 state 0x2 ref 0 00002000:00010000:3.0:1789760758.869333:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66330624, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1fa28 00010000:00010000:3.0:1789760758.869386:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.869404:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760758.869409:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.869416:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.869527:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.876234:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66330624 -> 66334720 00002000:00010000:3.0:1789760758.876240:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129576 -> 129584 00010000:00010000:3.0:1789760758.876254:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876267:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876277:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876285:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.876290:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876300:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876321:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.876328:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674b9de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66330624->66334719] (req 66330624->66334719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.876586:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565301376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7916us (8206us total) trans 4294983502 rc 0/0 00000100:00100000:3.0:1789760758.876596:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16205 00000100:00100000:3.0:1789760758.876604:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697098194338 time 697128945225 state 0x2 ref 0 00000100:00100000:3.0:1789760758.883101:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.914031:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760758.929413:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565301888 00000100:00100000:3.0:1789760758.929422:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565301888 00000100:00100000:3.0:1789760758.929470:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697163360560 time 697174649254 state 0x0 ref 1 00000100:00100000:3.0:1789760758.929484:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697174909670 time 697174649254 state 0x1 ref 1 00000100:00100000:3.0:1789760758.929513:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697174909670 time 697189805080 state 0x0 ref 1 00000100:00100000:3.0:1789760758.929524:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565301888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.929572:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66347008, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0x1fa48 00010000:00010000:3.0:1789760758.929581:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.929597:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760758.929601:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.929607:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66347008->66351103] (req 66347008->66351103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.929621:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674b9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66347008->66351103] (req 66347008->66351103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.953778:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66355200 -> 66359296 00002000:00010000:3.0:1789760758.953783:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129624 -> 129632 00010000:00010000:3.0:1789760758.953796:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.954942:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.954960:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.954968:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.954973:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.954989:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.955009:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.955018:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ba08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66355200->66359295] (req 66355200->66359295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.955115:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565302144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6468us (6658us total) trans 4294983508 rc 0/0 00000100:00100000:3.0:1789760758.955132:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16211 00000100:00100000:3.0:1789760758.955141:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697201632911 time 697208925041 state 0x2 ref 0 00000100:00100000:3.0:1789760758.992191:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565302528 00000100:00100000:3.0:1789760758.992200:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565302528 00000100:00100000:3.0:1789760758.992252:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697221689816 time 697232300643 state 0x0 ref 1 00000100:00100000:3.0:1789760758.992266:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697232561059 time 697232300643 state 0x1 ref 1 00000100:00100000:3.0:1789760758.992300:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697232561059 time 697252591847 state 0x0 ref 1 00000100:00100000:3.0:1789760758.992313:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565302528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760758.992358:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66367488, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1fa70 00010000:00010000:3.0:1789760758.992368:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.992384:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760758.992388:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.992394:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.992407:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.997471:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66367488 -> 66371584 00002000:00010000:3.0:1789760758.997476:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129648 -> 129656 00010000:00010000:3.0:1789760758.997489:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997502:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997511:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997520:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760758.997524:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997531:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997556:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.997565:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66367488->66371583] (req 66367488->66371583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.997748:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565302528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5389us (5595us total) trans 4294983511 rc 0/0 00000100:00100000:3.0:1789760758.997759:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16214 00000100:00100000:3.0:1789760758.997768:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697232561059 time 697252591847 state 0x2 ref 0 00000100:00100000:3.0:1789760759.025843:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565302912 00000100:00100000:3.0:1789760759.025853:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565302912 00000100:00100000:3.0:1789760759.025917:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697264149622 time 697273829123 state 0x0 ref 1 00000100:00100000:3.0:1789760759.025932:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697274089539 time 697273829123 state 0x1 ref 1 00000100:00100000:3.0:1789760759.026012:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697274089539 time 697286302745 state 0x0 ref 1 00000100:00100000:3.0:1789760759.026026:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565302912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760759.026085:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66379776, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1fa88 00010000:00010000:3.0:1789760759.026094:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.026118:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760759.026124:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.026129:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.026143:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760759.036258:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66379776 -> 66383872 00002000:00010000:3.0:1789760759.036263:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129672 -> 129680 00010000:00010000:3.0:1789760759.036278:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036291:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036300:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036308:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760759.036312:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036320:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036339:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.036351:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66379776->66383871] (req 66379776->66383871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760759.036459:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565302912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10414us (10909us total) trans 4294983514 rc 0/0 00000100:00100000:3.0:1789760759.036470:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16217 00000100:00100000:3.0:1789760759.036479:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697274089539 time 697286302745 state 0x2 ref 0 00000001:00080000:3.0:1789760759.076764:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983516 is committed 00000100:00100000:3.0:1789760759.086311:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565303296 00000100:00100000:3.0:1789760759.086323:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565303296 00000100:00100000:3.0:1789760759.086374:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697310626723 time 697327307298 state 0x0 ref 1 00000100:00100000:3.0:1789760759.086515:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697327567714 time 697327307298 state 0x1 ref 1 00000100:00100000:3.0:1789760759.086584:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697327567714 time 697346874735 state 0x0 ref 1 00000100:00100000:3.0:1789760759.086597:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565303296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760759.086660:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66392064, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1faa0 00010000:00010000:3.0:1789760759.086669:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.086683:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760759.086687:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.086692:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.086728:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760759.103715:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66392064 -> 66396160 00002000:00010000:3.0:1789760759.103725:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129696 -> 129704 00010000:00010000:3.0:1789760759.103740:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103753:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103763:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103771:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760759.103776:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103785:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103805:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.103813:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66392064->66396159] (req 66392064->66396159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760759.104461:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565303296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17860us (19161us total) trans 4294983517 rc 0/0 00000100:00100000:3.0:1789760759.104472:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16220 00000100:00100000:3.0:1789760759.104480:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697327567714 time 697346874735 state 0x2 ref 0 00000001:00080000:3.0:1789760759.139842:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983519 is committed 00000100:00100000:3.0:1789760759.146345:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565303680 00000100:00100000:3.0:1789760759.146357:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565303680 00000100:00100000:3.0:1789760759.146418:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697378493455 time 697392965130 state 0x0 ref 1 00000100:00100000:3.0:1789760759.146435:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697393225546 time 697392965130 state 0x1 ref 1 00000100:00100000:3.0:1789760759.146469:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697393225546 time 697406760456 state 0x0 ref 1 00000100:00100000:3.0:1789760759.146482:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565303680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760759.146532:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66404352, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1fab8 00010000:00010000:3.0:1789760759.146542:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.146559:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760759.146563:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.146569:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66404352->66408447] (req 66404352->66408447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.146583:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674ba5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66404352->66408447] (req 66404352->66408447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760759.167674:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983521 is committed 00000001:00080000:3.0:1789760759.177118:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983522 is committed 00000001:00080000:3.0:1789760759.191528:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983523 is committed 00000001:00080000:3.0:1789760759.210762:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983524 is committed 00000001:00080000:3.0:1789760759.230044:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983525 is committed 00000001:00080000:3.0:1789760759.244948:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983526 is committed 00000001:00080000:3.0:1789760759.263632:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983527 is committed 00000001:00080000:3.0:1789760759.373520:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983534 is committed 00000001:00080000:3.0:1789760759.398391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983536 is committed 00000100:00100000:3.0:1789760759.440553:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565306112 00000100:00100000:3.0:1789760759.440563:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565306112 00000100:00100000:3.0:1789760759.440622:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697669166410 time 697686785457 state 0x0 ref 1 00000100:00100000:3.0:1789760759.440637:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697687045873 time 697686785457 state 0x1 ref 1 00000100:00100000:3.0:1789760759.440669:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697687045873 time 697700961391 state 0x0 ref 1 00000100:00100000:3.0:1789760759.440682:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565306112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760759.440761:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66482176, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1fb50 00010000:00010000:3.0:1789760759.440771:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.440787:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760759.440791:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.440798:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66482176->66486271] (req 66482176->66486271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.440827:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66482176->66486271] (req 66482176->66486271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760759.476685:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983541 is committed 00000001:00080000:3.0:1789760759.491648:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983542 is committed 00000001:00080000:3.0:1789760759.504512:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983543 is committed 00000001:00080000:3.0:1789760759.515088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983544 is committed 00000100:00100000:3.0:1789760759.564220:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:769fd61a-9f51-46fc-af80-467e2ca172bc:3458:1876699580062208:0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564253:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760759.564276:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3458:1876699580062720:0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564296:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760759.564315:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760759.564321:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3458:1876699580062336:0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564341:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760759.564356:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580062848:0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564373:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760759.564436:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580062208 00000100:00100000:3.0:1789760759.564439:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580062208 00000100:00100000:3.0:1789760759.564476:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789760759.564482:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3458:x1876699580062208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564505:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3458:x1876699580062208:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760759.564511:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789760759.564539:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580062848 00000100:00100000:3.0:1789760759.564543:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580062848 00000100:00100000:3.0:1789760759.564570:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789760759.564576:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580062848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760759.564602:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580062848:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760759.564607:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789760759.578128:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 697828757180 time 697838417377 state 0x0 ref 1 00000100:00100000:3.0:1789760759.578144:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565307648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760759.578191:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66531328, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0x1fbb0 00010000:00010000:3.0:1789760759.578200:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.578501:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1789760759.578507:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.578513:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.578527:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760759.583653:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66531328 -> 66535424 00002000:00010000:3.0:1789760759.583658:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129968 -> 129976 00010000:00010000:3.0:1789760759.583671:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583682:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583689:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583696:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760759.583700:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583744:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583763:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.583772:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bb35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66531328->66535423] (req 66531328->66535423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760759.777085:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983565 is committed 00000001:00080000:3.0:1789760759.811457:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983567 is committed 00000001:00080000:3.0:1789760759.823334:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983568 is committed 00000001:00080000:3.0:1789760759.842175:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983569 is committed 00000001:00080000:3.0:1789760759.887827:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983571 is committed 00000001:00080000:3.0:1789760759.903510:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983572 is committed 00000001:00080000:3.0:1789760759.913669:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983573 is committed 00000001:00080000:3.0:1789760759.930140:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983574 is committed 00000001:00080000:3.0:1789760759.997736:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983578 is committed 00000100:00100000:3.0:1789760760.105123:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.122094:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.150268:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.163457:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.189383:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.299512:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 698545881411 time 698559791955 state 0x0 ref 1 00000001:00080000:3.0:1789760760.402084:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983603 is committed 00000001:00080000:3.0:1789760760.411646:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983604 is committed 00000001:00080000:3.0:1789760760.425201:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983605 is committed 00000001:00080000:3.0:1789760760.437217:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983606 is committed 00000001:00080000:3.0:1789760760.459466:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983608 is committed 00000001:00080000:3.0:1789760760.468601:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983609 is committed 00000100:00100000:3.0:1789760760.502847:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.516478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983613 is committed 00000001:00080000:3.0:1789760760.531309:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983614 is committed 00000100:00100000:3.0:1789760760.538199:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.543559:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983615 is committed 00000001:00080000:3.0:1789760760.562144:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983616 is committed 00000100:00100000:3.0:1789760760.571473:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.605682:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983619 is committed 00000100:00100000:3.0:1789760760.611150:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.650987:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.689611:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.729589:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.788656:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.797012:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983632 is committed 00000100:00100000:3.0:1789760760.820196:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.837061:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.844498:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983635 is committed 00000100:00100000:3.0:1789760760.854888:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760760.862263:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983636 is committed 00000100:00100000:3.0:1789760760.866673:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.884870:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.895819:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760760.936465:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565319168 00000100:00100000:3.0:1789760760.936475:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565319168 00000100:00100000:3.0:1789760760.936525:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699156888841 time 699183870778 state 0x0 ref 1 00000100:00100000:3.0:1789760760.936540:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699184131194 time 699183870778 state 0x1 ref 1 00000100:00100000:3.0:1789760760.936570:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699184131194 time 699196862166 state 0x0 ref 1 00000100:00100000:3.0:1789760760.936581:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565319168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760760.936625:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66899968, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0x1fe80 00010000:00010000:3.0:1789760760.936635:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bdab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.936650:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760760.936654:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760760.936661:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bdab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66899968->66904063] (req 66899968->66904063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.936675:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bdab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66899968->66904063] (req 66899968->66904063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760760.948359:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983641 is committed 00000001:00080000:3.0:1789760760.968622:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983642 is committed 00000001:00080000:3.0:1789760760.984975:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983643 is committed 00000100:00100000:3.0:1789760760.989389:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565319552 00000100:00100000:3.0:1789760760.989398:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565319552 00000100:00100000:3.0:1789760760.989461:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699223658911 time 699233753386 state 0x0 ref 1 00000100:00100000:3.0:1789760760.989477:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699234013802 time 699233753386 state 0x1 ref 1 00000100:00100000:3.0:1789760760.989506:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699234013802 time 699249797858 state 0x0 ref 1 00000100:00100000:3.0:1789760760.989518:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565319552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760760.989563:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66912256, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1fe98 00010000:00010000:3.0:1789760760.989573:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bdc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.989586:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760760.989591:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760760.989596:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bdc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66912256->66916351] (req 66912256->66916351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.989611:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bdc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66912256->66916351] (req 66912256->66916351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760761.000407:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983644 is committed 00000100:00100000:3.0:1789760761.042137:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.095016:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.110816:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.133593:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565320576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5793us (6072us total) trans 4294983652 rc 0/0 00000100:00100000:3.0:1789760761.133604:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16355 00000100:00100000:3.0:1789760761.133613:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699371830234 time 699388075351 state 0x2 ref 0 00000100:00100000:3.0:1789760761.137411:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.146463:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983653 is committed 00000001:00080000:3.0:1789760761.163281:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983654 is committed 00000100:00100000:3.0:1789760761.167014:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565320960 00000100:00100000:3.0:1789760761.167024:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565320960 00000100:00100000:3.0:1789760761.167075:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699398196429 time 699418189158 state 0x0 ref 1 00000100:00100000:3.0:1789760761.167090:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699418449574 time 699418189158 state 0x1 ref 1 00000100:00100000:3.0:1789760761.167147:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699418449574 time 699427439187 state 0x0 ref 1 00000100:00100000:3.0:1789760761.167159:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565320960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.167210:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66957312, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1fef0 00010000:00010000:3.0:1789760761.167219:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.167241:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.167253:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.167261:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66957312->66961407] (req 66957312->66961407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.167276:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66957312->66961407] (req 66957312->66961407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760761.171921:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983655 is committed 00000100:00100000:3.0:1789760761.177215:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.184902:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983656 is committed 00000100:00100000:3.0:1789760761.208331:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565321344 00000100:00100000:3.0:1789760761.208340:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565321344 00000100:00100000:3.0:1789760761.208390:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699438198558 time 699454916803 state 0x0 ref 1 00000100:00100000:3.0:1789760761.208415:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699455177219 time 699454916803 state 0x1 ref 1 00000100:00100000:3.0:1789760761.208445:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699455177219 time 699468737204 state 0x0 ref 1 00000100:00100000:3.0:1789760761.208457:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565321344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.208499:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66969600, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ff08 00010000:00010000:3.0:1789760761.208765:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.208781:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.208785:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.208796:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66969600->66973695] (req 66969600->66973695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.208811:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674be22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66969600->66973695] (req 66969600->66973695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760761.219057:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983658 is committed 00000100:00100000:3.0:1789760761.234603:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.241165:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.241229:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.241257:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.241293:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565321728 00000100:00100000:3.0:1789760761.241303:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565321728 00000100:00100000:3.0:1789760761.241360:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565321856 00000100:00100000:3.0:1789760761.241364:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565321856 00000100:00100000:3.0:1789760761.241392:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 447 00000100:00100000:3.0:1789760761.241400:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565321728:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1789760761.241464:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565321728:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.241471:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 447 00000100:00100000:3.0:1789760761.241486:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 448 00000100:00100000:3.0:1789760761.241492:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565321856:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1789760761.241510:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565321856:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.241516:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 448 00000100:00080000:3.0:1789760761.241532:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760761.250562:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983659 is committed 00000100:00100000:3.0:1789760761.254685:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.263362:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983660 is committed 00000100:00100000:3.0:1789760761.270375:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.278815:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983661 is committed 00000100:00100000:3.0:1789760761.508199:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.521394:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565323904 00000100:00100000:3.0:1789760761.521404:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565323904 00000100:00100000:3.0:1789760761.521457:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699753668012 time 699768699197 state 0x0 ref 1 00000100:00100000:3.0:1789760761.521472:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699768959613 time 699768699197 state 0x1 ref 1 00000100:00100000:3.0:1789760761.521503:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699768959613 time 699781795149 state 0x0 ref 1 00000100:00100000:3.0:1789760761.521515:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565323904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.521567:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67039232, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ff90 00010000:00010000:3.0:1789760761.521577:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.521593:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.521597:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.521603:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.521619:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.527337:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67039232 -> 67043328 00002000:00010000:3.0:1789760761.527345:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 130960 -> 130968 00010000:00010000:3.0:1789760761.527357:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527370:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527383:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527390:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.527395:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527403:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527423:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.527431:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674be99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67039232->67043327] (req 67039232->67043327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.529379:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565323904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7852us (8175us total) trans 4294983675 rc 0/0 00000100:00100000:3.0:1789760761.529394:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16378 00000100:00100000:3.0:1789760761.529404:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699768959613 time 699781795149 state 0x2 ref 0 00002000:00010000:3.0:1789760761.539759:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67043328 -> 67047424 00002000:00010000:3.0:1789760761.539764:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 130968 -> 130976 00010000:00010000:3.0:1789760761.539778:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539805:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539815:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539821:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.539826:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539833:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539861:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.539870:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674bea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67043328->67047423] (req 67043328->67047423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.539972:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565324032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5813us (6301us total) trans 4294983676 rc 0/0 00000100:00100000:3.0:1789760761.539983:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16379 00000100:00100000:3.0:1789760761.539994:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699782055565 time 699794432359 state 0x2 ref 0 00000001:00080000:3.0:1789760761.551056:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983677 is committed 00000100:00100000:3.0:1789760761.559530:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565324288 00000100:00100000:3.0:1789760761.559539:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565324288 00000100:00100000:3.0:1789760761.559591:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699794692775 time 699804920135 state 0x0 ref 1 00000100:00100000:3.0:1789760761.559605:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699805180551 time 699804920135 state 0x1 ref 1 00000100:00100000:3.0:1789760761.559643:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699805180551 time 699819934493 state 0x0 ref 1 00000100:00100000:3.0:1789760761.559657:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565324288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.559751:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67051520, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ffa8 00010000:00010000:3.0:1789760761.559762:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674beae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.559781:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.559786:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.559794:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674beae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67051520->67055615] (req 67051520->67055615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.559809:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674beae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67051520->67055615] (req 67051520->67055615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760761.573819:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983678 is committed 00000100:00100000:3.0:1789760761.581732:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565324416 00000100:00100000:3.0:1789760761.581741:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565324416 00000100:00100000:3.0:1789760761.581791:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699805180551 time 699819934493 state 0x0 ref 1 00000100:00100000:3.0:1789760761.581807:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699820194909 time 699819934493 state 0x1 ref 1 00000100:00100000:3.0:1789760761.581839:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699820194909 time 699842131060 state 0x0 ref 1 00000100:00100000:3.0:1789760761.581850:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565324416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.581907:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67055616, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ffb0 00010000:00010000:3.0:1789760761.581917:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.581932:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.581935:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.581941:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.581954:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.591142:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67055616 -> 67059712 00002000:00010000:3.0:1789760761.591147:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 130992 -> 131000 00010000:00010000:3.0:1789760761.591161:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591173:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591183:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591195:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.591200:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591208:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591240:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.591249:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674beb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67055616->67059711] (req 67055616->67059711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.591339:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565324416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9486us (9966us total) trans 4294983679 rc 0/0 00000100:00100000:3.0:1789760761.591349:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16382 00000100:00100000:3.0:1789760761.591358:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699820194909 time 699842131060 state 0x2 ref 0 00000100:00100000:3.0:1789760761.646841:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565324800 00000100:00100000:3.0:1789760761.646865:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565324800 00000100:00100000:3.0:1789760761.646931:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699863643810 time 699889365220 state 0x0 ref 1 00000100:00100000:3.0:1789760761.646947:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699889625636 time 699889365220 state 0x1 ref 1 00000100:00100000:3.0:1789760761.646977:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699889625636 time 699907269222 state 0x0 ref 1 00000100:00100000:3.0:1789760761.646994:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565324800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.647041:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67067904, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ffc8 00010000:00010000:3.0:1789760761.647050:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.647065:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.647069:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.647077:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.647091:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.654884:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67067904 -> 67072000 00002000:00010000:3.0:1789760761.654889:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131016 -> 131024 00010000:00010000:3.0:1789760761.654903:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654916:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654925:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654932:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.654938:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654947:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654965:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.654974:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674beca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67067904->67071999] (req 67067904->67071999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.655116:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565324800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8120us (9018us total) trans 4294983682 rc 0/0 00000100:00100000:3.0:1789760761.655135:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16385 00000100:00100000:3.0:1789760761.655143:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699889625636 time 699907269222 state 0x2 ref 0 00000100:00100000:3.0:1789760761.664889:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.691746:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983684 is committed 00000100:00100000:3.0:1789760761.697586:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565325184 00000100:00100000:3.0:1789760761.697595:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565325184 00000100:00100000:3.0:1789760761.697647:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699925722048 time 699942453884 state 0x0 ref 1 00000100:00100000:3.0:1789760761.697661:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699942714300 time 699942453884 state 0x1 ref 1 00000100:00100000:3.0:1789760761.697752:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699942714300 time 699958044216 state 0x0 ref 1 00000100:00100000:3.0:1789760761.697765:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565325184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.697823:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67080192, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1ffe0 00010000:00010000:3.0:1789760761.697833:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.697846:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=699s v=(0 0) 00010000:00010000:3.0:1789760761.697859:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.697865:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.697883:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.708270:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67080192 -> 67084288 00002000:00010000:3.0:1789760761.708276:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131040 -> 131048 00010000:00010000:3.0:1789760761.708289:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708302:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708310:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708317:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.708322:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708337:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708362:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.708371:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bedf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67080192->67084287] (req 67080192->67084287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.708650:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565325184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10882us (11206us total) trans 4294983685 rc 0/0 00000100:00100000:3.0:1789760761.708662:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16388 00000100:00100000:3.0:1789760761.708672:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699942714300 time 699958044216 state 0x2 ref 0 00000100:00100000:3.0:1789760761.718101:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.725046:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983686 is committed 00000100:00100000:3.0:1789760761.750209:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565325568 00000100:00100000:3.0:1789760761.750218:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565325568 00000100:00100000:3.0:1789760761.750292:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699978906688 time 699991775575 state 0x0 ref 1 00000100:00100000:3.0:1789760761.750307:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699992035991 time 699991775575 state 0x1 ref 1 00000100:00100000:3.0:1789760761.750343:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699992035991 time 700010635305 state 0x0 ref 1 00000100:00100000:3.0:1789760761.750355:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565325568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.750669:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67092480, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x1fff8 00010000:00010000:3.0:1789760761.750678:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.750694:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760761.750699:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.750729:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.750744:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.758417:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67092480 -> 67096576 00002000:00010000:3.0:1789760761.758423:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131064 -> 131072 00010000:00010000:3.0:1789760761.758436:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758449:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758458:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758466:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.758471:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758485:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758504:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.758511:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67092480->67096575] (req 67092480->67096575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.758607:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565325568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8249us (8482us total) trans 4294983688 rc 0/0 00000100:00100000:3.0:1789760761.758618:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16391 00000100:00100000:3.0:1789760761.758626:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 699992035991 time 700010635305 state 0x2 ref 0 00000100:00100000:3.0:1789760761.764055:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.804395:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565325952 00000100:00100000:3.0:1789760761.804484:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565325952 00000100:00100000:3.0:1789760761.804539:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700027590891 time 700051051966 state 0x0 ref 1 00000100:00100000:3.0:1789760761.804554:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700051312382 time 700051051966 state 0x1 ref 1 00000100:00100000:3.0:1789760761.804585:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700051312382 time 700064876332 state 0x0 ref 1 00000100:00100000:3.0:1789760761.804597:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565325952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.804641:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67104768, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x20010 00010000:00010000:3.0:1789760761.804651:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.804667:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760761.804671:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.804677:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.804689:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.813252:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67104768 -> 67108864 00002000:00010000:3.0:1789760761.813257:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131088 -> 131096 00010000:00010000:3.0:1789760761.813270:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813282:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813290:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813297:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.813302:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813314:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813334:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.813341:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67104768->67108863] (req 67104768->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.813440:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565325952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8841us (9471us total) trans 4294983691 rc 0/0 00000100:00100000:3.0:1789760761.813451:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16394 00000100:00100000:3.0:1789760761.813460:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700051312382 time 700064876332 state 0x2 ref 0 00000100:00100000:3.0:1789760761.843127:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565326336 00000100:00100000:3.0:1789760761.843135:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565326336 00000100:00100000:3.0:1789760761.843190:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700079145834 time 700089626772 state 0x0 ref 1 00000100:00100000:3.0:1789760761.843208:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700089887188 time 700089626772 state 0x1 ref 1 00000100:00100000:3.0:1789760761.843232:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700089887188 time 700103523952 state 0x0 ref 1 00000100:00100000:3.0:1789760761.843244:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565326336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760761.843294:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67117056, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0x20028 00010000:00010000:3.0:1789760761.843304:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.843321:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760761.843326:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.843331:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.843344:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760761.849396:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67117056 -> 67121152 00002000:00010000:3.0:1789760761.849402:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131112 -> 131120 00010000:00010000:3.0:1789760761.849415:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849428:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849437:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849445:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760761.849449:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849459:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849479:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.849493:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67117056->67121151] (req 67117056->67121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.849586:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565326336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6339us (6553us total) trans 4294983694 rc 0/0 00000100:00100000:3.0:1789760761.849597:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16397 00000100:00100000:3.0:1789760761.849606:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700089887188 time 700103523952 state 0x2 ref 0 00000100:00100000:3.0:1789760761.856957:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760761.880679:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565326720 00000100:00100000:3.0:1789760761.880688:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565326720 00000100:00100000:3.0:1789760761.901444:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760761.951983:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983700 is committed 00000001:00080000:3.0:1789760761.976101:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983701 is committed 00000001:00080000:3.0:1789760761.997631:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983702 is committed 00000100:00100000:3.0:1789760762.004141:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565327360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16785us (17354us total) trans 4294983702 rc 0/0 00000100:00100000:3.0:1789760762.004157:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16405 00000100:00100000:3.0:1789760762.004168:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700227690474 time 700247625274 state 0x2 ref 0 00000100:00100000:3.0:1789760762.012807:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760762.015572:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760762.019913:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983703 is committed 00000001:00080000:3.0:1789760762.039187:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983704 is committed 00000100:00100000:3.0:1789760762.058035:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565327744 00000100:00100000:3.0:1789760762.058060:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565327744 00000100:00100000:3.0:1789760762.058157:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700274822606 time 700292389189 state 0x0 ref 1 00000100:00100000:3.0:1789760762.058177:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700292649605 time 700292389189 state 0x1 ref 1 00000100:00100000:3.0:1789760762.058695:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700292649605 time 700318980401 state 0x0 ref 1 00000100:00100000:3.0:1789760762.058915:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565327744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.058987:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67162112, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x20080 00010000:00010000:3.0:1789760762.058998:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.059019:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.059024:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.059033:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67162112->67166207] (req 67162112->67166207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.059049:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674bf6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67162112->67166207] (req 67162112->67166207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.094302:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67166208 -> 67170304 00002000:00010000:3.0:1789760762.094314:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131208 -> 131216 00010000:00010000:3.0:1789760762.094335:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094351:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094367:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094376:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.094381:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094392:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094418:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.094426:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674bf72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67166208->67170303] (req 67166208->67170303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.094609:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565327872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14332us (14666us total) trans 4294983706 rc 0/0 00000100:00100000:3.0:1789760762.094622:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16409 00000100:00100000:3.0:1789760762.094634:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700319240817 time 700340544023 state 0x2 ref 0 00000100:00100000:3.0:1789760762.130359:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565328128 00000100:00100000:3.0:1789760762.130369:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565328128 00000100:00100000:3.0:1789760762.130423:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700340804439 time 700367288579 state 0x0 ref 1 00000100:00100000:3.0:1789760762.130439:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700367548995 time 700367288579 state 0x1 ref 1 00000100:00100000:3.0:1789760762.130473:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700367548995 time 700390765111 state 0x0 ref 1 00000100:00100000:3.0:1789760762.130487:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565328128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.130534:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67174400, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x20098 00010000:00010000:3.0:1789760762.130544:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.130560:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.130564:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.130570:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.130584:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.150463:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67174400 -> 67178496 00002000:00010000:3.0:1789760762.150470:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131224 -> 131232 00010000:00010000:3.0:1789760762.150483:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150496:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150580:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150594:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.150599:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150608:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150629:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.150637:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67174400->67178495] (req 67174400->67178495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.151017:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565328128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 20528us (20769us total) trans 4294983708 rc 0/0 00000100:00100000:3.0:1789760762.151029:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16411 00000100:00100000:3.0:1789760762.151038:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700367548995 time 700390765111 state 0x2 ref 0 00000100:00100000:3.0:1789760762.154258:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565328256 00000100:00100000:3.0:1789760762.154267:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565328256 00000100:00100000:3.0:1789760762.154322:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700367548995 time 700390765111 state 0x0 ref 1 00000100:00100000:3.0:1789760762.154338:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700391025527 time 700390765111 state 0x1 ref 1 00000100:00100000:3.0:1789760762.154369:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700391025527 time 700414660918 state 0x0 ref 1 00000100:00100000:3.0:1789760762.154385:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565328256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.154431:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67178496, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x200a0 00010000:00010000:3.0:1789760762.154441:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.154458:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.154462:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.154469:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.154483:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.168079:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67178496 -> 67182592 00002000:00010000:3.0:1789760762.168086:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131232 -> 131240 00010000:00010000:3.0:1789760762.168100:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168113:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168122:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168130:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.168135:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168144:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168163:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.168182:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67178496->67182591] (req 67178496->67182591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.168274:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565328256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13887us (14157us total) trans 4294983709 rc 0/0 00000100:00100000:3.0:1789760762.168283:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16412 00000100:00100000:3.0:1789760762.168292:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700391025527 time 700414660918 state 0x2 ref 0 00000100:00100000:3.0:1789760762.198869:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565328512 00000100:00100000:3.0:1789760762.198882:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565328512 00000100:00100000:3.0:1789760762.198957:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700414921334 time 700436490730 state 0x0 ref 1 00000100:00100000:3.0:1789760762.198977:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700436751146 time 700436490730 state 0x1 ref 1 00000100:00100000:3.0:1789760762.199014:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700436751146 time 700459305257 state 0x0 ref 1 00000100:00100000:3.0:1789760762.199028:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565328512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.199093:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67186688, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x200b0 00010000:00010000:3.0:1789760762.199105:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.199125:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.199130:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.199139:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.199155:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.212008:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67186688 -> 67190784 00002000:00010000:3.0:1789760762.212018:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131248 -> 131256 00010000:00010000:3.0:1789760762.212037:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212065:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212075:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212084:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.212089:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212099:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212124:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.212132:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bf95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67186688->67190783] (req 67186688->67190783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.212264:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565328512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13229us (13553us total) trans 4294983711 rc 0/0 00000100:00100000:3.0:1789760762.212277:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16414 00000100:00100000:3.0:1789760762.212288:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700436751146 time 700459305257 state 0x2 ref 0 00000100:00100000:3.0:1789760762.215202:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565328640 00000100:00100000:3.0:1789760762.215216:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565328640 00000100:00100000:3.0:1789760762.215286:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700436751146 time 700459305257 state 0x0 ref 1 00000100:00100000:3.0:1789760762.215303:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700459565673 time 700459305257 state 0x1 ref 1 00000100:00100000:3.0:1789760762.215334:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700459565673 time 700475625827 state 0x0 ref 1 00000100:00100000:3.0:1789760762.215346:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565328640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.216535:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67190784, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x200b8 00010000:00010000:3.0:1789760762.216549:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.216577:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.216583:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.216589:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67190784->67194879] (req 67190784->67194879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.216604:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674bf9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67190784->67194879] (req 67190784->67194879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.277304:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565328896 00000100:00100000:3.0:1789760762.277315:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565328896 00000100:00100000:3.0:1789760762.277374:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700475886243 time 700500754696 state 0x0 ref 1 00000100:00100000:3.0:1789760762.277390:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700501015112 time 700500754696 state 0x1 ref 1 00000100:00100000:3.0:1789760762.277427:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700501015112 time 700537719194 state 0x0 ref 1 00000100:00100000:3.0:1789760762.277440:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565328896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.277485:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67198976, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x200c8 00010000:00010000:3.0:1789760762.277493:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.277508:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.277512:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.277519:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.277532:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.291658:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67198976 -> 67203072 00002000:00010000:3.0:1789760762.291665:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131272 -> 131280 00010000:00010000:3.0:1789760762.291680:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.291693:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.292018:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.292030:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.292036:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.292046:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.292067:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.292076:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67198976->67203071] (req 67198976->67203071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.292398:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565328896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14955us (15748us total) trans 4294983714 rc 0/0 00000100:00100000:3.0:1789760762.292411:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16417 00000100:00100000:3.0:1789760762.292420:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700501015112 time 700537719194 state 0x2 ref 0 00000100:00100000:3.0:1789760762.341250:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565329280 00000100:00100000:3.0:1789760762.341263:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565329280 00000100:00100000:3.0:1789760762.341347:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700568341656 time 700591780495 state 0x0 ref 1 00000100:00100000:3.0:1789760762.341369:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700592040911 time 700591780495 state 0x1 ref 1 00000100:00100000:3.0:1789760762.341410:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700592040911 time 700601701362 state 0x0 ref 1 00000100:00100000:3.0:1789760762.341436:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565329280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.341505:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67211264, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x200e0 00010000:00010000:3.0:1789760762.341518:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.341539:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.341544:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.341551:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.341570:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.349595:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67211264 -> 67215360 00002000:00010000:3.0:1789760762.349600:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131296 -> 131304 00010000:00010000:3.0:1789760762.349614:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349626:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349634:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349641:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.349646:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349655:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349673:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.349681:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67211264->67215359] (req 67211264->67215359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.349832:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565329280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8406us (8935us total) trans 4294983717 rc 0/0 00000100:00100000:3.0:1789760762.349843:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16420 00000100:00100000:3.0:1789760762.349863:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700592040911 time 700601701362 state 0x2 ref 0 00000001:00080000:3.0:1789760762.387632:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983719 is committed 00002000:00010000:3.0:1789760762.406933:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67223552 -> 67227648 00002000:00010000:3.0:1789760762.406939:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131320 -> 131328 00010000:00010000:3.0:1789760762.406952:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.406964:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.406973:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.406982:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.406986:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.406995:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.407015:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.407023:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674bfd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67223552->67227647] (req 67223552->67227647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.407128:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565329664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11891us (12203us total) trans 4294983720 rc 0/0 00000100:00100000:3.0:1789760762.407139:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16423 00000100:00100000:3.0:1789760762.407147:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700635248589 time 700655514784 state 0x2 ref 0 00000001:00080000:3.0:1789760762.444519:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983722 is committed 00000100:00100000:3.0:1789760762.454785:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565330048 00000100:00100000:3.0:1789760762.454799:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565330048 00000100:00100000:3.0:1789760762.454884:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700682946744 time 700696556238 state 0x0 ref 1 00000100:00100000:3.0:1789760762.454904:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700696816654 time 700696556238 state 0x1 ref 1 00000100:00100000:3.0:1789760762.454941:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700696816654 time 700715232173 state 0x0 ref 1 00000100:00100000:3.0:1789760762.454955:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565330048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.455020:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67235840, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x20110 00010000:00010000:3.0:1789760762.455032:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.455053:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.455065:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.455073:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.455092:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.464949:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67235840 -> 67239936 00002000:00010000:3.0:1789760762.464957:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131344 -> 131352 00010000:00010000:3.0:1789760762.464974:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.464990:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.465001:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.465010:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.465015:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.465027:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.465055:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.465063:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bfe9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67235840->67239935] (req 67235840->67239935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.465253:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565330048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10292us (10613us total) trans 4294983723 rc 0/0 00000100:00100000:3.0:1789760762.465266:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16426 00000100:00100000:3.0:1789760762.465278:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700696816654 time 700715232173 state 0x2 ref 0 00000001:00080000:3.0:1789760762.510410:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983725 is committed 00000100:00100000:3.0:1789760762.517438:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565330432 00000100:00100000:3.0:1789760762.517448:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565330432 00000100:00100000:3.0:1789760762.517504:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700737529479 time 700760474340 state 0x0 ref 1 00000100:00100000:3.0:1789760762.517518:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700760734756 time 700760474340 state 0x1 ref 1 00000100:00100000:3.0:1789760762.517611:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700760734756 time 700777901252 state 0x0 ref 1 00000100:00100000:3.0:1789760762.517625:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565330432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.517682:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67248128, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x20128 00010000:00010000:3.0:1789760762.517692:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bffe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.517740:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1789760762.517746:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.517753:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67248128->67252223] (req 67248128->67252223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.517768:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674bffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67248128->67252223] (req 67248128->67252223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760762.570125:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983729 is committed 00000001:00080000:3.0:1789760762.589491:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983730 is committed 00000100:00100000:3.0:1789760762.629494:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565331200 00000100:00100000:3.0:1789760762.629504:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565331200 00000100:00100000:3.0:1789760762.629558:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700843763062 time 700858462335 state 0x0 ref 1 00000100:00100000:3.0:1789760762.629696:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 700858722751 time 700858462335 state 0x1 ref 1 00002000:00010000:3.0:1789760762.818047:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67309568 -> 67313664 00002000:00010000:3.0:1789760762.818053:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131488 -> 131496 00010000:00010000:3.0:1789760762.818066:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818079:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818089:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818097:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.818102:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818109:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818128:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.818134:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c067 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67309568->67313663] (req 67309568->67313663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.818243:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565332352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8716us (8969us total) trans 4294983741 rc 0/0 00000100:00100000:3.0:1789760762.818254:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16444 00000100:00100000:3.0:1789760762.818264:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701054983581 time 701069797479 state 0x2 ref 0 00000100:00100000:3.0:1789760762.867978:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565332736 00000100:00100000:3.0:1789760762.867987:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565332736 00000100:00100000:3.0:1789760762.868037:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701096799258 time 701113411142 state 0x0 ref 1 00000100:00100000:3.0:1789760762.868052:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701113671558 time 701113411142 state 0x1 ref 1 00000100:00100000:3.0:1789760762.868079:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701113671558 time 701128371550 state 0x0 ref 1 00000100:00100000:3.0:1789760762.868090:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565332736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.868137:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67321856, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x201b8 00010000:00010000:3.0:1789760762.868146:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.868162:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760762.868167:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.868173:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.868197:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.876110:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67321856 -> 67325952 00002000:00010000:3.0:1789760762.876115:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131512 -> 131520 00010000:00010000:3.0:1789760762.876142:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876155:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876164:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876171:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.876176:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876185:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876212:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.876220:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c07c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67321856->67325951] (req 67321856->67325951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.876312:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565332736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8218us (8469us total) trans 4294983744 rc 0/0 00000100:00100000:3.0:1789760762.876332:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16447 00000100:00100000:3.0:1789760762.876341:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701113671558 time 701128371550 state 0x2 ref 0 00000100:00100000:3.0:1789760762.925733:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565333120 00000100:00100000:3.0:1789760762.925748:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565333120 00000100:00100000:3.0:1789760762.925813:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701144181008 time 701166251519 state 0x0 ref 1 00000100:00100000:3.0:1789760762.925829:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701166511935 time 701166251519 state 0x1 ref 1 00000100:00100000:3.0:1789760762.925877:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701166511935 time 701186168472 state 0x0 ref 1 00000100:00100000:3.0:1789760762.925892:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565333120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.925944:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67334144, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0x201d0 00010000:00010000:3.0:1789760762.925954:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.925969:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760762.925973:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.925979:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.925993:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.938995:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67334144 -> 67338240 00002000:00010000:3.0:1789760762.939011:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131536 -> 131544 00010000:00010000:3.0:1789760762.939028:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939056:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939065:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939072:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.939077:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939086:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939105:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.939111:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c091 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67334144->67338239] (req 67334144->67338239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.939207:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565333120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13315us (15922us total) trans 4294983747 rc 0/0 00000100:00100000:3.0:1789760762.939217:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16450 00000100:00100000:3.0:1789760762.939226:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701166511935 time 701186168472 state 0x2 ref 0 00000100:00100000:3.0:1789760762.948202:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760762.973432:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565333504 00000100:00100000:3.0:1789760762.973442:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565333504 00000100:00100000:3.0:1789760762.973493:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701209202875 time 701220060796 state 0x0 ref 1 00000100:00100000:3.0:1789760762.973508:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701220321212 time 701220060796 state 0x1 ref 1 00000100:00100000:3.0:1789760762.973532:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701220321212 time 701233824449 state 0x0 ref 1 00000100:00100000:3.0:1789760762.973543:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565333504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760762.973592:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67346432, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x201e8 00010000:00010000:3.0:1789760762.973602:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.973618:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760762.973622:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760762.973629:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.973643:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.979490:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67346432 -> 67350528 00002000:00010000:3.0:1789760762.979495:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131560 -> 131568 00010000:00010000:3.0:1789760762.979508:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979522:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979532:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979539:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760762.979544:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979553:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979571:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.979578:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67346432->67350527] (req 67346432->67350527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.980132:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565333504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6582us (6777us total) trans 4294983750 rc 0/0 00000100:00100000:3.0:1789760762.980143:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16453 00000100:00100000:3.0:1789760762.980153:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701220321212 time 701233824449 state 0x2 ref 0 00002000:00010000:3.0:1789760763.045324:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67362816 -> 67366912 00002000:00010000:3.0:1789760763.045329:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131592 -> 131600 00010000:00010000:3.0:1789760763.045343:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045361:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045369:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045377:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.045381:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045390:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045410:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.045417:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c0c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67362816->67366911] (req 67362816->67366911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.045509:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565334016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7811us (8291us total) trans 4294983754 rc 0/0 00000100:00100000:3.0:1789760763.045519:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16457 00000100:00100000:3.0:1789760763.045529:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701279162359 time 701297975336 state 0x2 ref 0 00002000:00010000:3.0:1789760763.077555:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67371008 -> 67375104 00002000:00010000:3.0:1789760763.077565:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131608 -> 131616 00010000:00010000:3.0:1789760763.077580:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077593:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077602:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077609:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.077614:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077622:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077642:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.077649:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c0d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67371008->67375103] (req 67371008->67375103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.077790:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565334272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8358us (10314us total) trans 4294983756 rc 0/0 00000100:00100000:3.0:1789760763.077801:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16459 00000100:00100000:3.0:1789760763.077810:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701315821244 time 701329707455 state 0x2 ref 0 00000100:00100000:3.0:1789760763.088533:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565334400 00000100:00100000:3.0:1789760763.088543:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565334400 00000100:00100000:3.0:1789760763.088599:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701315821244 time 701329707455 state 0x0 ref 1 00000100:00100000:3.0:1789760763.088668:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701329967871 time 701329707455 state 0x1 ref 1 00000100:00100000:3.0:1789760763.088777:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701329967871 time 701349067420 state 0x0 ref 1 00000100:00100000:3.0:1789760763.088791:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565334400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.088837:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67375104, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20220 00010000:00010000:3.0:1789760763.088864:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.088881:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.088885:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.088900:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.088915:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.095348:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67375104 -> 67379200 00002000:00010000:3.0:1789760763.095357:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131616 -> 131624 00010000:00010000:3.0:1789760763.095370:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095389:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095398:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095406:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.095410:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095418:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095436:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.095443:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67375104->67379199] (req 67375104->67379199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.095639:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565334400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6846us (7159us total) trans 4294983757 rc 0/0 00000100:00100000:3.0:1789760763.095650:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16460 00000100:00100000:3.0:1789760763.095660:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701329967871 time 701349067420 state 0x2 ref 0 00000100:00100000:3.0:1789760763.110121:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565334656 00000100:00100000:3.0:1789760763.110130:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565334656 00000100:00100000:3.0:1789760763.110182:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701349327836 time 701361833451 state 0x0 ref 1 00000100:00100000:3.0:1789760763.110207:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701362093867 time 701361833451 state 0x1 ref 1 00000100:00100000:3.0:1789760763.110238:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701362093867 time 701370530144 state 0x0 ref 1 00000100:00100000:3.0:1789760763.110251:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565334656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.110295:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67383296, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20230 00010000:00010000:3.0:1789760763.110304:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.110318:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.110321:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.110327:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.110340:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.117571:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67383296 -> 67387392 00002000:00010000:3.0:1789760763.117577:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131632 -> 131640 00010000:00010000:3.0:1789760763.117592:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117617:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117633:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117641:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.117645:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117654:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117672:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.117680:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67383296->67387391] (req 67383296->67387391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.117837:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565334656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7583us (8002us total) trans 4294983759 rc 0/0 00000100:00100000:3.0:1789760763.117856:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16462 00000100:00100000:3.0:1789760763.117866:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701362093867 time 701370530144 state 0x2 ref 0 00000100:00100000:3.0:1789760763.126957:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565334784 00000100:00100000:3.0:1789760763.126966:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565334784 00000100:00100000:3.0:1789760763.127018:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701362093867 time 701370530144 state 0x0 ref 1 00000100:00100000:3.0:1789760763.127034:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701370790560 time 701370530144 state 0x1 ref 1 00000100:00100000:3.0:1789760763.127068:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701370790560 time 701387359385 state 0x0 ref 1 00000100:00100000:3.0:1789760763.127081:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565334784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.127129:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67387392, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20238 00010000:00010000:3.0:1789760763.127138:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.127153:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.127158:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.127164:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.127178:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.138037:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67387392 -> 67391488 00002000:00010000:3.0:1789760763.138043:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131640 -> 131648 00010000:00010000:3.0:1789760763.138056:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138070:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138081:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138095:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.138101:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138110:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138130:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.138139:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67387392->67391487] (req 67387392->67391487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.138247:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565334784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11163us (11403us total) trans 4294983760 rc 0/0 00000100:00100000:3.0:1789760763.138257:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16463 00000100:00100000:3.0:1789760763.138266:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701370790560 time 701387359385 state 0x2 ref 0 00000100:00100000:3.0:1789760763.167219:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565335040 00000100:00100000:3.0:1789760763.167230:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565335040 00000100:00100000:3.0:1789760763.167287:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701387619801 time 701407739956 state 0x0 ref 1 00000100:00100000:3.0:1789760763.167302:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701408000372 time 701407739956 state 0x1 ref 1 00000100:00100000:3.0:1789760763.167333:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701408000372 time 701427625510 state 0x0 ref 1 00000100:00100000:3.0:1789760763.167348:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565335040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.167395:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67395584, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20248 00010000:00010000:3.0:1789760763.167405:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.167421:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.167425:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.167432:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.167447:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.179829:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67395584 -> 67399680 00002000:00010000:3.0:1789760763.179850:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131656 -> 131664 00010000:00010000:3.0:1789760763.179873:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179887:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179896:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179904:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.179909:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179919:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179939:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.179947:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c0fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67395584->67399679] (req 67395584->67399679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.180056:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565335040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12705us (12907us total) trans 4294983762 rc 0/0 00000100:00100000:3.0:1789760763.180067:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16465 00000100:00100000:3.0:1789760763.180077:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701408000372 time 701427625510 state 0x2 ref 0 00000100:00100000:3.0:1789760763.200636:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565335168 00000100:00100000:3.0:1789760763.200652:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565335168 00000100:00100000:3.0:1789760763.234474:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565335424 00000100:00100000:3.0:1789760763.234493:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565335424 00000100:00100000:3.0:1789760763.234547:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701461610605 time 701477103520 state 0x0 ref 1 00000100:00100000:3.0:1789760763.234562:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701477363936 time 701477103520 state 0x1 ref 1 00000100:00100000:3.0:1789760763.234591:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701477363936 time 701494882921 state 0x0 ref 1 00000100:00100000:3.0:1789760763.234603:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565335424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.234658:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67407872, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20260 00010000:00010000:3.0:1789760763.234667:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c10f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.234683:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.234688:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.234694:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67407872->67411967] (req 67407872->67411967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.234736:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67407872->67411967] (req 67407872->67411967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.469752:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67461120 -> 67465216 00002000:00010000:3.0:1789760763.469758:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131784 -> 131792 00010000:00010000:3.0:1789760763.469783:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469796:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469805:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469812:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.469816:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469830:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469863:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.469870:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674c16a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67461120->67465215] (req 67461120->67465215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.469996:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565337088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12317us (12516us total) trans 4294983778 rc 0/0 00000100:00100000:3.0:1789760763.470007:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16481 00000100:00100000:3.0:1789760763.470017:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701706658353 time 701717956196 state 0x2 ref 0 00000100:00100000:3.0:1789760763.530999:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565337472 00000100:00100000:3.0:1789760763.531009:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565337472 00000100:00100000:3.0:1789760763.531059:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701749479800 time 701771594938 state 0x0 ref 1 00000100:00100000:3.0:1789760763.531074:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701771855354 time 701771594938 state 0x1 ref 1 00000100:00100000:3.0:1789760763.531106:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701771855354 time 701791397806 state 0x0 ref 1 00000100:00100000:3.0:1789760763.531118:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565337472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.531161:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67473408, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x202e0 00010000:00010000:3.0:1789760763.531170:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.531195:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.531206:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.531213:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.531340:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.539917:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67473408 -> 67477504 00002000:00010000:3.0:1789760763.539924:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131808 -> 131816 00010000:00010000:3.0:1789760763.539938:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.539951:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.539961:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.539969:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.539974:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.539983:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.540009:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.540017:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c17f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67473408->67477503] (req 67473408->67477503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.540164:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565337472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9042us (9370us total) trans 4294983781 rc 0/0 00000100:00100000:3.0:1789760763.540174:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16484 00000100:00100000:3.0:1789760763.540465:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701771855354 time 701791397806 state 0x2 ref 0 00000100:00100000:3.0:1789760763.593421:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565337856 00000100:00100000:3.0:1789760763.593431:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565337856 00000100:00100000:3.0:1789760763.593493:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701819205187 time 701838309221 state 0x0 ref 1 00000100:00100000:3.0:1789760763.593508:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701838569637 time 701838309221 state 0x1 ref 1 00000100:00100000:3.0:1789760763.593538:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701838569637 time 701853829450 state 0x0 ref 1 00000100:00100000:3.0:1789760763.593552:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565337856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.593596:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67485696, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x202f8 00010000:00010000:3.0:1789760763.593605:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.593621:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.593626:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.593632:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.593646:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.603114:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67485696 -> 67489792 00002000:00010000:3.0:1789760763.603119:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131832 -> 131840 00010000:00010000:3.0:1789760763.603133:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603145:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603153:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603161:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.603165:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603174:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603194:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.603208:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c194 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67485696->67489791] (req 67485696->67489791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.603317:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565337856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9764us (10245us total) trans 4294983784 rc 0/0 00000100:00100000:3.0:1789760763.603328:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16487 00000100:00100000:3.0:1789760763.603337:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701838569637 time 701853829450 state 0x2 ref 0 00000100:00100000:3.0:1789760763.639746:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565338240 00000100:00100000:3.0:1789760763.639755:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565338240 00000100:00100000:3.0:1789760763.639817:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701874901673 time 701886552809 state 0x0 ref 1 00000100:00100000:3.0:1789760763.639830:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701886813225 time 701886552809 state 0x1 ref 1 00000100:00100000:3.0:1789760763.639882:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701886813225 time 701900174142 state 0x0 ref 1 00000100:00100000:3.0:1789760763.639895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565338240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.639940:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67497984, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20310 00010000:00010000:3.0:1789760763.639949:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.639964:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789760763.639969:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.639975:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.639993:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760763.648802:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67497984 -> 67502080 00002000:00010000:3.0:1789760763.648807:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131856 -> 131864 00010000:00010000:3.0:1789760763.648820:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648833:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648851:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648858:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.648863:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648870:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648889:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.648897:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c1a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67497984->67502079] (req 67497984->67502079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.648991:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565338240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9094us (9476us total) trans 4294983787 rc 0/0 00000100:00100000:3.0:1789760763.649002:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16490 00000100:00100000:3.0:1789760763.649012:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701886813225 time 701900174142 state 0x2 ref 0 00000100:00100000:3.0:1789760763.666599:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760763.714620:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565338624 00000100:00100000:3.0:1789760763.714632:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565338624 00000100:00100000:3.0:1789760763.714692:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701928199365 time 701952668398 state 0x0 ref 1 00000100:00100000:3.0:1789760763.714815:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 701952928814 time 701952668398 state 0x1 ref 1 00000100:00100000:3.0:1789760763.728827:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760763.739160:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983791 is committed 00000100:00100000:3.0:1789760763.775079:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760763.820951:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760763.825988:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983797 is committed 00002000:00010000:3.0:1789760763.826903:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67538944 -> 67543040 00002000:00010000:3.0:1789760763.826911:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131936 -> 131944 00010000:00010000:3.0:1789760763.826924:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826937:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826947:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826955:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760763.826959:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826968:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826987:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.826995:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674c1ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67538944->67543039] (req 67538944->67543039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760763.827157:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565339520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5804us (6211us total) trans 4294983797 rc 0/0 00000100:00100000:3.0:1789760763.831278:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16500 00000100:00100000:3.0:1789760763.831308:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702064580342 time 702081628538 state 0x2 ref 0 00000001:00080000:3.0:1789760763.839074:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983798 is committed 00000001:00080000:3.0:1789760763.853026:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983799 is committed 00000100:00100000:3.0:1789760763.858019:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565339904 00000100:00100000:3.0:1789760763.858029:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565339904 00000100:00100000:3.0:1789760763.858087:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702092202568 time 702107801885 state 0x0 ref 1 00000100:00100000:3.0:1789760763.858103:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702108062301 time 702107801885 state 0x1 ref 1 00000100:00100000:3.0:1789760763.858165:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702108062301 time 702118456907 state 0x0 ref 1 00000100:00100000:3.0:1789760763.858178:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565339904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760763.858234:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67551232, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0x20378 00010000:00010000:3.0:1789760763.858243:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.858258:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=702s v=(0 0) 00010000:00010000:3.0:1789760763.858262:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.858277:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67551232->67555327] (req 67551232->67555327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.858292:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67551232->67555327] (req 67551232->67555327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760763.890497:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983801 is committed 00002000:00010000:3.0:1789760764.149097:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67637248 -> 67641344 00002000:00010000:3.0:1789760764.149108:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 132128 -> 132136 00010000:00010000:3.0:1789760764.149124:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149136:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149145:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149158:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760764.149162:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149171:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149266:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.149275:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674c297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67637248->67641343] (req 67637248->67641343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.149421:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565342592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11319us (11540us total) trans 4294983821 rc 0/0 00000100:00100000:3.0:1789760764.149431:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16524 00000100:00100000:3.0:1789760764.149441:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702384749799 time 702398377777 state 0x2 ref 0 00000100:00100000:3.0:1789760764.209040:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565342976 00000100:00100000:3.0:1789760764.209050:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565342976 00000100:00100000:3.0:1789760764.209106:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702420956582 time 702451563089 state 0x0 ref 1 00000100:00100000:3.0:1789760764.209121:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702451823505 time 702451563089 state 0x1 ref 1 00000100:00100000:3.0:1789760764.209193:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702451823505 time 702469484404 state 0x0 ref 1 00000100:00100000:3.0:1789760764.209209:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565342976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760764.209257:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67649536, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0x20438 00010000:00010000:3.0:1789760764.209266:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c2ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.209281:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=702s v=(0 0) 00010000:00010000:3.0:1789760764.209286:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760764.209291:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67649536->67653631] (req 67649536->67653631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.209305:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c2ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67649536->67653631] (req 67649536->67653631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760764.396277:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983836 is committed 00000100:00100000:3.0:1789760764.481057:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760764.512339:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983843 is committed 00000100:00100000:3.0:1789760764.548442:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760764.686251:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580063616 00000100:00100000:3.0:1789760764.686255:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580063616 00000100:00100000:3.0:1789760764.686292:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789760764.686300:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7eeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580063872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760764.686350:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580063872:12345-0@lo:400:kworker.0 Request processed in 51us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.686356:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789760764.686368:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789760764.686373:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580063616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760764.686423:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7eee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580063616:12345-0@lo:400:kworker.0 Request processed in 50us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.686429:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789760764.686450:0:13530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064000 00000100:00100000:3.0:1789760764.686453:0:13530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064000 00000100:00100000:3.0:1789760764.686488:0:13530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760764.686495:0:13530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580064000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760764.686515:0:13530:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760764.686542:0:13530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580064000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.686548:0:13530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760764.686580:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d47698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580064000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760764.686591:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580063616:0@lo:400:kworker.0 00000100:00100000:3.0:1789760764.686617:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d42b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580063872:0@lo:400:kworker.0 00000100:00080000:3.0:1789760764.686648:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760764.686652:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760764.686654:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760764.688119:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3457:1876699580063488:0@lo:400:kworker.0 00002000:00010000:3.0:1789760764.690061:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67764224 -> 67768320 00002000:00010000:3.0:1789760764.690067:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 132376 -> 132384 00010000:00010000:3.0:1789760764.690080:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690093:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690108:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690115:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760764.690120:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690129:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690151:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.690159:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67764224->67768319] (req 67764224->67768319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.690258:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565346560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7888us (8258us total) trans 4294983852 rc 0/0 00000100:00100000:3.0:1789760764.690268:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16555 00000100:00100000:3.0:1789760764.690278:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702921236473 time 702942645879 state 0x2 ref 0 00000100:00100000:3.0:1789760764.741280:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565346944 00000100:00100000:3.0:1789760764.741289:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565346944 00000100:00100000:3.0:1789760764.741344:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702956787233 time 702982488411 state 0x0 ref 1 00000100:00100000:3.0:1789760764.741359:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702982748827 time 702982488411 state 0x1 ref 1 00000100:00100000:3.0:1789760764.741435:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702982748827 time 703001726791 state 0x0 ref 1 00000100:00100000:3.0:1789760764.741448:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565346944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760764.741495:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67776512, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0x20530 00010000:00010000:3.0:1789760764.741506:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.741521:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=703s v=(0 0) 00010000:00010000:3.0:1789760764.741526:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760764.741532:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.741549:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760764.750887:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67776512 -> 67780608 00002000:00010000:3.0:1789760764.750896:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 132400 -> 132408 00010000:00010000:3.0:1789760764.750912:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750924:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750931:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750942:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760764.750946:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750955:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750973:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.750979:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c385 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67776512->67780607] (req 67776512->67780607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.751072:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565346944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9621us (9878us total) trans 4294983855 rc 0/0 00000100:00100000:3.0:1789760764.751081:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16558 00000100:00100000:3.0:1789760764.751090:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 702982748827 time 703001726791 state 0x2 ref 0 00000100:00100000:3.0:1789760764.787061:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565347328 00000100:00100000:3.0:1789760764.787072:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565347328 00000100:00100000:3.0:1789760764.787125:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703015980137 time 703028329252 state 0x0 ref 1 00000100:00100000:3.0:1789760764.787262:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703028589668 time 703028329252 state 0x1 ref 1 00000100:00100000:3.0:1789760764.787331:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703028589668 time 703047621999 state 0x0 ref 1 00000100:00100000:3.0:1789760764.787348:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565347328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760764.787393:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67788800, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0x20548 00010000:00010000:3.0:1789760764.787403:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.787427:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=703s v=(0 0) 00010000:00010000:3.0:1789760764.787432:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760764.787437:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.787451:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760764.796586:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67788800 -> 67792896 00002000:00010000:3.0:1789760764.796591:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 132424 -> 132432 00010000:00010000:3.0:1789760764.796605:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796618:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796628:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796635:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760764.796641:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796650:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796669:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.796676:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c39a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67788800->67792895] (req 67788800->67792895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.796843:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565347328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9485us (9920us total) trans 4294983858 rc 0/0 00000100:00100000:3.0:1789760764.796854:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16561 00000100:00100000:3.0:1789760764.796863:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703028589668 time 703047621999 state 0x2 ref 0 00000100:00100000:3.0:1789760764.822625:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565347712 00000100:00100000:3.0:1789760764.822634:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565347712 00000100:00100000:3.0:1789760764.822685:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703063214858 time 703073872641 state 0x0 ref 1 00000100:00100000:3.0:1789760764.822700:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703074133057 time 703073872641 state 0x1 ref 1 00000100:00100000:3.0:1789760764.822988:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 703074133057 time 703083278890 state 0x0 ref 1 00000100:00100000:3.0:1789760764.823003:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565347712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760764.823048:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67801088, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0x20560 00010000:00010000:3.0:1789760764.823057:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c3af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.823072:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=703s v=(0 0) 00010000:00010000:3.0:1789760764.823076:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760764.823083:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67801088->67805183] (req 67801088->67805183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.823097:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67801088->67805183] (req 67801088->67805183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760765.044284:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983874 is committed 00000001:00080000:3.0:1789760765.064144:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983875 is committed 00000001:00080000:3.0:1789760765.075040:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983876 is committed 00000001:00080000:3.0:1789760765.144594:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983880 is committed 00000001:00080000:3.0:1789760765.156075:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983881 is committed 00000001:00080000:3.0:1789760765.175505:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983882 is committed 00000001:00080000:3.0:1789760765.198210:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983884 is committed 00000001:00080000:3.0:1789760765.682740:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983908 is committed 00000001:00080000:3.0:1789760765.853966:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983918 is committed 00000001:00080000:3.0:1789760765.878028:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983920 is committed 00000001:00080000:3.0:1789760765.891662:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983921 is committed 00000001:00080000:3.0:1789760765.921143:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983923 is committed 00000100:00080000:3.0:1789760766.004410:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760766.159672:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565357824 00000100:00100000:3.0:1789760766.159681:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565357824 00000100:00100000:3.0:1789760766.159771:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704390469292 time 704401359484 state 0x0 ref 1 00000100:00100000:3.0:1789760766.159797:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704401619900 time 704401359484 state 0x1 ref 1 00000100:00100000:3.0:1789760766.159832:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704401619900 time 704420124761 state 0x0 ref 1 00000100:00100000:3.0:1789760766.159845:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565357824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.159896:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68124672, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x207d8 00010000:00010000:3.0:1789760766.159904:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.159919:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.159923:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.159929:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.159943:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760766.169334:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68124672 -> 68128768 00002000:00010000:3.0:1789760766.169406:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133080 -> 133088 00010000:00010000:3.0:1789760766.169420:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169433:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169443:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169458:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.169463:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169472:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169492:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.169500:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68124672->68128767] (req 68124672->68128767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.169614:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565357824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9766us (10037us total) trans 4294983940 rc 0/0 00000100:00100000:3.0:1789760766.169626:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16643 00000100:00100000:3.0:1789760766.169636:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704401619900 time 704420124761 state 0x2 ref 0 00000001:00080000:3.0:1789760766.183288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983941 is committed 00000100:00100000:3.0:1789760766.204132:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565358208 00000100:00100000:3.0:1789760766.204143:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565358208 00000100:00100000:3.0:1789760766.204202:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704436876465 time 704449095631 state 0x0 ref 1 00000100:00100000:3.0:1789760766.204219:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704449356047 time 704449095631 state 0x1 ref 1 00000100:00100000:3.0:1789760766.204293:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704449356047 time 704464584748 state 0x0 ref 1 00000100:00100000:3.0:1789760766.204307:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565358208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.204356:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68136960, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x207f0 00010000:00010000:3.0:1789760766.204365:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.204381:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.204385:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.204391:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68136960->68141055] (req 68136960->68141055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.204416:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674c5ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68136960->68141055] (req 68136960->68141055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760766.209730:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983943 is committed 00000001:00080000:3.0:1789760766.222733:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983944 is committed 00000100:00100000:3.0:1789760766.279949:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704501886409 time 704519842173 state 0x0 ref 1 00000100:00100000:3.0:1789760766.279970:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704520102589 time 704519842173 state 0x1 ref 1 00000100:00100000:3.0:1789760766.280003:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704520102589 time 704540295179 state 0x0 ref 1 00000100:00100000:3.0:1789760766.280018:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565358720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.280071:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68153344, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20810 00010000:00010000:3.0:1789760766.280093:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.280110:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.280115:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.280121:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.280136:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760766.287360:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68153344 -> 68157440 00002000:00010000:3.0:1789760766.287370:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133136 -> 133144 00010000:00010000:3.0:1789760766.287387:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287402:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287412:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287421:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.287426:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287435:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287461:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.287469:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c609 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68153344->68157439] (req 68153344->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.287554:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565358720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7536us (12544us total) trans 4294983947 rc 0/0 00000100:00100000:3.0:1789760766.287564:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16650 00000100:00100000:3.0:1789760766.287573:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704520102589 time 704540295179 state 0x2 ref 0 00000100:00100000:3.0:1789760766.333306:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565359104 00000100:00100000:3.0:1789760766.333316:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565359104 00000100:00100000:3.0:1789760766.333369:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704558575205 time 704576516514 state 0x0 ref 1 00000100:00100000:3.0:1789760766.333383:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704576776930 time 704576516514 state 0x1 ref 1 00000100:00100000:3.0:1789760766.333417:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704576776930 time 704593709082 state 0x0 ref 1 00000100:00100000:3.0:1789760766.333429:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565359104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.333476:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68165632, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20828 00010000:00010000:3.0:1789760766.333485:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.333499:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.333504:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.333511:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.333524:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760766.337508:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68165632 -> 68169728 00002000:00010000:3.0:1789760766.337513:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133160 -> 133168 00010000:00010000:3.0:1789760766.337525:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337537:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337545:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337551:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.337557:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337565:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337585:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.337597:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c61e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68165632->68169727] (req 68165632->68169727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.338377:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565359104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4942us (5149us total) trans 4294983950 rc 0/0 00000100:00100000:3.0:1789760766.338388:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16653 00000100:00100000:3.0:1789760766.338397:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704576776930 time 704593709082 state 0x2 ref 0 00000100:00100000:3.0:1789760766.400133:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565359872 00000100:00100000:3.0:1789760766.400143:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565359872 00000100:00100000:3.0:1789760766.400211:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704621574369 time 704641331848 state 0x0 ref 1 00000100:00100000:3.0:1789760766.400226:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704641592264 time 704641331848 state 0x1 ref 1 00000100:00100000:3.0:1789760766.400256:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704641592264 time 704660548066 state 0x0 ref 1 00000100:00100000:3.0:1789760766.400269:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565359872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.400315:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68177920, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20840 00010000:00010000:3.0:1789760766.400325:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c633 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.400341:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.400345:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.400350:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68177920->68182015] (req 68177920->68182015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.400369:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674c633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68177920->68182015] (req 68177920->68182015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.414280:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760766.433510:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983955 is committed 00002000:00010000:3.0:1789760766.433928:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68186112 -> 68190208 00002000:00010000:3.0:1789760766.433934:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133200 -> 133208 00010000:00010000:3.0:1789760766.433947:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.433961:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.433971:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.433979:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.433983:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.433991:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.434011:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.434025:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674c641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68186112->68190207] (req 68186112->68190207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.434156:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565360128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4928us (5144us total) trans 4294983955 rc 0/0 00000100:00100000:3.0:1789760766.434175:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16658 00000100:00100000:3.0:1789760766.434186:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704675674632 time 704689504197 state 0x2 ref 0 00000001:00080000:3.0:1789760766.447178:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983956 is committed 00000100:00100000:3.0:1789760766.455333:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760766.480509:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565360512 00000100:00100000:3.0:1789760766.480519:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565360512 00000100:00100000:3.0:1789760766.480576:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704703363541 time 704719574433 state 0x0 ref 1 00000100:00100000:3.0:1789760766.480592:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704719834849 time 704719574433 state 0x1 ref 1 00000100:00100000:3.0:1789760766.480624:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704719834849 time 704740916065 state 0x0 ref 1 00000100:00100000:3.0:1789760766.480636:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565360512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.480898:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68198400, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20868 00010000:00010000:3.0:1789760766.480907:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.480922:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.480926:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.480933:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.480947:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760766.493595:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68198400 -> 68202496 00002000:00010000:3.0:1789760766.493605:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133224 -> 133232 00010000:00010000:3.0:1789760766.493619:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493631:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493761:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493768:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.493773:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493782:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493803:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.493826:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68198400->68202495] (req 68198400->68202495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.493923:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565360512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13283us (13509us total) trans 4294983958 rc 0/0 00000100:00100000:3.0:1789760766.493934:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16661 00000100:00100000:3.0:1789760766.493944:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704719834849 time 704740916065 state 0x2 ref 0 00000100:00100000:3.0:1789760766.528450:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565360896 00000100:00100000:3.0:1789760766.528461:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565360896 00000100:00100000:3.0:1789760766.528528:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704758205771 time 704773589444 state 0x0 ref 1 00000100:00100000:3.0:1789760766.528544:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704773849860 time 704773589444 state 0x1 ref 1 00000100:00100000:3.0:1789760766.528611:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704773849860 time 704788902515 state 0x0 ref 1 00000100:00100000:3.0:1789760766.528625:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565360896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.528671:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68210688, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20880 00010000:00010000:3.0:1789760766.528680:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.528694:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.528699:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.528730:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.528760:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760766.536491:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68210688 -> 68214784 00002000:00010000:3.0:1789760766.536500:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133248 -> 133256 00010000:00010000:3.0:1789760766.537939:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.537959:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.537968:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.537976:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.537981:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.537990:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.538011:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.538019:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c66b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68210688->68214783] (req 68210688->68214783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.538329:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565360896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9700us (10017us total) trans 4294983961 rc 0/0 00000100:00100000:3.0:1789760766.538341:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16664 00000100:00100000:3.0:1789760766.538351:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704773849860 time 704788902515 state 0x2 ref 0 00000100:00100000:3.0:1789760766.572365:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565361280 00000100:00100000:3.0:1789760766.572374:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565361280 00000100:00100000:3.0:1789760766.572434:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704808673549 time 704819439175 state 0x0 ref 1 00000100:00100000:3.0:1789760766.572449:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704819699591 time 704819439175 state 0x1 ref 1 00000100:00100000:3.0:1789760766.572475:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 704819699591 time 704832767404 state 0x0 ref 1 00000100:00100000:3.0:1789760766.572487:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565361280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.572534:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68222976, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20898 00010000:00010000:3.0:1789760766.572543:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.572560:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789760766.572564:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.572570:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68222976->68227071] (req 68222976->68227071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.572584:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674c680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68222976->68227071] (req 68222976->68227071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760766.622959:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983967 is committed 00000001:00080000:3.0:1789760766.636195:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983968 is committed 00000001:00080000:3.0:1789760766.680777:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983970 is committed 00000001:00080000:3.0:1789760766.696114:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983971 is committed 00000001:00080000:3.0:1789760766.721473:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983972 is committed 00000001:00080000:3.0:1789760766.739754:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983973 is committed 00000100:00100000:3.0:1789760766.771695:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760766.804260:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68272128 -> 68276224 00002000:00010000:3.0:1789760766.804266:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133368 -> 133376 00010000:00010000:3.0:1789760766.804280:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804294:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804304:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804312:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760766.804317:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804327:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804348:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.804357:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674c6d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68272128->68276223] (req 68272128->68276223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760766.804500:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565362816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7926us (8223us total) trans 4294983976 rc 0/0 00000100:00100000:3.0:1789760766.804511:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16679 00000100:00100000:3.0:1789760766.804523:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705037180472 time 705056849004 state 0x2 ref 0 00000001:00080000:3.0:1789760766.812997:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983977 is committed 00000001:00080000:3.0:1789760766.826999:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294983978 is committed 00000100:00100000:3.0:1789760766.833557:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565363200 00000100:00100000:3.0:1789760766.833568:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565363200 00000100:00100000:3.0:1789760766.833627:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705068745085 time 705082854720 state 0x0 ref 1 00000100:00100000:3.0:1789760766.833643:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705083115136 time 705082854720 state 0x1 ref 1 00000100:00100000:3.0:1789760766.833739:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705083115136 time 705094029752 state 0x0 ref 1 00000100:00100000:3.0:1789760766.833762:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565363200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760766.833809:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68284416, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0x20910 00010000:00010000:3.0:1789760766.833827:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674c6e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.833846:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760766.833851:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.833859:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674c6e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68284416->68288511] (req 68284416->68288511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.833872:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674c6e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68284416->68288511] (req 68284416->68288511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.033099:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705271681122 time 705293379476 state 0x0 ref 1 00000100:00100000:3.0:1789760767.033135:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565364992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.033509:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68341760, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20980 00010000:00010000:3.0:1789760767.033520:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.033541:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760767.033547:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.033555:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.033572:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760767.048672:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68341760 -> 68345856 00002000:00010000:3.0:1789760767.048680:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133504 -> 133512 00010000:00010000:3.0:1789760767.048693:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048732:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048743:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048751:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.048756:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048766:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048786:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.048794:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c74b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68341760->68345855] (req 68341760->68345855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.048902:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565364992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15779us (19851us total) trans 4294983993 rc 0/0 00000100:00100000:3.0:1789760767.048913:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16696 00000100:00100000:3.0:1789760767.048921:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705271681122 time 705293379476 state 0x2 ref 0 00000100:00100000:3.0:1789760767.105431:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565365376 00000100:00100000:3.0:1789760767.105445:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565365376 00000100:00100000:3.0:1789760767.105501:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705314097897 time 705335149888 state 0x0 ref 1 00000100:00100000:3.0:1789760767.105516:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705335410304 time 705335149888 state 0x1 ref 1 00000100:00100000:3.0:1789760767.105551:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705335410304 time 705365843288 state 0x0 ref 1 00000100:00100000:3.0:1789760767.105564:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565365376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.105609:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68354048, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20998 00010000:00010000:3.0:1789760767.105619:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.105635:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760767.105639:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.105646:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.105660:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760767.114526:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68354048 -> 68358144 00002000:00010000:3.0:1789760767.114532:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133528 -> 133536 00010000:00010000:3.0:1789760767.114546:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114558:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114567:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114579:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.114583:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114591:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114611:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.114619:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c760 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68354048->68358143] (req 68354048->68358143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.115454:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565365376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9885us (11290us total) trans 4294983996 rc 0/0 00000100:00100000:3.0:1789760767.115465:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16699 00000100:00100000:3.0:1789760767.115476:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705335410304 time 705365843288 state 0x2 ref 0 00000100:00100000:3.0:1789760767.161415:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565365760 00000100:00100000:3.0:1789760767.161431:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565365760 00000100:00100000:3.0:1789760767.161511:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705385216927 time 705401951505 state 0x0 ref 1 00000100:00100000:3.0:1789760767.161531:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705402211921 time 705401951505 state 0x1 ref 1 00000100:00100000:3.0:1789760767.161566:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705402211921 time 705421858018 state 0x0 ref 1 00000100:00100000:3.0:1789760767.161586:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565365760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.161652:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68366336, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x209b0 00010000:00010000:3.0:1789760767.161664:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c775 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.161683:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760767.161689:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.161696:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68366336->68370431] (req 68366336->68370431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.161957:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68366336->68370431] (req 68366336->68370431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.221555:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565366144 00000100:00100000:3.0:1789760767.221570:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565366144 00000100:00100000:3.0:1789760767.221659:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705446792653 time 705463749111 state 0x0 ref 1 00000100:00100000:3.0:1789760767.221680:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705464009527 time 705463749111 state 0x1 ref 1 00000100:00100000:3.0:1789760767.221761:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705464009527 time 705482051492 state 0x0 ref 1 00000100:00100000:3.0:1789760767.221776:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565366144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.222066:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68378624, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x209c8 00010000:00010000:3.0:1789760767.222081:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c78a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.222338:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760767.222345:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.222355:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c78a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68378624->68382719] (req 68378624->68382719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.222374:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c78a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68378624->68382719] (req 68378624->68382719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.245097:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580064128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760767.263912:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705507225818 time 705524192549 state 0x0 ref 1 00000100:00100000:3.0:1789760767.263941:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565366400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.264005:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68386816, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x209d8 00010000:00010000:3.0:1789760767.264016:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c798 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.264035:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1789760767.264041:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.264049:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c798 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68386816->68390911] (req 68386816->68390911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.264067:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674c798 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68386816->68390911] (req 68386816->68390911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.283027:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760767.330802:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.428413:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984014 is committed 00000100:00100000:3.0:1789760767.506074:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1789760767.506601:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.506614:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760767.513016:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68452352 -> 68456448 00002000:00010000:1.0:1789760767.513022:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133720 -> 133728 00010000:00010000:1.0:1789760767.513035:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513046:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513052:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513057:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760767.513060:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513066:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513081:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.513089:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c808 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68452352->68456447] (req 68452352->68456447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.513190:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565368448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6670us (7120us total) trans 4294984020 rc 0/0 00000100:00100000:1.0:1789760767.513201:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16723 00000100:00100000:1.0:1789760767.513210:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705752337778 time 705766796669 state 0x2 ref 0 00000001:00080000:3.0:1789760767.545996:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984022 is committed 00000100:00100000:3.0:1789760767.553777:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760767.553902:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565368832 00000100:00100000:1.0:1789760767.553911:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565368832 00000100:00100000:1.0:1789760767.553964:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705778013512 time 705795694464 state 0x0 ref 1 00000100:00100000:1.0:1789760767.553979:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705795954880 time 705795694464 state 0x1 ref 1 00000100:00100000:1.0:1789760767.554010:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705795954880 time 705814301949 state 0x0 ref 1 00000100:00100000:1.0:1789760767.554022:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565368832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760767.554098:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68464640, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20a70 00010000:00010000:1.0:1789760767.554109:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c81d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.554124:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1789760767.554128:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760767.554134:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c81d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68464640->68468735] (req 68464640->68468735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.554147:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674c81d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68464640->68468735] (req 68464640->68468735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760767.560364:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984023 is committed 00000100:00100000:1.0:1789760767.567341:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.573239:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984024 is committed 00000100:00100000:1.0:1789760767.579055:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.584422:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984025 is committed 00000100:00100000:3.0:1789760767.595245:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.600666:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984026 is committed 00000100:00100000:1.0:1789760767.617331:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:1.0:1789760767.623661:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68481024 -> 68485120 00002000:00010000:1.0:1789760767.623667:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133776 -> 133784 00010000:00010000:1.0:1789760767.623680:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623694:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623741:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623760:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760767.623765:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623775:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623794:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.623802:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674c839 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68481024->68485119] (req 68481024->68485119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.623980:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565369344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6325us (6653us total) trans 4294984027 rc 0/0 00000100:00100000:1.0:1789760767.623991:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16730 00000100:00100000:1.0:1789760767.624000:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705856191081 time 705877931498 state 0x2 ref 0 00000100:00100000:1.0:1789760767.630440:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.637743:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984028 is committed 00000100:00100000:3.0:1789760767.645448:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760767.667802:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565369728 00000100:00100000:1.0:1789760767.667821:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565369728 00000100:00100000:1.0:1789760767.667876:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705891179353 time 705905952061 state 0x0 ref 1 00000100:00100000:1.0:1789760767.667891:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705906212477 time 705905952061 state 0x1 ref 1 00000100:00100000:1.0:1789760767.667936:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705906212477 time 705928227834 state 0x0 ref 1 00000100:00100000:1.0:1789760767.667948:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565369728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760767.667997:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68493312, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20aa8 00010000:00010000:1.0:1789760767.668008:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674c84e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.668026:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1789760767.668032:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760767.668038:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674c84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68493312->68497407] (req 68493312->68497407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.668052:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674c84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68493312->68497407] (req 68493312->68497407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.686964:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.695607:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984031 is committed 00000100:00100000:3.0:1789760767.705056:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.711624:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984032 is committed 00000001:00080000:3.0:1789760767.723818:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984033 is committed 00000100:00100000:1.0:1789760767.729686:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760767.737835:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984034 is committed 00000100:00100000:3.0:1789760767.746943:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:3.0:1789760767.758550:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68513792 -> 68517888 00002000:00010000:3.0:1789760767.758555:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133840 -> 133848 00010000:00010000:3.0:1789760767.758569:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758581:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758595:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758604:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.758609:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758618:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758636:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.758644:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674c871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68513792->68517887] (req 68513792->68517887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.758759:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565370368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11540us (11821us total) trans 4294984035 rc 0/0 00000100:00100000:3.0:1789760767.758769:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16738 00000100:00100000:3.0:1789760767.758778:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 705991396575 time 706007495930 state 0x2 ref 0 00000001:00080000:1.0:1789760767.772294:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984036 is committed 00000100:00100000:1.0:1789760767.783249:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706026002437 time 706043538178 state 0x0 ref 1 00000100:00100000:1.0:1789760767.783264:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565370624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760767.783429:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68521984, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20ae0 00010000:00010000:1.0:1789760767.783440:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.783455:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760767.783460:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760767.783466:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.783480:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760767.793067:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68521984 -> 68526080 00002000:00010000:1.0:1789760767.793072:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133856 -> 133864 00010000:00010000:1.0:1789760767.793085:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793098:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793108:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793115:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760767.793120:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793130:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793149:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.793215:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674c87f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68521984->68526079] (req 68521984->68526079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.793366:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565370624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10040us (10761us total) trans 4294984037 rc 0/0 00000100:00100000:1.0:1789760767.794184:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16740 00000100:00100000:1.0:1789760767.794194:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706026002437 time 706043538178 state 0x2 ref 0 00000100:00100000:3.0:1789760767.796626:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565370752 00000100:00100000:3.0:1789760767.796636:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565370752 00000100:00100000:3.0:1789760767.796690:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706026002437 time 706043538178 state 0x0 ref 1 00000100:00100000:3.0:1789760767.796724:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706043798594 time 706043538178 state 0x1 ref 1 00000100:00100000:3.0:1789760767.796789:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706043798594 time 706057080419 state 0x0 ref 1 00000100:00100000:3.0:1789760767.796801:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565370752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.796873:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68526080, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20ae8 00010000:00010000:3.0:1789760767.796882:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.796902:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1789760767.796906:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.796913:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.796927:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760767.803480:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984038 is committed 00002000:00010000:3.0:1789760767.803745:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68526080 -> 68530176 00002000:00010000:3.0:1789760767.803751:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133864 -> 133872 00010000:00010000:3.0:1789760767.803765:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803776:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803784:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803796:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.803802:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803820:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803839:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.803854:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68526080->68530175] (req 68526080->68530175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.804133:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565370752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7329us (7807us total) trans 4294984038 rc 0/0 00000100:00100000:3.0:1789760767.805079:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16741 00000100:00100000:3.0:1789760767.805091:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706043798594 time 706057080419 state 0x2 ref 0 00000001:00080000:1.0:1789760767.815414:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984039 is committed 00000100:00100000:1.0:1789760767.821381:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565371008 00000100:00100000:1.0:1789760767.821399:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565371008 00000100:00100000:1.0:1789760767.821632:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706057340835 time 706068847009 state 0x0 ref 1 00000100:00100000:1.0:1789760767.821650:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706069107425 time 706068847009 state 0x1 ref 1 00000100:00100000:1.0:1789760767.821929:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706069107425 time 706082219298 state 0x0 ref 1 00000100:00100000:1.0:1789760767.821998:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565371008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760767.822047:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68534272, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20af8 00010000:00010000:1.0:1789760767.822056:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c894 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.822071:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760767.822076:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760767.822083:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68534272->68538367] (req 68534272->68538367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.822096:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68534272->68538367] (req 68534272->68538367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760767.829775:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984040 is committed 00000100:00100000:1.0:1789760767.835000:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760767.835451:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565371136 00000100:00100000:3.0:1789760767.835461:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565371136 00000100:00100000:3.0:1789760767.835513:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706069107425 time 706082219298 state 0x0 ref 1 00000100:00100000:3.0:1789760767.835529:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706082479714 time 706082219298 state 0x1 ref 1 00000100:00100000:3.0:1789760767.835566:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706082479714 time 706095857464 state 0x0 ref 1 00000100:00100000:3.0:1789760767.835583:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565371136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.835640:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68538368, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20b00 00010000:00010000:3.0:1789760767.835649:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.835665:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1789760767.835669:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.835675:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.835689:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760767.845511:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984041 is committed 00002000:00010000:3.0:1789760767.845884:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68538368 -> 68542464 00002000:00010000:3.0:1789760767.845891:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133888 -> 133896 00010000:00010000:3.0:1789760767.845904:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845917:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845927:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845935:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.845940:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845949:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845972:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.845979:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674c89b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68538368->68542463] (req 68538368->68542463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.846165:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565371136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10572us (11161us total) trans 4294984041 rc 0/0 00000100:00100000:3.0:1789760767.846176:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16744 00000100:00100000:3.0:1789760767.846186:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706082479714 time 706095857464 state 0x2 ref 0 00000001:00080000:1.0:1789760767.858257:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984042 is committed 00000100:00100000:3.0:1789760767.867050:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760767.874552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984043 is committed 00000100:00100000:1.0:1789760767.882457:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760767.882564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565371520 00000100:00100000:3.0:1789760767.882574:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565371520 00000100:00100000:3.0:1789760767.882624:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706113416603 time 706127589390 state 0x0 ref 1 00000100:00100000:3.0:1789760767.882638:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706127849806 time 706127589390 state 0x1 ref 1 00000100:00100000:3.0:1789760767.882699:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706127849806 time 706142990492 state 0x0 ref 1 00000100:00100000:3.0:1789760767.882726:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565371520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.882938:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68550656, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20b18 00010000:00010000:3.0:1789760767.882947:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.882962:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1789760767.882965:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.882970:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.882982:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760767.889595:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984044 is committed 00002000:00010000:3.0:1789760767.892499:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68550656 -> 68554752 00002000:00010000:3.0:1789760767.892508:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133912 -> 133920 00010000:00010000:3.0:1789760767.892522:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892535:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892544:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892552:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760767.892557:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892571:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892595:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.892602:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68550656->68554751] (req 68550656->68554751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.892980:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565371520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10250us (10526us total) trans 4294984044 rc 0/0 00000100:00100000:3.0:1789760767.892993:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16747 00000100:00100000:3.0:1789760767.893003:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706127849806 time 706142990492 state 0x2 ref 0 00000100:00100000:1.0:1789760767.911220:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760767.921423:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984046 is committed 00000100:00100000:1.0:1789760767.925769:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760767.925843:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565371904 00000100:00100000:3.0:1789760767.925852:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565371904 00000100:00100000:3.0:1789760767.925905:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706157693018 time 706172586468 state 0x0 ref 1 00000100:00100000:3.0:1789760767.925920:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706172846884 time 706172586468 state 0x1 ref 1 00000100:00100000:3.0:1789760767.925951:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706172846884 time 706186242695 state 0x0 ref 1 00000100:00100000:3.0:1789760767.925963:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565371904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760767.926009:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68562944, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0x20b30 00010000:00010000:3.0:1789760767.926019:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.926036:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1789760767.926041:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.926048:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68562944->68567039] (req 68562944->68567039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.926062:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674c8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68562944->68567039] (req 68562944->68567039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760767.931175:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984047 is committed 00002000:00010000:1.0:1789760767.947500:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68567040 -> 68571136 00002000:00010000:1.0:1789760767.947505:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760767 -> 1789760768 00002000:00010000:1.0:1789760767.947508:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760767 -> 1789760768 00002000:00010000:1.0:1789760767.947510:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133944 -> 133952 00010000:00010000:1.0:1789760767.947524:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947536:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947545:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947552:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760767.947557:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947565:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947583:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.947591:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674c8cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68567040->68571135] (req 68567040->68571135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.947683:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565372032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11729us (12418us total) trans 4294984048 rc 0/0 00000100:00100000:1.0:1789760767.947694:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16751 00000100:00100000:1.0:1789760767.947722:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706186503111 time 706195987644 state 0x2 ref 0 00000100:00100000:1.0:1789760767.955137:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760767.994353:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565372416 00000100:00100000:1.0:1789760767.994363:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565372416 00000100:00100000:1.0:1789760767.994419:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706216586613 time 706238737942 state 0x0 ref 1 00000100:00100000:1.0:1789760767.994433:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706238998358 time 706238737942 state 0x1 ref 1 00000100:00100000:1.0:1789760767.994470:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706238998358 time 706254761821 state 0x0 ref 1 00000100:00100000:1.0:1789760767.994483:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565372416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760767.994532:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68579328, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20b50 00010000:00010000:1.0:1789760767.994560:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674c8e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.994576:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760767.994581:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760767.994587:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674c8e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68579328->68583423] (req 68579328->68583423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.994600:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674c8e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68579328->68583423] (req 68579328->68583423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.002759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984051 is committed 00000100:00100000:3.0:1789760768.007281:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.024197:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984052 is committed 00002000:00010000:1.0:1789760768.024338:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68583424 -> 68587520 00002000:00010000:1.0:1789760768.024344:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133976 -> 133984 00010000:00010000:1.0:1789760768.024358:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024371:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024380:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024388:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.024392:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024401:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024421:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.024429:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c8e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68583424->68587519] (req 68583424->68587519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.024526:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565372544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17054us (17253us total) trans 4294984052 rc 0/0 00000100:00100000:1.0:1789760768.024536:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16755 00000100:00100000:1.0:1789760768.024545:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706255022237 time 706267748896 state 0x2 ref 0 00000100:00100000:1.0:1789760768.029007:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1789760768.029473:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674c8ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68587520->68591615] (req 68587520->68591615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.029491:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674c8ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68587520->68591615] (req 68587520->68591615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.039771:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984053 is committed 00000100:00100000:3.0:1789760768.045594:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.045744:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565372800 00000100:00100000:0.0:1789760768.046340:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565372800 00000100:00100000:0.0:1789760768.046399:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706268009312 time 706289652085 state 0x0 ref 1 00000100:00100000:0.0:1789760768.046415:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706289912501 time 706289652085 state 0x1 ref 1 00000100:00100000:0.0:1789760768.046454:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706289912501 time 706306746522 state 0x0 ref 1 00000100:00100000:0.0:1789760768.046468:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565372800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.046520:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68591616, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20b68 00010000:00010000:0.0:1789760768.046530:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.046547:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.046552:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.046560:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.046574:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.058593:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984054 is committed 00002000:00010000:1.0:1789760768.058788:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68591616 -> 68595712 00002000:00010000:1.0:1789760768.058793:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133992 -> 134000 00010000:00010000:1.0:1789760768.058819:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058833:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058842:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058850:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.058855:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058864:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058884:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.058893:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c8f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68591616->68595711] (req 68591616->68595711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.058996:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565372800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12525us (13407us total) trans 4294984054 rc 0/0 00000100:00100000:1.0:1789760768.059007:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16757 00000100:00100000:1.0:1789760768.059019:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706289912501 time 706306746522 state 0x2 ref 0 00000100:00100000:3.0:1789760768.065456:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.065542:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565372928 00000100:00100000:1.0:1789760768.065551:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565372928 00000100:00100000:1.0:1789760768.065603:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706289912501 time 706306746522 state 0x0 ref 1 00000100:00100000:1.0:1789760768.065618:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706307006938 time 706306746522 state 0x1 ref 1 00000100:00100000:1.0:1789760768.065651:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706307006938 time 706325943180 state 0x0 ref 1 00000100:00100000:1.0:1789760768.065664:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565372928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.065741:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68595712, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20b70 00010000:00010000:1.0:1789760768.065751:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674c8fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.065769:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.065773:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.065780:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674c8fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68595712->68599807] (req 68595712->68599807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.065800:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674c8fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68595712->68599807] (req 68595712->68599807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.077347:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984055 is committed 00000100:00100000:3.0:1789760768.082076:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760768.094656:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984056 is committed 00000100:00100000:3.0:1789760768.109138:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.109407:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565373184 00000100:00100000:1.0:1789760768.109416:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565373184 00000100:00100000:1.0:1789760768.109470:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706326203596 time 706345410940 state 0x0 ref 1 00000100:00100000:1.0:1789760768.109485:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706345671356 time 706345410940 state 0x1 ref 1 00000100:00100000:1.0:1789760768.109518:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706345671356 time 706369810419 state 0x0 ref 1 00000100:00100000:1.0:1789760768.109531:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565373184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.109578:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68603904, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20b80 00010000:00010000:1.0:1789760768.109588:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.109601:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.109605:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.109611:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.109623:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.119460:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984057 is committed 00002000:00010000:1.0:1789760768.119910:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68603904 -> 68608000 00002000:00010000:1.0:1789760768.119916:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134016 -> 134024 00010000:00010000:1.0:1789760768.119929:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120017:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120030:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120039:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.120044:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120054:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120074:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.120091:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674c90b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68603904->68607999] (req 68603904->68607999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.120188:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565373184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10654us (11055us total) trans 4294984057 rc 0/0 00000100:00100000:1.0:1789760768.120688:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16760 00000100:00100000:1.0:1789760768.120700:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706345671356 time 706369810419 state 0x2 ref 0 00000100:00100000:1.0:1789760768.124183:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.131039:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984058 is committed 00000100:00100000:3.0:1789760768.142873:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.148015:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984059 is committed 00002000:00010000:0.0:1789760768.153337:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68612096 -> 68616192 00002000:00010000:0.0:1789760768.153348:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134032 -> 134040 00010000:00010000:0.0:1789760768.153363:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153377:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153386:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153393:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.153398:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153408:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153430:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.153438:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674c919 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68612096->68616191] (req 68612096->68616191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.153588:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565373440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10497us (10718us total) trans 4294984059 rc 0/0 00000100:00100000:0.0:1789760768.153599:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16762 00000100:00100000:0.0:1789760768.153608:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706385599531 time 706403368385 state 0x2 ref 0 00000100:00100000:3.0:1789760768.162274:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.162566:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565373568 00000100:00100000:1.0:1789760768.162577:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565373568 00000100:00100000:1.0:1789760768.162635:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706385599531 time 706403368385 state 0x0 ref 1 00000100:00100000:1.0:1789760768.162650:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706403628801 time 706403368385 state 0x1 ref 1 00000100:00100000:1.0:1789760768.162684:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706403628801 time 706422976463 state 0x0 ref 1 00000100:00100000:1.0:1789760768.162696:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565373568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.162783:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68616192, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20b98 00010000:00010000:1.0:1789760768.162793:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.162818:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.162823:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.162829:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.162842:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.168027:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984060 is committed 00002000:00010000:1.0:1789760768.169869:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68616192 -> 68620288 00002000:00010000:1.0:1789760768.169879:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134040 -> 134048 00010000:00010000:1.0:1789760768.169970:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.169986:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.169995:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.170003:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.170008:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.170017:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.170038:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.170045:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674c920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68616192->68620287] (req 68616192->68620287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.170333:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565373568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7634us (8063us total) trans 4294984060 rc 0/0 00000100:00100000:1.0:1789760768.170345:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16763 00000100:00100000:1.0:1789760768.170354:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706403628801 time 706422976463 state 0x2 ref 0 00000100:00100000:1.0:1789760768.178105:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:1.0:1789760768.188601:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68620288 -> 68624384 00002000:00010000:1.0:1789760768.188607:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134048 -> 134056 00010000:00010000:1.0:1789760768.188621:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188636:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188646:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188654:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.188660:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188670:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188690:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.188698:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674c927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68620288->68624383] (req 68620288->68624383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.189286:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565373696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10926us (11185us total) trans 4294984061 rc 0/0 00000100:00100000:1.0:1789760768.189300:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16764 00000100:00100000:1.0:1789760768.189311:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706423236879 time 706438636168 state 0x2 ref 0 00000100:00100000:3.0:1789760768.198682:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.198893:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565373824 00000100:00100000:0.0:1789760768.198905:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565373824 00000100:00100000:0.0:1789760768.198973:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706423236879 time 706438636168 state 0x0 ref 1 00000100:00100000:0.0:1789760768.198989:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706438896584 time 706438636168 state 0x1 ref 1 00000100:00100000:0.0:1789760768.199020:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706438896584 time 706459312224 state 0x0 ref 1 00000100:00100000:0.0:1789760768.199033:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565373824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.199084:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68624384, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20ba8 00010000:00010000:0.0:1789760768.199094:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.199110:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.199115:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.199122:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.199135:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.204047:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789760768.209973:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68624384 -> 68628480 00002000:00010000:0.0:1789760768.209978:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134056 -> 134064 00010000:00010000:0.0:1789760768.209991:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210003:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210012:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210020:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.210024:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210034:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210053:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.210061:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c92e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68624384->68628479] (req 68624384->68628479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.210544:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565373824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11506us (11866us total) trans 4294984062 rc 0/0 00000100:00100000:0.0:1789760768.210556:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16765 00000100:00100000:0.0:1789760768.210566:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706438896584 time 706459312224 state 0x2 ref 0 00000100:00100000:3.0:1789760768.219895:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.220615:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565373952 00000100:00100000:1.0:1789760768.220626:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565373952 00000100:00100000:1.0:1789760768.220683:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706438896584 time 706459312224 state 0x0 ref 1 00000100:00100000:1.0:1789760768.220700:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706459572640 time 706459312224 state 0x1 ref 1 00000100:00100000:1.0:1789760768.220916:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706459572640 time 706481207267 state 0x0 ref 1 00000100:00100000:1.0:1789760768.220931:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565373952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.220981:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68628480, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bb0 00010000:00010000:1.0:1789760768.220990:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.221005:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.221009:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.221015:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.221029:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.233030:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984063 is committed 00002000:00010000:1.0:1789760768.233416:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68628480 -> 68632576 00002000:00010000:1.0:1789760768.233422:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134064 -> 134072 00010000:00010000:1.0:1789760768.233434:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233445:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233453:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233460:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.233465:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233474:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233492:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.233500:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674c935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68628480->68632575] (req 68628480->68632575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.233597:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565373952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12665us (13707us total) trans 4294984063 rc 0/0 00000100:00100000:1.0:1789760768.233608:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16766 00000100:00100000:1.0:1789760768.233617:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706459572640 time 706481207267 state 0x2 ref 0 00000100:00100000:1.0:1789760768.238494:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760768.249055:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984064 is committed 00000100:00100000:3.0:1789760768.258420:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.261574:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374208 00000100:00100000:0.0:1789760768.261589:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374208 00000100:00100000:0.0:1789760768.261654:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706481467683 time 706498973778 state 0x0 ref 1 00000100:00100000:0.0:1789760768.261670:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706499234194 time 706498973778 state 0x1 ref 1 00000100:00100000:0.0:1789760768.261769:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706499234194 time 706522060055 state 0x0 ref 1 00000100:00100000:0.0:1789760768.261784:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.261839:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68636672, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bc0 00010000:00010000:0.0:1789760768.261848:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.261864:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.261869:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.261876:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.261900:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.268742:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984065 is committed 00002000:00010000:0.0:1789760768.268882:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68636672 -> 68640768 00002000:00010000:0.0:1789760768.268888:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134080 -> 134088 00010000:00010000:0.0:1789760768.268902:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268914:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268922:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268930:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.268935:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268944:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268964:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.268972:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c943 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68636672->68640767] (req 68636672->68640767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.270507:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8717us (12087us total) trans 4294984065 rc 0/0 00000100:00100000:0.0:1789760768.270520:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16768 00000100:00100000:0.0:1789760768.270530:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706499234194 time 706522060055 state 0x2 ref 0 00000100:00100000:3.0:1789760768.283829:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.284144:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374336 00000100:00100000:1.0:1789760768.284162:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374336 00000100:00100000:1.0:1789760768.284217:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706499234194 time 706522060055 state 0x0 ref 1 00000100:00100000:1.0:1789760768.284233:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706522320471 time 706522060055 state 0x1 ref 1 00000100:00100000:1.0:1789760768.284268:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706522320471 time 706544559311 state 0x0 ref 1 00000100:00100000:1.0:1789760768.284280:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.284327:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68640768, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bc8 00010000:00010000:1.0:1789760768.284336:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.284353:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.284358:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.284377:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.284391:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.291204:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984066 is committed 00002000:00010000:1.0:1789760768.291338:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68640768 -> 68644864 00002000:00010000:1.0:1789760768.291343:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134088 -> 134096 00010000:00010000:1.0:1789760768.291359:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291380:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291389:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291396:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.291402:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291411:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291431:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.291439:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c94a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68640768->68644863] (req 68640768->68644863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.291537:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7253us (7712us total) trans 4294984066 rc 0/0 00000100:00100000:1.0:1789760768.291547:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16769 00000100:00100000:1.0:1789760768.291558:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706522320471 time 706544559311 state 0x2 ref 0 00000100:00100000:1.0:1789760768.308343:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760768.319679:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68644864 -> 68648960 00002000:00010000:0.0:1789760768.319688:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134096 -> 134104 00010000:00010000:0.0:1789760768.319701:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319733:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319743:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319750:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.319756:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319765:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319784:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.319792:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674c951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68644864->68648959] (req 68644864->68648959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.319954:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11365us (11615us total) trans 4294984067 rc 0/0 00000100:00100000:0.0:1789760768.319969:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16770 00000100:00100000:0.0:1789760768.319978:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706544819727 time 706568865331 state 0x2 ref 0 00000100:00100000:3.0:1789760768.325497:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.325763:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374592 00000100:00100000:0.0:1789760768.325773:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374592 00000100:00100000:0.0:1789760768.325836:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706544819727 time 706568865331 state 0x0 ref 1 00000100:00100000:0.0:1789760768.325852:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706569125747 time 706568865331 state 0x1 ref 1 00000100:00100000:0.0:1789760768.325884:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706569125747 time 706586176061 state 0x0 ref 1 00000100:00100000:0.0:1789760768.325897:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565374592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.325946:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68648960, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bd8 00010000:00010000:0.0:1789760768.325955:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.325971:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.325976:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.325983:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.325998:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760768.334054:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68648960 -> 68653056 00002000:00010000:0.0:1789760768.334064:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134104 -> 134112 00010000:00010000:0.0:1789760768.334078:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334092:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334102:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334110:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.334116:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334126:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334146:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.334154:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68648960->68653055] (req 68648960->68653055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.334261:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565374592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8361us (8768us total) trans 4294984068 rc 0/0 00000100:00100000:0.0:1789760768.334272:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16771 00000100:00100000:0.0:1789760768.334282:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706569125747 time 706586176061 state 0x2 ref 0 00000100:00100000:3.0:1789760768.342253:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.342432:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374720 00000100:00100000:1.0:1789760768.342442:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374720 00000100:00100000:1.0:1789760768.342499:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706569125747 time 706586176061 state 0x0 ref 1 00000100:00100000:1.0:1789760768.342514:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706586436477 time 706586176061 state 0x1 ref 1 00000100:00100000:1.0:1789760768.342545:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706586436477 time 706602837188 state 0x0 ref 1 00000100:00100000:1.0:1789760768.342557:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.342602:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68653056, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20be0 00010000:00010000:1.0:1789760768.342612:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.342627:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.342631:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.342638:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.342652:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760768.361786:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68653056 -> 68657152 00002000:00010000:0.0:1789760768.361796:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134112 -> 134120 00010000:00010000:0.0:1789760768.361819:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361833:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361843:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361850:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.361854:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361864:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361883:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.361891:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674c95f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68653056->68657151] (req 68653056->68657151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.362047:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19486us (19798us total) trans 4294984069 rc 0/0 00000100:00100000:0.0:1789760768.362062:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16772 00000100:00100000:0.0:1789760768.362072:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706586436477 time 706602837188 state 0x2 ref 0 00000100:00100000:3.0:1789760768.365325:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.365497:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374848 00000100:00100000:0.0:1789760768.365506:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374848 00000100:00100000:0.0:1789760768.365573:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706586436477 time 706602837188 state 0x0 ref 1 00000100:00100000:0.0:1789760768.365587:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706603097604 time 706602837188 state 0x1 ref 1 00000100:00100000:0.0:1789760768.365618:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706603097604 time 706625909751 state 0x0 ref 1 00000100:00100000:0.0:1789760768.365630:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565374848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.365675:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68657152, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20be8 00010000:00010000:0.0:1789760768.365685:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.365700:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.365734:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.365741:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.365754:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760768.371453:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68657152 -> 68661248 00002000:00010000:0.0:1789760768.371459:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134120 -> 134128 00010000:00010000:0.0:1789760768.371473:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371487:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371496:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371503:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.371508:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371516:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371533:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.371540:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68657152->68661247] (req 68657152->68661247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.371635:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565374848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6002us (6314us total) trans 4294984070 rc 0/0 00000100:00100000:0.0:1789760768.371645:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16773 00000100:00100000:0.0:1789760768.371654:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706603097604 time 706625909751 state 0x2 ref 0 00000100:00100000:3.0:1789760768.379233:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.379472:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565374976 00000100:00100000:0.0:1789760768.379482:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565374976 00000100:00100000:0.0:1789760768.379538:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706603097604 time 706625909751 state 0x0 ref 1 00000100:00100000:0.0:1789760768.379554:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706626170167 time 706625909751 state 0x1 ref 1 00000100:00100000:0.0:1789760768.379579:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706626170167 time 706639870906 state 0x0 ref 1 00000100:00100000:0.0:1789760768.379593:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.379644:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68661248, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bf0 00010000:00010000:0.0:1789760768.379653:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.379669:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.379673:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.379680:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.379694:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.393502:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984071 is committed 00002000:00010000:0.0:1789760768.393735:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68661248 -> 68665344 00002000:00010000:0.0:1789760768.393741:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134128 -> 134136 00010000:00010000:0.0:1789760768.393754:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393773:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393782:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393788:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.393793:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393814:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393832:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.393839:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c96d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68661248->68665343] (req 68661248->68665343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.393926:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565374976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14332us (14699us total) trans 4294984071 rc 0/0 00000100:00100000:0.0:1789760768.393936:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16774 00000100:00100000:0.0:1789760768.394119:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706626170167 time 706639870906 state 0x2 ref 0 00000100:00100000:3.0:1789760768.398763:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.399795:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565375104 00000100:00100000:0.0:1789760768.399818:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565375104 00000100:00100000:0.0:1789760768.399955:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706626170167 time 706639870906 state 0x0 ref 1 00000100:00100000:0.0:1789760768.399970:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706640131322 time 706639870906 state 0x1 ref 1 00000100:00100000:0.0:1789760768.400005:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706640131322 time 706660296055 state 0x0 ref 1 00000100:00100000:0.0:1789760768.400019:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565375104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.400073:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68665344, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20bf8 00010000:00010000:0.0:1789760768.400083:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.400099:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.400105:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.400111:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.400125:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.407495:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984072 is committed 00002000:00010000:0.0:1789760768.416331:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68665344 -> 68669440 00002000:00010000:0.0:1789760768.416342:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134136 -> 134144 00010000:00010000:0.0:1789760768.416357:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416371:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416386:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416394:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.416398:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416407:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416427:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.416434:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c974 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68665344->68669439] (req 68665344->68669439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.416602:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565375104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16581us (17891us total) trans 4294984072 rc 0/0 00000100:00100000:0.0:1789760768.416613:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16775 00000100:00100000:0.0:1789760768.416623:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706640131322 time 706660296055 state 0x2 ref 0 00000100:00100000:3.0:1789760768.426143:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.428109:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565375232 00000100:00100000:0.0:1789760768.428124:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565375232 00000100:00100000:0.0:1789760768.428189:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706640131322 time 706660296055 state 0x0 ref 1 00000100:00100000:0.0:1789760768.428205:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706660556471 time 706660296055 state 0x1 ref 1 00000100:00100000:0.0:1789760768.428241:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706660556471 time 706688533312 state 0x0 ref 1 00000100:00100000:0.0:1789760768.428255:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565375232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.428304:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68669440, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c00 00010000:00010000:0.0:1789760768.428313:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c97b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.428329:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.428333:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.428340:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c97b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68669440->68673535] (req 68669440->68673535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.428353:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674c97b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68669440->68673535] (req 68669440->68673535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.444088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984073 is committed 00000100:00100000:0.0:1789760768.461383:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565375360 00000100:00100000:0.0:1789760768.461393:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565375360 00000100:00100000:0.0:1789760768.461448:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706660556471 time 706688533312 state 0x0 ref 1 00000100:00100000:0.0:1789760768.461464:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706688793728 time 706688533312 state 0x1 ref 1 00000100:00100000:0.0:1789760768.461497:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706688793728 time 706721788695 state 0x0 ref 1 00000100:00100000:0.0:1789760768.461511:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565375360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.461559:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68673536, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c08 00010000:00010000:0.0:1789760768.461569:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.461585:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.461589:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.461596:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.461611:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.475253:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984074 is committed 00002000:00010000:0.0:1789760768.478628:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68673536 -> 68677632 00002000:00010000:0.0:1789760768.478637:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134152 -> 134160 00010000:00010000:0.0:1789760768.478652:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478665:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478673:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478681:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.478686:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478695:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478736:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.478744:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68673536->68677631] (req 68673536->68677631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.479046:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565375360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17533us (17804us total) trans 4294984074 rc 0/0 00000100:00100000:0.0:1789760768.479057:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16777 00000100:00100000:0.0:1789760768.479066:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706688793728 time 706721788695 state 0x2 ref 0 00000100:00100000:0.0:1789760768.485778:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760768.495258:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984075 is committed 00000100:00100000:3.0:1789760768.503195:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.503275:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565375616 00000100:00100000:0.0:1789760768.503286:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565375616 00000100:00100000:0.0:1789760768.503339:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706722049111 time 706746355890 state 0x0 ref 1 00000100:00100000:0.0:1789760768.503354:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706746616306 time 706746355890 state 0x1 ref 1 00000100:00100000:0.0:1789760768.503389:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706746616306 time 706763681917 state 0x0 ref 1 00000100:00100000:0.0:1789760768.503402:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565375616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.503449:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68681728, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c18 00010000:00010000:0.0:1789760768.503458:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.503477:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.503482:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.503487:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.503500:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.512085:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984076 is committed 00002000:00010000:0.0:1789760768.512373:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68681728 -> 68685824 00002000:00010000:0.0:1789760768.512378:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134168 -> 134176 00010000:00010000:0.0:1789760768.512392:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512404:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512413:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512421:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.512426:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512434:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512460:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.512468:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c990 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68681728->68685823] (req 68681728->68685823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.512564:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565375616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9158us (9374us total) trans 4294984076 rc 0/0 00000100:00100000:0.0:1789760768.512576:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16779 00000100:00100000:0.0:1789760768.512586:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706746616306 time 706763681917 state 0x2 ref 0 00000100:00100000:1.0:1789760768.519247:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.521795:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565375744 00000100:00100000:0.0:1789760768.521820:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565375744 00000100:00100000:0.0:1789760768.522105:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706746616306 time 706763681917 state 0x0 ref 1 00000100:00100000:0.0:1789760768.522120:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706763942333 time 706763681917 state 0x1 ref 1 00000100:00100000:0.0:1789760768.522155:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706763942333 time 706782447236 state 0x0 ref 1 00000100:00100000:0.0:1789760768.522169:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565375744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.522218:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68685824, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c20 00010000:00010000:0.0:1789760768.522228:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.522244:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.522249:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.522256:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.522271:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.529594:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984077 is committed 00002000:00010000:0.0:1789760768.529986:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68685824 -> 68689920 00002000:00010000:0.0:1789760768.529991:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134176 -> 134184 00010000:00010000:0.0:1789760768.530005:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530018:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530028:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530035:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.530040:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530050:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530071:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.530096:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c997 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68685824->68689919] (req 68685824->68689919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.530270:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565375744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8100us (11027us total) trans 4294984077 rc 0/0 00000100:00100000:0.0:1789760768.530281:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16780 00000100:00100000:0.0:1789760768.530291:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706763942333 time 706782447236 state 0x2 ref 0 00000100:00100000:1.0:1789760768.539277:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.550540:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984078 is committed 00000100:00100000:0.0:1789760768.561139:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565376000 00000100:00100000:0.0:1789760768.561152:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565376000 00000100:00100000:0.0:1789760768.561223:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706782707652 time 706799865313 state 0x0 ref 1 00000100:00100000:0.0:1789760768.561238:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706800125729 time 706799865313 state 0x1 ref 1 00000100:00100000:0.0:1789760768.561273:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706800125729 time 706821565185 state 0x0 ref 1 00000100:00100000:0.0:1789760768.561287:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565376000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.561336:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68694016, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c30 00010000:00010000:0.0:1789760768.561345:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.561361:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.561365:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.561371:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.561386:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.570201:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984079 is committed 00002000:00010000:1.0:1789760768.570330:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68694016 -> 68698112 00002000:00010000:1.0:1789760768.570336:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134192 -> 134200 00010000:00010000:1.0:1789760768.570350:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570363:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570372:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570380:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.570385:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570394:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570413:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.570422:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674c9a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68694016->68698111] (req 68694016->68698111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.570561:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565376000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9272us (9664us total) trans 4294984079 rc 0/0 00000100:00100000:1.0:1789760768.570572:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16782 00000100:00100000:1.0:1789760768.570583:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706800125729 time 706821565185 state 0x2 ref 0 00000100:00100000:1.0:1789760768.582658:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.582759:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565376128 00000100:00100000:0.0:1789760768.582768:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565376128 00000100:00100000:0.0:1789760768.582835:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706800125729 time 706821565185 state 0x0 ref 1 00000100:00100000:0.0:1789760768.582851:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706821825601 time 706821565185 state 0x1 ref 1 00000100:00100000:0.0:1789760768.582881:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706821825601 time 706843173069 state 0x0 ref 1 00000100:00100000:0.0:1789760768.582894:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.582941:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68698112, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c38 00010000:00010000:0.0:1789760768.582951:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.582966:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.582972:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.582978:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.583002:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.590497:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984080 is committed 00002000:00010000:0.0:1789760768.590675:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68698112 -> 68702208 00002000:00010000:0.0:1789760768.590681:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134200 -> 134208 00010000:00010000:0.0:1789760768.590694:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590723:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590732:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590740:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.590745:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590754:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590775:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.590783:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674c9ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68698112->68702207] (req 68698112->68702207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.590945:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8048us (8292us total) trans 4294984080 rc 0/0 00000100:00100000:0.0:1789760768.590957:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16783 00000100:00100000:0.0:1789760768.590967:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706821825601 time 706843173069 state 0x2 ref 0 00000100:00100000:0.0:1789760768.595284:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.603531:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984081 is committed 00000100:00100000:1.0:1789760768.613492:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565376384 00000100:00100000:1.0:1789760768.613505:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565376384 00000100:00100000:1.0:1789760768.613563:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706843433485 time 706856506949 state 0x0 ref 1 00000100:00100000:1.0:1789760768.613582:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706856767365 time 706856506949 state 0x1 ref 1 00000100:00100000:1.0:1789760768.613615:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706856767365 time 706873905961 state 0x0 ref 1 00000100:00100000:1.0:1789760768.613627:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.613682:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68706304, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c48 00010000:00010000:1.0:1789760768.613692:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.613875:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.613880:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.613886:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.613900:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.621446:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984082 is committed 00002000:00010000:1.0:1789760768.621864:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68706304 -> 68710400 00002000:00010000:1.0:1789760768.621869:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134216 -> 134224 00010000:00010000:1.0:1789760768.621882:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621895:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621903:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621911:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.621915:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621926:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621945:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.621953:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674c9ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68706304->68710399] (req 68706304->68710399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.622053:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8424us (9059us total) trans 4294984082 rc 0/0 00000100:00100000:1.0:1789760768.622064:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16785 00000100:00100000:1.0:1789760768.622074:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706856767365 time 706873905961 state 0x2 ref 0 00000100:00100000:1.0:1789760768.626655:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.628261:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565376512 00000100:00100000:0.0:1789760768.628276:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565376512 00000100:00100000:0.0:1789760768.628339:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706856767365 time 706873905961 state 0x0 ref 1 00000100:00100000:0.0:1789760768.628691:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706874166377 time 706873905961 state 0x1 ref 1 00000100:00100000:0.0:1789760768.628811:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706874166377 time 706889090989 state 0x0 ref 1 00000100:00100000:0.0:1789760768.628828:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.628881:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68710400, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c50 00010000:00010000:0.0:1789760768.628891:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674c9c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.628907:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:0.0:1789760768.628911:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.628918:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674c9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68710400->68714495] (req 68710400->68714495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.628931:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674c9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68710400->68714495] (req 68710400->68714495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.634670:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984083 is committed 00000100:00100000:0.0:1789760768.640072:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760768.650537:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68714496 -> 68718592 00002000:00010000:0.0:1789760768.650543:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134232 -> 134240 00010000:00010000:0.0:1789760768.650557:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650569:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650579:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650586:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.650653:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650664:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650683:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.650690:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674c9c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68714496->68718591] (req 68714496->68718591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.651068:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565376640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8439us (10999us total) trans 4294984084 rc 0/0 00000100:00100000:0.0:1789760768.651079:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16787 00000100:00100000:0.0:1789760768.651088:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706889351405 time 706902897065 state 0x2 ref 0 00000100:00100000:3.0:1789760768.665897:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.666053:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565376768 00000100:00100000:1.0:1789760768.666063:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565376768 00000100:00100000:1.0:1789760768.666116:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706889351405 time 706902897065 state 0x0 ref 1 00000100:00100000:1.0:1789760768.666132:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706903157481 time 706902897065 state 0x1 ref 1 00000100:00100000:1.0:1789760768.666224:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706903157481 time 706926515355 state 0x0 ref 1 00000100:00100000:1.0:1789760768.666237:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565376768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.666348:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68718592, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c60 00010000:00010000:1.0:1789760768.666358:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.666374:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.666378:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.666384:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.666398:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760768.676500:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68718592 -> 68722688 00002000:00010000:1.0:1789760768.676505:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134240 -> 134248 00010000:00010000:1.0:1789760768.676519:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676533:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676542:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676549:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.676554:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676563:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676584:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.676591:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674c9cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68718592->68722687] (req 68718592->68722687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.676691:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565376768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10451us (10799us total) trans 4294984085 rc 0/0 00000100:00100000:1.0:1789760768.676833:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16788 00000100:00100000:1.0:1789760768.676844:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706903157481 time 706926515355 state 0x2 ref 0 00000100:00100000:1.0:1789760768.682172:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.690747:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984086 is committed 00000100:00100000:0.0:1789760768.698300:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760768.707592:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68726784 -> 68730880 00002000:00010000:0.0:1789760768.707597:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134256 -> 134264 00010000:00010000:0.0:1789760768.707610:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707624:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707632:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707639:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.707644:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707652:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707676:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.707683:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674c9dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68726784->68730879] (req 68726784->68730879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.708097:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565377024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8193us (9801us total) trans 4294984087 rc 0/0 00000100:00100000:0.0:1789760768.708108:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16790 00000100:00100000:0.0:1789760768.708118:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706942998288 time 706960177566 state 0x2 ref 0 00000100:00100000:3.0:1789760768.716810:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.717427:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565377152 00000100:00100000:1.0:1789760768.717439:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565377152 00000100:00100000:1.0:1789760768.717495:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706942998288 time 706960177566 state 0x0 ref 1 00000100:00100000:1.0:1789760768.717511:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706960437982 time 706960177566 state 0x1 ref 1 00000100:00100000:1.0:1789760768.717548:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706960437982 time 706977840211 state 0x0 ref 1 00000100:00100000:1.0:1789760768.717561:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565377152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.717606:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68730880, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c78 00010000:00010000:1.0:1789760768.717616:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.717631:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1789760768.717636:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.717643:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.717658:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760768.723815:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68730880 -> 68734976 00002000:00010000:1.0:1789760768.723821:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134264 -> 134272 00010000:00010000:1.0:1789760768.723835:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.723853:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.723861:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.723868:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.723873:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.723881:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.724006:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.724015:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674c9e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68730880->68734975] (req 68730880->68734975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.724217:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565377152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6652us (7421us total) trans 4294984088 rc 0/0 00000100:00100000:1.0:1789760768.724228:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16791 00000100:00100000:1.0:1789760768.724238:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706960437982 time 706977840211 state 0x2 ref 0 00000100:00100000:1.0:1789760768.732779:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.741825:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984089 is committed 00000100:00100000:0.0:1789760768.747502:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760768.754015:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68739072 -> 68743168 00002000:00010000:0.0:1789760768.754020:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134280 -> 134288 00010000:00010000:0.0:1789760768.754033:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754045:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754053:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754060:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.754065:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754073:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754093:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.754101:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674c9f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68739072->68743167] (req 68739072->68743167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.754497:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565377408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6740us (6996us total) trans 4294984090 rc 0/0 00000100:00100000:0.0:1789760768.754509:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16793 00000100:00100000:0.0:1789760768.754520:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706994137042 time 707007996900 state 0x2 ref 0 00000100:00100000:1.0:1789760768.761263:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565377536 00000100:00100000:1.0:1789760768.761272:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565377536 00000100:00100000:1.0:1789760768.761324:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 706994137042 time 707007996900 state 0x0 ref 1 00000100:00100000:1.0:1789760768.761338:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707008257316 time 707007996900 state 0x1 ref 1 00000100:00100000:1.0:1789760768.761366:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707008257316 time 707021659125 state 0x0 ref 1 00000100:00100000:1.0:1789760768.761377:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565377536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.761420:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68743168, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20c90 00010000:00010000:1.0:1789760768.761443:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.761459:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760768.761463:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.761469:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.761483:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760768.772280:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68743168 -> 68747264 00002000:00010000:1.0:1789760768.772285:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134288 -> 134296 00010000:00010000:1.0:1789760768.772300:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772312:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772322:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772329:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.772334:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772343:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772362:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.772370:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674c9f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68743168->68747263] (req 68743168->68747263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.772476:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565377536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11094us (12102us total) trans 4294984091 rc 0/0 00000100:00100000:1.0:1789760768.772486:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16794 00000100:00100000:1.0:1789760768.772496:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707008257316 time 707021659125 state 0x2 ref 0 00000100:00100000:1.0:1789760768.781235:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.789794:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984092 is committed 00000100:00100000:0.0:1789760768.796526:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.803312:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984093 is committed 00000100:00100000:3.0:1789760768.809045:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760768.809188:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565377920 00000100:00100000:1.0:1789760768.809200:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565377920 00000100:00100000:1.0:1789760768.809256:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707042937834 time 707057042248 state 0x0 ref 1 00000100:00100000:1.0:1789760768.809275:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707057302664 time 707057042248 state 0x1 ref 1 00000100:00100000:1.0:1789760768.809305:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707057302664 time 707069596584 state 0x0 ref 1 00000100:00100000:1.0:1789760768.809317:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565377920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.809363:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68755456, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20ca8 00010000:00010000:1.0:1789760768.809373:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ca0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.809389:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760768.809393:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.809400:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ca0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68755456->68759551] (req 68755456->68759551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.809413:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ca0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68755456->68759551] (req 68755456->68759551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.815256:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984094 is committed 00000100:00100000:1.0:1789760768.824457:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.836483:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984095 is committed 00002000:00010000:3.0:1789760768.836619:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68759552 -> 68763648 00002000:00010000:3.0:1789760768.836624:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134320 -> 134328 00010000:00010000:3.0:1789760768.836638:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836651:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836659:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836666:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760768.836671:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836680:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836722:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.836731:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ca15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68759552->68763647] (req 68759552->68763647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.836897:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565378048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12030us (12446us total) trans 4294984095 rc 0/0 00000100:00100000:3.0:1789760768.836908:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16798 00000100:00100000:3.0:1789760768.836918:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707069857000 time 707084993936 state 0x2 ref 0 00000100:00100000:1.0:1789760768.844029:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.855406:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984096 is committed 00002000:00010000:0.0:1789760768.855675:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68763648 -> 68767744 00002000:00010000:0.0:1789760768.855680:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134328 -> 134336 00010000:00010000:0.0:1789760768.855694:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855742:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855752:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855759:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.855763:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855772:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855792:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.855807:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ca1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68763648->68767743] (req 68763648->68767743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.856010:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565378176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11544us (11867us total) trans 4294984096 rc 0/0 00000100:00100000:0.0:1789760768.856022:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16799 00000100:00100000:0.0:1789760768.856030:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707085254352 time 707104622377 state 0x2 ref 0 00000100:00100000:1.0:1789760768.865752:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565378304 00000100:00100000:1.0:1789760768.865762:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565378304 00000100:00100000:1.0:1789760768.865824:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707085254352 time 707104622377 state 0x0 ref 1 00000100:00100000:1.0:1789760768.865839:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707104882793 time 707104622377 state 0x1 ref 1 00000100:00100000:1.0:1789760768.865873:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707104882793 time 707126165001 state 0x0 ref 1 00000100:00100000:1.0:1789760768.865894:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565378304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.865943:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68767744, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20cc0 00010000:00010000:1.0:1789760768.865952:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.865968:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760768.865972:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.865979:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.865992:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760768.874565:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984097 is committed 00002000:00010000:1.0:1789760768.874842:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68767744 -> 68771840 00002000:00010000:1.0:1789760768.874847:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134336 -> 134344 00010000:00010000:1.0:1789760768.874861:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.874875:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.874884:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.874968:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.874973:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.874983:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.875005:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.875013:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ca23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68767744->68771839] (req 68767744->68771839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.875216:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565378304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9327us (9807us total) trans 4294984097 rc 0/0 00000100:00100000:1.0:1789760768.875228:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16800 00000100:00100000:1.0:1789760768.875240:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707104882793 time 707126165001 state 0x2 ref 0 00000100:00100000:1.0:1789760768.879574:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760768.879665:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565378432 00000100:00100000:3.0:1789760768.879675:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565378432 00000100:00100000:3.0:1789760768.879978:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707104882793 time 707126165001 state 0x0 ref 1 00000100:00100000:3.0:1789760768.879996:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707126425417 time 707126165001 state 0x1 ref 1 00000100:00100000:3.0:1789760768.880059:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707126425417 time 707140350269 state 0x0 ref 1 00000100:00100000:3.0:1789760768.880074:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565378432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760768.880120:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68771840, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20cc8 00010000:00010000:3.0:1789760768.880128:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.880160:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1789760768.880164:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760768.880171:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.880185:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.886025:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984098 is committed 00002000:00010000:0.0:1789760768.886266:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68771840 -> 68775936 00002000:00010000:0.0:1789760768.886365:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134344 -> 134352 00010000:00010000:0.0:1789760768.886380:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886395:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886405:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886412:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.886417:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886427:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886448:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.886457:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ca2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68771840->68775935] (req 68771840->68775935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.886642:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565378432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6566us (7071us total) trans 4294984098 rc 0/0 00000100:00100000:0.0:1789760768.886653:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16801 00000100:00100000:0.0:1789760768.886664:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707126425417 time 707140350269 state 0x2 ref 0 00000100:00100000:0.0:1789760768.896598:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.904478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984099 is committed 00000100:00100000:1.0:1789760768.914357:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565378688 00000100:00100000:1.0:1789760768.914366:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565378688 00000100:00100000:1.0:1789760768.914424:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707140610685 time 707157129188 state 0x0 ref 1 00000100:00100000:1.0:1789760768.914440:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707157389604 time 707157129188 state 0x1 ref 1 00000100:00100000:1.0:1789760768.914546:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707157389604 time 707174837069 state 0x0 ref 1 00000100:00100000:1.0:1789760768.914561:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565378688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.914610:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68780032, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20cd8 00010000:00010000:1.0:1789760768.914619:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.914638:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760768.914643:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.914649:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.914664:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.920765:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984100 is committed 00002000:00010000:1.0:1789760768.921020:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68780032 -> 68784128 00002000:00010000:1.0:1789760768.921026:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134360 -> 134368 00010000:00010000:1.0:1789760768.921042:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921055:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921064:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921150:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.921157:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921167:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921189:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.921198:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ca38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68780032->68784127] (req 68780032->68784127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.921292:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565378688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6729us (7038us total) trans 4294984100 rc 0/0 00000100:00100000:1.0:1789760768.921302:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16803 00000100:00100000:1.0:1789760768.921312:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707157389604 time 707174837069 state 0x2 ref 0 00000100:00100000:1.0:1789760768.928532:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.929236:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565378816 00000100:00100000:0.0:1789760768.929246:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565378816 00000100:00100000:0.0:1789760768.929300:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707157389604 time 707174837069 state 0x0 ref 1 00000100:00100000:0.0:1789760768.929316:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707175097485 time 707174837069 state 0x1 ref 1 00000100:00100000:0.0:1789760768.929385:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707175097485 time 707189676253 state 0x0 ref 1 00000100:00100000:0.0:1789760768.929399:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565378816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.929444:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68784128, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0x20ce0 00010000:00010000:0.0:1789760768.929463:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.929479:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760768.929484:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.929490:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.929504:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.935573:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984101 is committed 00002000:00010000:0.0:1789760768.935765:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68784128 -> 68788224 00002000:00010000:0.0:1789760768.935770:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760768 -> 1789760769 00002000:00010000:0.0:1789760768.935773:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760768 -> 1789760769 00002000:00010000:0.0:1789760768.935776:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134368 -> 134376 00010000:00010000:0.0:1789760768.935789:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936286:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936295:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936302:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.936306:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936314:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936335:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.936342:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ca3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68784128->68788223] (req 68784128->68788223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.936758:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565378816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7307us (8180us total) trans 4294984101 rc 0/0 00000100:00100000:0.0:1789760768.936768:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16804 00000100:00100000:0.0:1789760768.936777:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707175097485 time 707189676253 state 0x2 ref 0 00000100:00100000:0.0:1789760768.948277:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760768.953692:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984102 is committed 00000100:00100000:1.0:1789760768.963103:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379072 00000100:00100000:1.0:1789760768.963115:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379072 00000100:00100000:1.0:1789760768.963188:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707189936669 time 707208821127 state 0x0 ref 1 00000100:00100000:1.0:1789760768.963205:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707209081543 time 707208821127 state 0x1 ref 1 00000100:00100000:1.0:1789760768.963248:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707209081543 time 707223539172 state 0x0 ref 1 00000100:00100000:1.0:1789760768.963260:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565379072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760768.963308:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68792320, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20cf0 00010000:00010000:1.0:1789760768.963317:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.963332:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760768.963337:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.963343:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.963356:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.971548:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984103 is committed 00002000:00010000:1.0:1789760768.971995:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68792320 -> 68796416 00002000:00010000:1.0:1789760768.972001:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134384 -> 134392 00010000:00010000:1.0:1789760768.972015:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972029:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972038:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972047:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760768.972051:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972066:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972269:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.972278:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ca4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68792320->68796415] (req 68792320->68796415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.972563:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565379072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9299us (9561us total) trans 4294984103 rc 0/0 00000100:00100000:1.0:1789760768.972573:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16806 00000100:00100000:1.0:1789760768.972583:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707209081543 time 707223539172 state 0x2 ref 0 00000100:00100000:1.0:1789760768.978485:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760768.978647:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379200 00000100:00100000:0.0:1789760768.978657:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379200 00000100:00100000:0.0:1789760768.978745:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707209081543 time 707223539172 state 0x0 ref 1 00000100:00100000:0.0:1789760768.978761:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707223799588 time 707223539172 state 0x1 ref 1 00000100:00100000:0.0:1789760768.978794:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707223799588 time 707239086531 state 0x0 ref 1 00000100:00100000:0.0:1789760768.978815:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565379200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760768.978864:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68796416, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20cf8 00010000:00010000:0.0:1789760768.978874:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.979371:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760768.979377:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760768.979496:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.979513:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.984043:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984104 is committed 00002000:00010000:0.0:1789760768.984636:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68796416 -> 68800512 00002000:00010000:0.0:1789760768.984642:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134392 -> 134400 00010000:00010000:0.0:1789760768.984655:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984668:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984678:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984685:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760768.984691:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984700:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984738:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.984746:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ca54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68796416->68800511] (req 68796416->68800511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.985007:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565379200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6189us (6527us total) trans 4294984104 rc 0/0 00000100:00100000:0.0:1789760768.985018:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16807 00000100:00100000:0.0:1789760768.985029:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707223799588 time 707239086531 state 0x2 ref 0 00000100:00100000:0.0:1789760768.988855:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760768.997489:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984105 is committed 00000100:00100000:1.0:1789760769.012745:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379456 00000100:00100000:1.0:1789760769.012755:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379456 00000100:00100000:1.0:1789760769.012818:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707239346947 time 707249585289 state 0x0 ref 1 00000100:00100000:1.0:1789760769.012831:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707249845705 time 707249585289 state 0x1 ref 1 00000100:00100000:1.0:1789760769.012862:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707249845705 time 707273155034 state 0x0 ref 1 00000100:00100000:1.0:1789760769.012874:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565379456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.012921:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68804608, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d08 00010000:00010000:1.0:1789760769.012931:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ca62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.012946:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.012950:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.012956:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ca62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68804608->68808703] (req 68804608->68808703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.012970:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ca62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68804608->68808703] (req 68804608->68808703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.021731:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984106 is committed 00000100:00100000:1.0:1789760769.034291:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.034467:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379584 00000100:00100000:0.0:1789760769.034478:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379584 00000100:00100000:0.0:1789760769.034535:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707249845705 time 707273155034 state 0x0 ref 1 00000100:00100000:0.0:1789760769.034563:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707273415450 time 707273155034 state 0x1 ref 1 00000100:00100000:0.0:1789760769.034592:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707273415450 time 707294884288 state 0x0 ref 1 00000100:00100000:0.0:1789760769.034605:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565379584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.034659:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68808704, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d10 00010000:00010000:0.0:1789760769.034669:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.034686:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.034691:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.034698:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.034751:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.040453:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984107 is committed 00002000:00010000:0.0:1789760769.042317:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68808704 -> 68812800 00002000:00010000:0.0:1789760769.042326:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134416 -> 134424 00010000:00010000:0.0:1789760769.042340:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042353:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042368:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042376:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.042381:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042390:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042409:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.042416:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68808704->68812799] (req 68808704->68812799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.042519:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565379584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7911us (8235us total) trans 4294984107 rc 0/0 00000100:00100000:0.0:1789760769.042530:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16810 00000100:00100000:0.0:1789760769.042539:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707273415450 time 707294884288 state 0x2 ref 0 00000100:00100000:0.0:1789760769.048283:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.058395:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984108 is committed 00000100:00100000:1.0:1789760769.077993:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379840 00000100:00100000:1.0:1789760769.078004:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379840 00000100:00100000:1.0:1789760769.078078:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707295144704 time 707308780977 state 0x0 ref 1 00000100:00100000:1.0:1789760769.078093:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707309041393 time 707308780977 state 0x1 ref 1 00000100:00100000:1.0:1789760769.078123:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707309041393 time 707338415604 state 0x0 ref 1 00000100:00100000:1.0:1789760769.078136:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565379840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.078184:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68816896, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d20 00010000:00010000:1.0:1789760769.078193:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078213:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.078218:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.078224:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078536:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.088527:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68816896 -> 68820992 00002000:00010000:0.0:1789760769.088532:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134432 -> 134440 00010000:00010000:0.0:1789760769.088545:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088558:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088568:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088576:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.088581:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088589:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088610:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.088618:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ca77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68816896->68820991] (req 68816896->68820991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.088805:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565379840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10658us (10873us total) trans 4294984109 rc 0/0 00000100:00100000:0.0:1789760769.088817:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16812 00000100:00100000:0.0:1789760769.088827:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707309041393 time 707338415604 state 0x2 ref 0 00000100:00100000:1.0:1789760769.098634:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.098865:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565379968 00000100:00100000:0.0:1789760769.098875:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565379968 00000100:00100000:0.0:1789760769.098929:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707309041393 time 707338415604 state 0x0 ref 1 00000100:00100000:0.0:1789760769.098944:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707338676020 time 707338415604 state 0x1 ref 1 00000100:00100000:0.0:1789760769.098976:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707338676020 time 707359267788 state 0x0 ref 1 00000100:00100000:0.0:1789760769.098988:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565379968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.099037:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68820992, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d28 00010000:00010000:0.0:1789760769.099047:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.099062:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.099066:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.099073:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.099088:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760769.110022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984110 is committed 00002000:00010000:0.0:1789760769.110143:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68820992 -> 68825088 00002000:00010000:0.0:1789760769.110149:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134440 -> 134448 00010000:00010000:0.0:1789760769.110162:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110185:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110201:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110208:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.110212:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110220:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110238:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.110246:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68820992->68825087] (req 68820992->68825087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.110341:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565379968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11349us (11711us total) trans 4294984110 rc 0/0 00000100:00100000:0.0:1789760769.110351:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16813 00000100:00100000:0.0:1789760769.110359:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707338676020 time 707359267788 state 0x2 ref 0 00000100:00100000:1.0:1789760769.114783:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760769.122918:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68825088 -> 68829184 00002000:00010000:0.0:1789760769.122923:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134448 -> 134456 00010000:00010000:0.0:1789760769.122961:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.122980:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.122989:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.122996:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.123001:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.123010:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.123029:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.123037:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ca85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68825088->68829183] (req 68825088->68829183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.123182:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565380096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8143us (8405us total) trans 4294984111 rc 0/0 00000100:00100000:0.0:1789760769.123192:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16814 00000100:00100000:0.0:1789760769.123202:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707359528204 time 707375306385 state 0x2 ref 0 00000100:00100000:0.0:1789760769.137089:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380224 00000100:00100000:0.0:1789760769.137099:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380224 00000100:00100000:0.0:1789760769.137153:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707359528204 time 707375306385 state 0x0 ref 1 00000100:00100000:0.0:1789760769.137168:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707375566801 time 707375306385 state 0x1 ref 1 00000100:00100000:0.0:1789760769.137248:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707375566801 time 707397538691 state 0x0 ref 1 00000100:00100000:0.0:1789760769.137262:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565380224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.137311:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68829184, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d38 00010000:00010000:0.0:1789760769.137320:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.137335:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.137340:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.137347:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68829184->68833279] (req 68829184->68833279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.137361:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ca8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68829184->68833279] (req 68829184->68833279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760769.146595:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984112 is committed 00000100:00100000:0.0:1789760769.156746:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380352 00000100:00100000:0.0:1789760769.156756:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380352 00000100:00100000:0.0:1789760769.156830:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707375566801 time 707397538691 state 0x0 ref 1 00000100:00100000:0.0:1789760769.156846:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707397799107 time 707397538691 state 0x1 ref 1 00000100:00100000:0.0:1789760769.156877:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707397799107 time 707417169608 state 0x0 ref 1 00000100:00100000:0.0:1789760769.156893:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565380352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.156943:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68833280, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d40 00010000:00010000:0.0:1789760769.156952:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.156970:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.156974:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.156981:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.156995:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.165587:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68833280 -> 68837376 00002000:00010000:0.0:1789760769.165592:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134464 -> 134472 00010000:00010000:0.0:1789760769.165605:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165618:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165627:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165635:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.165640:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165648:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165668:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.165676:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ca93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68833280->68837375] (req 68833280->68837375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.165808:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565380352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8900us (9164us total) trans 4294984113 rc 0/0 00000100:00100000:0.0:1789760769.165820:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16816 00000100:00100000:0.0:1789760769.165831:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707397799107 time 707417169608 state 0x2 ref 0 00000100:00100000:0.0:1789760769.170092:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760769.175976:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984114 is committed 00000100:00100000:0.0:1789760769.182212:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380608 00000100:00100000:0.0:1789760769.182224:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380608 00000100:00100000:0.0:1789760769.182283:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707417430024 time 707430543235 state 0x0 ref 1 00000100:00100000:0.0:1789760769.186624:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707430803651 time 707430543235 state 0x1 ref 1 00000100:00100000:0.0:1789760769.186669:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707430803651 time 707446961347 state 0x0 ref 1 00000100:00100000:0.0:1789760769.186698:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565380608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.186778:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68841472, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d50 00010000:00010000:0.0:1789760769.186788:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.186814:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.186818:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.186825:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.186840:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.193753:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68841472 -> 68845568 00002000:00010000:0.0:1789760769.193758:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134480 -> 134488 00010000:00010000:0.0:1789760769.193771:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193784:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193793:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193810:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.193815:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193830:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193849:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.193857:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68841472->68845567] (req 68841472->68845567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.193951:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565380608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7263us (12096us total) trans 4294984115 rc 0/0 00000100:00100000:0.0:1789760769.193962:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16818 00000100:00100000:0.0:1789760769.193972:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707430803651 time 707446961347 state 0x2 ref 0 00000100:00100000:1.0:1789760769.211084:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760769.211332:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380736 00000100:00100000:3.0:1789760769.211342:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380736 00000100:00100000:3.0:1789760769.211402:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707430803651 time 707446961347 state 0x0 ref 1 00000100:00100000:3.0:1789760769.211418:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707447221763 time 707446961347 state 0x1 ref 1 00000100:00100000:3.0:1789760769.211446:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707447221763 time 707471738539 state 0x0 ref 1 00000100:00100000:3.0:1789760769.211459:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565380736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760769.211508:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68845568, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d58 00010000:00010000:3.0:1789760769.211518:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.211532:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1789760769.211536:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.211542:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.211555:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760769.226220:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68845568 -> 68849664 00002000:00010000:3.0:1789760769.226225:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134488 -> 134496 00010000:00010000:3.0:1789760769.226245:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226258:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226268:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226275:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760769.226280:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226294:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226312:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.226321:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674caa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68845568->68849663] (req 68845568->68849663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.226416:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565380736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14955us (15336us total) trans 4294984116 rc 0/0 00000100:00100000:3.0:1789760769.226427:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16819 00000100:00100000:3.0:1789760769.230644:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707447221763 time 707471738539 state 0x2 ref 0 00010000:00010000:1.0:1789760769.231188:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760769.231312:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380864 00000100:00100000:0.0:1789760769.231322:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380864 00000100:00100000:0.0:1789760769.231373:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707447221763 time 707471738539 state 0x0 ref 1 00000100:00100000:0.0:1789760769.231387:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707471998955 time 707471738539 state 0x1 ref 1 00000100:00100000:0.0:1789760769.231414:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707471998955 time 707491706320 state 0x0 ref 1 00000100:00100000:0.0:1789760769.231428:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565380864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.231592:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68849664, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d60 00010000:00010000:0.0:1789760769.231601:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.231616:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.231621:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.231627:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.231640:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.238308:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984117 is committed 00002000:00010000:1.0:1789760769.238551:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68849664 -> 68853760 00002000:00010000:1.0:1789760769.238556:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134496 -> 134504 00010000:00010000:1.0:1789760769.238569:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238582:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238591:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238598:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.238602:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238612:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238631:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.238639:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674caaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68849664->68853759] (req 68849664->68853759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.238940:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565380864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7509us (7885us total) trans 4294984117 rc 0/0 00000100:00100000:1.0:1789760769.238952:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16820 00000100:00100000:1.0:1789760769.238961:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707471998955 time 707491706320 state 0x2 ref 0 00000100:00100000:0.0:1789760769.244023:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565380992 00000100:00100000:0.0:1789760769.244033:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565380992 00000100:00100000:0.0:1789760769.244084:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707471998955 time 707491706320 state 0x0 ref 1 00000100:00100000:0.0:1789760769.244099:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707491966736 time 707491706320 state 0x1 ref 1 00000100:00100000:0.0:1789760769.244131:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707491966736 time 707504422576 state 0x0 ref 1 00000100:00100000:0.0:1789760769.244154:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565380992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.244201:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68853760, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d68 00010000:00010000:0.0:1789760769.244210:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674cab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.244225:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.244229:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.244235:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674cab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68853760->68857855] (req 68853760->68857855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.244253:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674cab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68853760->68857855] (req 68853760->68857855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.252956:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984118 is committed 00000100:00100000:3.0:1789760769.263754:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760769.263878:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381120 00000100:00100000:1.0:1789760769.263887:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381120 00000100:00100000:1.0:1789760769.264014:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707491966736 time 707504422576 state 0x0 ref 1 00000100:00100000:1.0:1789760769.264029:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707504682992 time 707504422576 state 0x1 ref 1 00000100:00100000:1.0:1789760769.264063:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707504682992 time 707524355287 state 0x0 ref 1 00000100:00100000:1.0:1789760769.264076:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565381120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.264135:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68857856, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d70 00010000:00010000:1.0:1789760769.264429:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.264447:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.264451:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.264457:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.264471:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760769.270724:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984119 is committed 00002000:00010000:1.0:1789760769.271059:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68857856 -> 68861952 00002000:00010000:1.0:1789760769.271065:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134512 -> 134520 00010000:00010000:1.0:1789760769.271079:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271091:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271100:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271107:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.271121:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271131:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271356:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.271366:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cabd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68857856->68861951] (req 68857856->68861951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.271477:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565381120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7397us (7767us total) trans 4294984119 rc 0/0 00000100:00100000:1.0:1789760769.271489:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16822 00000100:00100000:1.0:1789760769.271500:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707504682992 time 707524355287 state 0x2 ref 0 00000100:00100000:0.0:1789760769.278094:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760769.278824:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381248 00000100:00100000:1.0:1789760769.278835:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381248 00000100:00100000:1.0:1789760769.278955:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707504682992 time 707524355287 state 0x0 ref 1 00000100:00100000:1.0:1789760769.278975:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707524615703 time 707524355287 state 0x1 ref 1 00000100:00100000:1.0:1789760769.279010:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707524615703 time 707539302028 state 0x0 ref 1 00000100:00100000:1.0:1789760769.279025:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565381248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.279084:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68861952, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d78 00010000:00010000:1.0:1789760769.279094:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cac4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.279110:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.279126:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.279132:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cac4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68861952->68866047] (req 68861952->68866047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.279146:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cac4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68861952->68866047] (req 68861952->68866047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.285892:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984120 is committed 00000100:00100000:1.0:1789760769.300160:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381376 00000100:00100000:1.0:1789760769.300170:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381376 00000100:00100000:1.0:1789760769.300223:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707524615703 time 707539302028 state 0x0 ref 1 00000100:00100000:1.0:1789760769.300237:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707539562444 time 707539302028 state 0x1 ref 1 00000100:00100000:1.0:1789760769.300264:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707539562444 time 707560556455 state 0x0 ref 1 00000100:00100000:1.0:1789760769.300276:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565381376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.300322:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68866048, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d80 00010000:00010000:1.0:1789760769.300331:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.300347:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.300351:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.300357:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.300370:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760769.306418:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984121 is committed 00002000:00010000:1.0:1789760769.306756:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68866048 -> 68870144 00002000:00010000:1.0:1789760769.306762:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134528 -> 134536 00010000:00010000:1.0:1789760769.306775:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.306788:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.306806:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.306814:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.306819:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.306829:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.306848:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.307092:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cacb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68866048->68870143] (req 68866048->68870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.307294:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565381376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7014us (7217us total) trans 4294984121 rc 0/0 00000100:00100000:1.0:1789760769.307305:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16824 00000100:00100000:1.0:1789760769.307315:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707539562444 time 707560556455 state 0x2 ref 0 00000100:00100000:3.0:1789760769.316867:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760769.316992:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381504 00000100:00100000:1.0:1789760769.317002:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381504 00000100:00100000:1.0:1789760769.317052:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707539562444 time 707560556455 state 0x0 ref 1 00000100:00100000:1.0:1789760769.317068:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707560816871 time 707560556455 state 0x1 ref 1 00000100:00100000:1.0:1789760769.317101:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707560816871 time 707577393663 state 0x0 ref 1 00000100:00100000:1.0:1789760769.317124:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565381504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.317327:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68870144, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d88 00010000:00010000:1.0:1789760769.317337:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.317351:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.317356:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.317362:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.317376:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760769.323343:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984122 is committed 00002000:00010000:1.0:1789760769.330329:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68870144 -> 68874240 00002000:00010000:1.0:1789760769.330338:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134536 -> 134544 00010000:00010000:1.0:1789760769.330352:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330364:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330373:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330379:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.330384:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330392:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330411:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.330419:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cad2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68870144->68874239] (req 68870144->68874239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.330522:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565381504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13398us (13660us total) trans 4294984122 rc 0/0 00000100:00100000:1.0:1789760769.330533:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16825 00000100:00100000:1.0:1789760769.330543:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707560816871 time 707577393663 state 0x2 ref 0 00000100:00100000:0.0:1789760769.335334:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.344745:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984123 is committed 00000100:00100000:1.0:1789760769.355952:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381760 00000100:00100000:1.0:1789760769.355966:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381760 00000100:00100000:1.0:1789760769.356027:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707577654079 time 707595897605 state 0x0 ref 1 00000100:00100000:1.0:1789760769.356043:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707596158021 time 707595897605 state 0x1 ref 1 00000100:00100000:1.0:1789760769.356079:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707596158021 time 707616371398 state 0x0 ref 1 00000100:00100000:1.0:1789760769.356093:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565381760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.356265:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68878336, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20d98 00010000:00010000:1.0:1789760769.356276:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.356293:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.356297:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.356302:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.356316:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760769.362355:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68878336 -> 68882432 00002000:00010000:1.0:1789760769.362360:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134552 -> 134560 00010000:00010000:1.0:1789760769.362374:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362393:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362403:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362411:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.362417:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362427:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362446:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.362454:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cae0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68878336->68882431] (req 68878336->68882431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.362557:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565381760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6463us (8972us total) trans 4294984124 rc 0/0 00000100:00100000:1.0:1789760769.362568:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16827 00000100:00100000:1.0:1789760769.362579:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707596158021 time 707616371398 state 0x2 ref 0 00000100:00100000:3.0:1789760769.365876:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760769.366033:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565381888 00000100:00100000:1.0:1789760769.366043:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565381888 00000100:00100000:1.0:1789760769.366096:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707596158021 time 707616371398 state 0x0 ref 1 00000100:00100000:1.0:1789760769.366112:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707616631814 time 707616371398 state 0x1 ref 1 00000100:00100000:1.0:1789760769.366155:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707616631814 time 707626446544 state 0x0 ref 1 00000100:00100000:1.0:1789760769.366169:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565381888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.366215:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68882432, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20da0 00010000:00010000:1.0:1789760769.366223:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.366238:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.366243:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.366249:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.366263:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760769.370807:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68882432 -> 68886528 00002000:00010000:1.0:1789760769.370812:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134560 -> 134568 00010000:00010000:1.0:1789760769.370826:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370838:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370852:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370858:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.370863:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370871:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370890:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.370897:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cae7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68882432->68886527] (req 68882432->68886527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.370988:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565381888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4817us (5116us total) trans 4294984125 rc 0/0 00000100:00100000:1.0:1789760769.370998:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16828 00000100:00100000:1.0:1789760769.371007:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707616631814 time 707626446544 state 0x2 ref 0 00000100:00100000:0.0:1789760769.374580:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.379802:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984126 is committed 00000100:00100000:1.0:1789760769.386962:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565382144 00000100:00100000:1.0:1789760769.386976:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565382144 00000100:00100000:1.0:1789760769.387317:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707626706960 time 707635133098 state 0x0 ref 1 00000100:00100000:1.0:1789760769.387339:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707635393514 time 707635133098 state 0x1 ref 1 00000100:00100000:1.0:1789760769.387426:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707635393514 time 707647716960 state 0x0 ref 1 00000100:00100000:1.0:1789760769.387442:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.387561:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68890624, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20db0 00010000:00010000:1.0:1789760769.387571:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.387586:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.387591:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.387598:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.387612:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760769.396195:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68890624 -> 68894720 00002000:00010000:3.0:1789760769.396204:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134576 -> 134584 00010000:00010000:3.0:1789760769.396218:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396320:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396336:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396344:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760769.396349:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396357:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396378:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.396386:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674caf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68890624->68894719] (req 68890624->68894719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.396523:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9080us (11157us total) trans 4294984127 rc 0/0 00000100:00100000:3.0:1789760769.396534:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16830 00000100:00100000:3.0:1789760769.396544:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707635393514 time 707647716960 state 0x2 ref 0 00000100:00100000:3.0:1789760769.405501:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760769.406654:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565382272 00000100:00100000:1.0:1789760769.406668:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565382272 00000100:00100000:1.0:1789760769.406786:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707635393514 time 707647716960 state 0x0 ref 1 00000100:00100000:1.0:1789760769.406814:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707647977376 time 707647716960 state 0x1 ref 1 00000100:00100000:0.0:1789760769.406951:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707647977376 time 707667240422 state 0x0 ref 1 00000100:00100000:0.0:1789760769.406969:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.407020:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68894720, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20db8 00010000:00010000:0.0:1789760769.407029:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.407046:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.407050:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.407056:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.407070:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.412347:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984128 is committed 00002000:00010000:0.0:1789760769.412956:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68894720 -> 68898816 00002000:00010000:0.0:1789760769.412962:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134584 -> 134592 00010000:00010000:0.0:1789760769.412976:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.412990:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.412998:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.413006:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.413010:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.413019:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.413038:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.413046:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cafc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68894720->68898815] (req 68894720->68898815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.413145:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6176us (7648us total) trans 4294984128 rc 0/0 00000100:00100000:0.0:1789760769.413156:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16831 00000100:00100000:0.0:1789760769.413165:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707647977376 time 707667240422 state 0x2 ref 0 00000100:00100000:0.0:1789760769.422934:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.428228:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984129 is committed 00000100:00100000:3.0:1789760769.439896:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565382528 00000100:00100000:3.0:1789760769.439905:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565382528 00000100:00100000:3.0:1789760769.439967:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707667500838 time 707684340304 state 0x0 ref 1 00000100:00100000:3.0:1789760769.439985:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707684600720 time 707684340304 state 0x1 ref 1 00000100:00100000:3.0:1789760769.440010:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707684600720 time 707700302781 state 0x0 ref 1 00000100:00100000:3.0:1789760769.440021:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760769.440067:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68902912, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20dc8 00010000:00010000:3.0:1789760769.440078:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.440096:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1789760769.440100:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.440106:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.440121:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.444263:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984130 is committed 00002000:00010000:3.0:1789760769.444376:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68902912 -> 68907008 00002000:00010000:3.0:1789760769.444381:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134600 -> 134608 00010000:00010000:3.0:1789760769.444392:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444404:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444414:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444421:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760769.444426:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444434:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444454:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.444460:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cb0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68902912->68907007] (req 68902912->68907007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.445262:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565382528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5234us (5492us total) trans 4294984130 rc 0/0 00000100:00100000:3.0:1789760769.445273:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16833 00000100:00100000:3.0:1789760769.445283:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707684600720 time 707700302781 state 0x2 ref 0 00000100:00100000:3.0:1789760769.449975:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.450121:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565382656 00000100:00100000:0.0:1789760769.450130:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565382656 00000100:00100000:0.0:1789760769.450193:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707684600720 time 707700302781 state 0x0 ref 1 00000100:00100000:0.0:1789760769.450207:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707700563197 time 707700302781 state 0x1 ref 1 00000100:00100000:0.0:1789760769.450241:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707700563197 time 707710532749 state 0x0 ref 1 00000100:00100000:0.0:1789760769.450253:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565382656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.450305:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68907008, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20dd0 00010000:00010000:0.0:1789760769.450315:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.450332:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.450337:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.450344:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.450358:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.454468:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68907008 -> 68911104 00002000:00010000:0.0:1789760769.454473:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134608 -> 134616 00010000:00010000:0.0:1789760769.454485:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454501:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454511:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454518:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.454523:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454531:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454549:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.454557:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68907008->68911103] (req 68907008->68911103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.454681:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565382656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4425us (4710us total) trans 4294984131 rc 0/0 00000100:00100000:0.0:1789760769.454691:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16834 00000100:00100000:0.0:1789760769.454700:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707700563197 time 707710532749 state 0x2 ref 0 00000100:00100000:0.0:1789760769.460839:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.465619:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984132 is committed 00000100:00100000:0.0:1789760769.471605:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760769.471690:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565382912 00000100:00100000:3.0:1789760769.471699:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565382912 00000100:00100000:3.0:1789760769.472539:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707710793165 time 707721493651 state 0x0 ref 1 00000100:00100000:3.0:1789760769.472558:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707721754067 time 707721493651 state 0x1 ref 1 00000100:00100000:0.0:1789760769.472676:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707721754067 time 707732966616 state 0x0 ref 1 00000100:00100000:0.0:1789760769.472696:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565382912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.472773:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68915200, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20de0 00010000:00010000:0.0:1789760769.472783:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.472808:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.472812:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.472817:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.472831:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.477631:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984133 is committed 00002000:00010000:0.0:1789760769.477805:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68915200 -> 68919296 00002000:00010000:0.0:1789760769.477811:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134624 -> 134632 00010000:00010000:0.0:1789760769.477823:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477837:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477845:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477856:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.477861:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477870:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477889:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.477897:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68915200->68919295] (req 68915200->68919295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.478104:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565382912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5410us (6502us total) trans 4294984133 rc 0/0 00000100:00100000:0.0:1789760769.478116:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16836 00000100:00100000:0.0:1789760769.478125:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707721754067 time 707732966616 state 0x2 ref 0 00000100:00100000:3.0:1789760769.488281:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.488479:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383040 00000100:00100000:0.0:1789760769.488490:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383040 00000100:00100000:0.0:1789760769.488697:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707721754067 time 707732966616 state 0x0 ref 1 00000100:00100000:0.0:1789760769.488729:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707733227032 time 707732966616 state 0x1 ref 1 00000100:00100000:0.0:1789760769.488754:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707733227032 time 707749045531 state 0x0 ref 1 00000100:00100000:0.0:1789760769.488771:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.488827:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68919296, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20de8 00010000:00010000:0.0:1789760769.488836:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.488861:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.488867:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.488874:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.488896:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.501410:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68919296 -> 68923392 00002000:00010000:0.0:1789760769.501415:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134632 -> 134640 00010000:00010000:0.0:1789760769.501429:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501442:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501452:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501459:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.501464:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501474:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501492:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.501501:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68919296->68923391] (req 68919296->68923391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.501596:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12825us (13320us total) trans 4294984134 rc 0/0 00000100:00100000:0.0:1789760769.501607:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16837 00000100:00100000:0.0:1789760769.501616:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707733227032 time 707749045531 state 0x2 ref 0 00000100:00100000:1.0:1789760769.507968:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383168 00000100:00100000:1.0:1789760769.507979:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383168 00000100:00100000:1.0:1789760769.508039:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707733227032 time 707749045531 state 0x0 ref 1 00000100:00100000:1.0:1789760769.508054:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707749305947 time 707749045531 state 0x1 ref 1 00000100:00100000:1.0:1789760769.508089:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707749305947 time 707768380506 state 0x0 ref 1 00000100:00100000:1.0:1789760769.508103:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565383168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.508176:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68923392, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20df0 00010000:00010000:1.0:1789760769.508185:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.508200:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.508205:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.508211:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68923392->68927487] (req 68923392->68927487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.508225:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68923392->68927487] (req 68923392->68927487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.517824:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984135 is committed 00000100:00100000:3.0:1789760769.523437:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.523575:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383296 00000100:00100000:0.0:1789760769.523586:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383296 00000100:00100000:0.0:1789760769.523645:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707749305947 time 707768380506 state 0x0 ref 1 00000100:00100000:0.0:1789760769.523661:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707768640922 time 707768380506 state 0x1 ref 1 00000100:00100000:0.0:1789760769.523693:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707768640922 time 707783984417 state 0x0 ref 1 00000100:00100000:0.0:1789760769.523724:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.523805:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68927488, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20df8 00010000:00010000:0.0:1789760769.523815:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.523831:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.523835:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.523841:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.523855:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.531060:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68927488 -> 68931584 00002000:00010000:0.0:1789760769.531068:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134648 -> 134656 00010000:00010000:0.0:1789760769.531081:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531094:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531103:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531110:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.531116:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531124:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531275:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.531284:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68927488->68931583] (req 68927488->68931583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.532753:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9030us (9305us total) trans 4294984136 rc 0/0 00000100:00100000:0.0:1789760769.532777:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16839 00000100:00100000:0.0:1789760769.532788:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707768640922 time 707783984417 state 0x2 ref 0 00000100:00100000:3.0:1789760769.543441:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.543539:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383424 00000100:00100000:0.0:1789760769.543620:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383424 00000100:00100000:0.0:1789760769.543684:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707768640922 time 707783984417 state 0x0 ref 1 00000100:00100000:0.0:1789760769.543699:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707784244833 time 707783984417 state 0x1 ref 1 00000100:00100000:0.0:1789760769.543931:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707784244833 time 707804221689 state 0x0 ref 1 00000100:00100000:0.0:1789760769.543946:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565383424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.543998:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68931584, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e00 00010000:00010000:0.0:1789760769.544007:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.544022:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.544027:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.544034:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.544048:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.552903:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984137 is committed 00002000:00010000:0.0:1789760769.553217:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68931584 -> 68935680 00002000:00010000:0.0:1789760769.553223:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134656 -> 134664 00010000:00010000:0.0:1789760769.553237:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553250:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553258:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553265:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.553270:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553279:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553298:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.553311:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68931584->68935679] (req 68931584->68935679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.553476:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565383424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9527us (10039us total) trans 4294984137 rc 0/0 00000100:00100000:0.0:1789760769.553487:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16840 00000100:00100000:0.0:1789760769.553496:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707784244833 time 707804221689 state 0x2 ref 0 00000100:00100000:1.0:1789760769.561309:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383552 00000100:00100000:1.0:1789760769.561320:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383552 00000100:00100000:1.0:1789760769.561379:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707784244833 time 707804221689 state 0x0 ref 1 00000100:00100000:1.0:1789760769.561396:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707804482105 time 707804221689 state 0x1 ref 1 00000100:00100000:1.0:1789760769.561429:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707804482105 time 707821721033 state 0x0 ref 1 00000100:00100000:1.0:1789760769.561442:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.561490:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68935680, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e08 00010000:00010000:1.0:1789760769.561499:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.561514:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.561518:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.561523:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.561537:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760769.571387:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68935680 -> 68939776 00002000:00010000:1.0:1789760769.571392:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134664 -> 134672 00010000:00010000:1.0:1789760769.571406:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571418:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571425:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571433:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.571438:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571445:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571466:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.571474:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68935680->68939775] (req 68935680->68939775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.571690:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10245us (10762us total) trans 4294984138 rc 0/0 00000100:00100000:1.0:1789760769.571702:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16841 00000100:00100000:1.0:1789760769.571757:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707804482105 time 707821721033 state 0x2 ref 0 00000100:00100000:3.0:1789760769.579764:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.579912:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383680 00000100:00100000:0.0:1789760769.579921:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383680 00000100:00100000:0.0:1789760769.579976:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707804482105 time 707821721033 state 0x0 ref 1 00000100:00100000:0.0:1789760769.579992:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707821981449 time 707821721033 state 0x1 ref 1 00000100:00100000:0.0:1789760769.580025:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707821981449 time 707840317819 state 0x0 ref 1 00000100:00100000:0.0:1789760769.580039:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565383680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.580088:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68939776, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e10 00010000:00010000:0.0:1789760769.580097:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.580113:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.580117:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.580124:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.580157:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.586498:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68939776 -> 68943872 00002000:00010000:0.0:1789760769.586503:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134672 -> 134680 00010000:00010000:0.0:1789760769.586516:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586527:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586536:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586544:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.586560:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586570:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586589:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.586596:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68939776->68943871] (req 68939776->68943871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.586684:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565383680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6643us (6973us total) trans 4294984139 rc 0/0 00000100:00100000:0.0:1789760769.586694:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16842 00000100:00100000:0.0:1789760769.587103:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707821981449 time 707840317819 state 0x2 ref 0 00000100:00100000:3.0:1789760769.590646:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.594852:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383808 00000100:00100000:0.0:1789760769.594869:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383808 00000100:00100000:0.0:1789760769.594936:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707821981449 time 707840317819 state 0x0 ref 1 00000100:00100000:0.0:1789760769.594952:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707840578235 time 707840317819 state 0x1 ref 1 00000100:00100000:0.0:1789760769.595045:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707840578235 time 707855336743 state 0x0 ref 1 00000100:00100000:0.0:1789760769.595060:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565383808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.595104:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68943872, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e18 00010000:00010000:0.0:1789760769.595113:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.595128:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.595132:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.595148:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.595163:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.601438:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68943872 -> 68947968 00002000:00010000:0.0:1789760769.601443:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134680 -> 134688 00010000:00010000:0.0:1789760769.601458:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601471:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601481:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601488:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.601493:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601503:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601522:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.601530:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68943872->68947967] (req 68943872->68947967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.601635:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565383808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6572us (10991us total) trans 4294984140 rc 0/0 00000100:00100000:0.0:1789760769.601646:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16843 00000100:00100000:0.0:1789760769.601656:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707840578235 time 707855336743 state 0x2 ref 0 00000100:00100000:1.0:1789760769.606649:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565383936 00000100:00100000:1.0:1789760769.606662:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565383936 00000100:00100000:1.0:1789760769.606843:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707840578235 time 707855336743 state 0x0 ref 1 00000100:00100000:1.0:1789760769.606932:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707855597159 time 707855336743 state 0x1 ref 1 00000100:00100000:1.0:1789760769.606960:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707855597159 time 707867252760 state 0x0 ref 1 00000100:00100000:1.0:1789760769.606977:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565383936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760769.607140:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68947968, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e20 00010000:00010000:1.0:1789760769.607151:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.607170:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1789760769.607175:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.607183:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.607199:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760769.613529:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68947968 -> 68952064 00002000:00010000:1.0:1789760769.613535:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134688 -> 134696 00010000:00010000:1.0:1789760769.613676:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613692:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613855:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613867:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760769.613872:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613882:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613902:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.613911:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cb57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68947968->68952063] (req 68947968->68952063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.619747:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.620846:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384064 00000100:00100000:0.0:1789760769.620934:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384064 00000100:00100000:0.0:1789760769.620996:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707855597159 time 707867252760 state 0x0 ref 1 00000100:00100000:0.0:1789760769.621014:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707867513176 time 707867252760 state 0x1 ref 1 00000100:00100000:0.0:1789760769.621119:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707867513176 time 707881409590 state 0x0 ref 1 00000100:00100000:0.0:1789760769.621133:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565384064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.621182:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68952064, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e28 00010000:00010000:0.0:1789760769.621191:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.621207:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.621212:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.621219:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.621301:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.627418:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984142 is committed 00002000:00010000:0.0:1789760769.627562:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68952064 -> 68956160 00002000:00010000:0.0:1789760769.627568:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134696 -> 134704 00010000:00010000:0.0:1789760769.627583:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627595:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627605:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627613:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.627618:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627627:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627648:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.627655:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68952064->68956159] (req 68952064->68956159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.628234:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565384064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7097us (8532us total) trans 4294984142 rc 0/0 00000100:00100000:0.0:1789760769.628246:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16845 00000100:00100000:0.0:1789760769.628257:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707867513176 time 707881409590 state 0x2 ref 0 00000100:00100000:3.0:1789760769.634323:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.634401:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384192 00000100:00100000:0.0:1789760769.634410:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384192 00000100:00100000:0.0:1789760769.634463:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707867513176 time 707881409590 state 0x0 ref 1 00000100:00100000:0.0:1789760769.634478:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707881670006 time 707881409590 state 0x1 ref 1 00000100:00100000:0.0:1789760769.634510:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707881670006 time 707894802668 state 0x0 ref 1 00000100:00100000:0.0:1789760769.634523:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.634567:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68956160, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e30 00010000:00010000:0.0:1789760769.634576:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.634592:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.634597:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.634603:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.634615:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760769.642209:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68956160 -> 68960256 00002000:00010000:0.0:1789760769.642215:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134704 -> 134712 00010000:00010000:0.0:1789760769.642230:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642258:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642268:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642275:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.642280:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642290:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642312:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642319:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68956160->68960255] (req 68956160->68960255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.642419:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7894us (8101us total) trans 4294984143 rc 0/0 00000100:00100000:0.0:1789760769.642432:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16846 00000100:00100000:0.0:1789760769.642441:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707881670006 time 707894802668 state 0x2 ref 0 00000100:00100000:0.0:1789760769.650022:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384320 00000100:00100000:0.0:1789760769.650033:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384320 00000100:00100000:0.0:1789760769.650089:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707881670006 time 707894802668 state 0x0 ref 1 00000100:00100000:0.0:1789760769.650105:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707895063084 time 707894802668 state 0x1 ref 1 00000100:00100000:0.0:1789760769.650132:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707895063084 time 707910424018 state 0x0 ref 1 00000100:00100000:0.0:1789760769.650156:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565384320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.650210:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68960256, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e38 00010000:00010000:0.0:1789760769.650219:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.650235:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.650240:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.650246:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.650261:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.661570:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984144 is committed 00002000:00010000:0.0:1789760769.661770:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68960256 -> 68964352 00002000:00010000:0.0:1789760769.661775:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134712 -> 134720 00010000:00010000:0.0:1789760769.661789:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661811:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661824:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661831:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.661836:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661844:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661864:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.661872:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68960256->68964351] (req 68960256->68964351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.661992:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565384320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11834us (12402us total) trans 4294984144 rc 0/0 00000100:00100000:0.0:1789760769.662005:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16847 00000100:00100000:0.0:1789760769.662014:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707895063084 time 707910424018 state 0x2 ref 0 00000100:00100000:3.0:1789760769.668544:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.668898:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384448 00000100:00100000:0.0:1789760769.668909:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384448 00000100:00100000:0.0:1789760769.668967:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707895063084 time 707910424018 state 0x0 ref 1 00000100:00100000:0.0:1789760769.668983:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707910684434 time 707910424018 state 0x1 ref 1 00000100:00100000:0.0:1789760769.669021:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707910684434 time 707929312578 state 0x0 ref 1 00000100:00100000:0.0:1789760769.669034:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.669084:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68964352, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e40 00010000:00010000:0.0:1789760769.669094:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.669109:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.669114:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.669120:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.669134:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.675486:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984145 is committed 00002000:00010000:0.0:1789760769.675664:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68964352 -> 68968448 00002000:00010000:0.0:1789760769.675670:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134720 -> 134728 00010000:00010000:0.0:1789760769.675683:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675695:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675742:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675756:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.675762:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675770:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675789:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.675808:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68964352->68968447] (req 68964352->68968447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.675901:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6864us (7460us total) trans 4294984145 rc 0/0 00000100:00100000:0.0:1789760769.675911:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16848 00000100:00100000:0.0:1789760769.675922:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707910684434 time 707929312578 state 0x2 ref 0 00000100:00100000:3.0:1789760769.687311:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.691332:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384576 00000100:00100000:0.0:1789760769.691351:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384576 00000100:00100000:0.0:1789760769.691420:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707910684434 time 707929312578 state 0x0 ref 1 00000100:00100000:0.0:1789760769.691436:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707929572994 time 707929312578 state 0x1 ref 1 00000100:00100000:0.0:1789760769.691487:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707929572994 time 707951778768 state 0x0 ref 1 00000100:00100000:0.0:1789760769.691506:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565384576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.691554:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68968448, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e48 00010000:00010000:0.0:1789760769.691562:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.691579:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.691583:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.691590:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68968448->68972543] (req 68968448->68972543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.691605:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cb7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68968448->68972543] (req 68968448->68972543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.697356:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984146 is committed 00000100:00100000:3.0:1789760769.702222:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760769.702292:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384704 00000100:00100000:0.0:1789760769.702303:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384704 00000100:00100000:0.0:1789760769.702362:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707929572994 time 707951778768 state 0x0 ref 1 00000100:00100000:0.0:1789760769.702378:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707952039184 time 707951778768 state 0x1 ref 1 00000100:00100000:0.0:1789760769.702414:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707952039184 time 707962705877 state 0x0 ref 1 00000100:00100000:0.0:1789760769.702427:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.702492:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68972544, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e50 00010000:00010000:0.0:1789760769.702503:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.702524:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.702529:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.702536:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.702550:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.709393:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984147 is committed 00002000:00010000:0.0:1789760769.709526:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68972544 -> 68976640 00002000:00010000:0.0:1789760769.709531:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134736 -> 134744 00010000:00010000:0.0:1789760769.709544:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709557:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709566:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709573:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.709577:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709586:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709611:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.709619:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68972544->68976639] (req 68972544->68976639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.709764:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7333us (7547us total) trans 4294984147 rc 0/0 00000100:00100000:0.0:1789760769.709776:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16850 00000100:00100000:0.0:1789760769.709788:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707952039184 time 707962705877 state 0x2 ref 0 00000100:00100000:0.0:1789760769.718434:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384832 00000100:00100000:0.0:1789760769.718443:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384832 00000100:00100000:0.0:1789760769.718491:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707952039184 time 707962705877 state 0x0 ref 1 00000100:00100000:0.0:1789760769.718504:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707962966293 time 707962705877 state 0x1 ref 1 00000100:00100000:0.0:1789760769.718532:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707962966293 time 707978824912 state 0x0 ref 1 00000100:00100000:0.0:1789760769.718544:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760769.718590:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68976640, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e58 00010000:00010000:0.0:1789760769.718599:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.718614:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1789760769.718620:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760769.718627:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.718640:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.724186:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984148 is committed 00002000:00010000:0.0:1789760769.726076:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68976640 -> 68980736 00002000:00010000:0.0:1789760769.726085:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134744 -> 134752 00010000:00010000:0.0:1789760769.726098:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726111:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726119:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726126:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.726131:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726151:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726172:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.726184:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cb88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68976640->68980735] (req 68976640->68980735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.726287:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7740us (7956us total) trans 4294984148 rc 0/0 00000100:00100000:0.0:1789760769.726298:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16851 00000100:00100000:0.0:1789760769.726308:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707962966293 time 707978824912 state 0x2 ref 0 00000100:00100000:3.0:1789760769.731996:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565384960 00000100:00100000:3.0:1789760769.732008:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565384960 00000100:00100000:3.0:1789760769.732076:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707962966293 time 707978824912 state 0x0 ref 1 00000100:00100000:3.0:1789760769.732093:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707979085328 time 707978824912 state 0x1 ref 1 00000100:00100000:3.0:1789760769.732131:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 707979085328 time 707992422970 state 0x0 ref 1 00000100:00100000:3.0:1789760769.732146:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565384960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760769.732335:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68980736, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0x20e60 00010000:00010000:3.0:1789760769.732346:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cb8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.732361:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1789760769.732366:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.732373:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cb8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68980736->68984831] (req 68980736->68984831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.732388:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cb8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68980736->68984831] (req 68980736->68984831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.741767:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984149 is committed 00000100:00100000:0.0:1789760769.754966:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.763639:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984150 is committed 00000100:00100000:0.0:1789760769.775595:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.785567:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984151 is committed 00000100:00100000:3.0:1789760769.795357:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.801628:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984152 is committed 00000100:00100000:3.0:1789760769.804934:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580064256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760769.805027:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.805109:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064256 00000100:00100000:3.0:1789760769.805117:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064256 00000100:00100000:3.0:1789760769.805205:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789760769.805218:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580064256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760769.805254:0:6955:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760769.805300:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580064256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.805308:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1789760769.805328:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760769.805978:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580064256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760769.807475:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580064384:0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.807575:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.807740:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064384 00000100:00100000:0.0:1789760769.807749:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064384 00000100:00100000:0.0:1789760769.807817:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789760769.807827:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580064384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.807882:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580064384:12345-0@lo:400:kworker.0 Request processed in 57us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.807890:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789760769.808108:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580064384:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.810013:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580064768:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.810083:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.810124:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760769.810130:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3458:1876699580064896:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.811677:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.812295:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064768 00000100:00100000:3.0:1789760769.812304:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064768 00000100:00100000:3.0:1789760769.812370:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789760769.812395:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.812466:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580064768:12345-0@lo:400:kworker.0 Request processed in 76us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.812477:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789760769.812503:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064896 00000100:00100000:3.0:1789760769.812507:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064896 00000100:00100000:3.0:1789760769.812539:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1789760769.812546:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1876699580064896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.812578:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1876699580064896:12345-0@lo:400:kworker.0 Request processed in 32us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.812583:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:3.0:1789760769.812606:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760769.812611:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760769.812644:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3458:1876699580064896:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.812657:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580064768:0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.813184:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3457:1876699580064640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.813233:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.813346:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699580064512:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.813521:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064640 00000100:00100000:3.0:1789760769.813529:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064640 00000100:00100000:3.0:1789760769.813576:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789760769.813583:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1876699580064640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760769.815855:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.816545:0:5966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580064512 00000100:00100000:0.0:1789760769.816560:0:5966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580064512 00000100:00100000:0.0:1789760769.816635:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789760769.816645:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699580064512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.816755:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699580064512:12345-0@lo:400:kworker.0 Request processed in 112us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.816763:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1789760769.818979:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699580064512:0@lo:400:kworker.0 00000100:00100000:3.0:1789760769.819561:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3457:1876699580064640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760769.822641:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760769.837756:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68997120 -> 69001216 00002000:00010000:0.0:1789760769.837765:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134784 -> 134792 00010000:00010000:0.0:1789760769.837882:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837895:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837904:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837912:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760769.837917:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837927:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837947:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.837955:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cbab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68997120->69001215] (req 68997120->69001215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.838116:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565385472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15165us (15479us total) trans 4294984153 rc 0/0 00000100:00100000:0.0:1789760769.838127:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16856 00000100:00100000:0.0:1789760769.838146:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708056204220 time 708083228967 state 0x2 ref 0 00000100:00100000:0.0:1789760769.847223:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.854337:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984154 is committed 00000100:00100000:3.0:1789760769.863172:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760769.874610:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984155 is committed 00000100:00100000:0.0:1789760769.886570:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760769.901375:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984156 is committed 00000100:00100000:0.0:1789760769.921603:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760769.929310:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984157 is committed 00000100:00100000:0.0:1789760769.945398:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.959150:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984158 is committed 00000100:00100000:3.0:1789760769.964270:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760769.975239:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984159 is committed 00000100:00100000:0.0:1789760769.985875:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.009303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984160 is committed 00000100:00100000:0.0:1789760770.020564:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:3.0:1789760770.024683:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760770.028612:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984161 is committed 00000100:00100000:0.0:1789760770.036001:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.043006:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984162 is committed 00000100:00100000:0.0:1789760770.059292:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.067129:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984163 is committed 00000100:00100000:0.0:1789760770.078991:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.090197:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984164 is committed 00002000:00010000:3.0:1789760770.090348:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69042176 -> 69046272 00002000:00010000:3.0:1789760770.090354:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134872 -> 134880 00010000:00010000:3.0:1789760770.090367:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090379:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090389:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090396:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.090401:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090410:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090428:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.090435:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674cbf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69042176->69046271] (req 69042176->69046271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.090526:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565386880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11270us (11594us total) trans 4294984164 rc 0/0 00000100:00100000:3.0:1789760770.090535:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16867 00000100:00100000:3.0:1789760770.090544:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708320051065 time 708339532694 state 0x2 ref 0 00000100:00100000:0.0:1789760770.099634:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.113327:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984165 is committed 00000100:00100000:3.0:1789760770.115150:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565387008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15130us (15514us total) trans 4294984165 rc 0/0 00000100:00100000:3.0:1789760770.115164:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16868 00000100:00100000:3.0:1789760770.115173:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708339793110 time 708360290363 state 0x2 ref 0 00000100:00100000:0.0:1789760770.121196:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.126855:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708339793110 time 708360290363 state 0x0 ref 1 00000100:00100000:3.0:1789760770.126872:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708360550779 time 708360290363 state 0x1 ref 1 00000100:00100000:3.0:1789760770.126908:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708360550779 time 708387200011 state 0x0 ref 1 00000100:00100000:3.0:1789760770.126922:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565387136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.126974:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69050368, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20ee8 00010000:00010000:3.0:1789760770.126984:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.127000:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.127005:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.127012:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.127026:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.135258:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984166 is committed 00002000:00010000:3.0:1789760770.135833:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69050368 -> 69054464 00002000:00010000:3.0:1789760770.135839:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134888 -> 134896 00010000:00010000:3.0:1789760770.135854:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135867:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135876:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135884:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.135888:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135896:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135915:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.135989:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69050368->69054463] (req 69050368->69054463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.136077:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565387136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9154us (14887us total) trans 4294984166 rc 0/0 00000100:00100000:3.0:1789760770.136089:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16869 00000100:00100000:3.0:1789760770.136098:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708360550779 time 708387200011 state 0x2 ref 0 00000100:00100000:0.0:1789760770.142996:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.145104:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565387264 00000100:00100000:3.0:1789760770.145120:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565387264 00000100:00100000:3.0:1789760770.145188:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708360550779 time 708387200011 state 0x0 ref 1 00000100:00100000:3.0:1789760770.145206:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708387460427 time 708387200011 state 0x1 ref 1 00000100:00100000:3.0:1789760770.145239:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708387460427 time 708405531027 state 0x0 ref 1 00000100:00100000:3.0:1789760770.145254:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565387264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.145308:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69054464, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20ef0 00010000:00010000:3.0:1789760770.145324:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.145340:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.145344:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.145350:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.145364:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.154594:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984167 is committed 00002000:00010000:3.0:1789760770.154806:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69054464 -> 69058560 00002000:00010000:3.0:1789760770.154812:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134896 -> 134904 00010000:00010000:3.0:1789760770.154839:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154852:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154868:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154875:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.154880:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154888:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154906:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.154913:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69054464->69058559] (req 69054464->69058559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.155209:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565387264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9952us (12216us total) trans 4294984167 rc 0/0 00000100:00100000:3.0:1789760770.155220:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16870 00000100:00100000:3.0:1789760770.155230:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708387460427 time 708405531027 state 0x2 ref 0 00000100:00100000:0.0:1789760770.165209:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.165398:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565387392 00000100:00100000:3.0:1789760770.165409:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565387392 00000100:00100000:3.0:1789760770.165476:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708387460427 time 708405531027 state 0x0 ref 1 00000100:00100000:3.0:1789760770.165490:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708405791443 time 708405531027 state 0x1 ref 1 00000100:00100000:3.0:1789760770.165521:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708405791443 time 708425812960 state 0x0 ref 1 00000100:00100000:3.0:1789760770.165534:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565387392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.165587:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69058560, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20ef8 00010000:00010000:3.0:1789760770.165597:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.165616:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.165620:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.165626:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69058560->69062655] (req 69058560->69062655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.165640:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cc14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69058560->69062655] (req 69058560->69062655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.171482:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984168 is committed 00000100:00100000:0.0:1789760770.180056:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.180340:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565387520 00000100:00100000:3.0:1789760770.180350:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565387520 00000100:00100000:3.0:1789760770.180406:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708405791443 time 708425812960 state 0x0 ref 1 00000100:00100000:3.0:1789760770.180422:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708426073376 time 708425812960 state 0x1 ref 1 00000100:00100000:3.0:1789760770.180697:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708426073376 time 708440988466 state 0x0 ref 1 00000100:00100000:3.0:1789760770.180745:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565387520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.180822:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69062656, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f00 00010000:00010000:3.0:1789760770.180832:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.180847:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.180852:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.180858:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.180871:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.186382:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984169 is committed 00002000:00010000:3.0:1789760770.186776:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69062656 -> 69066752 00002000:00010000:3.0:1789760770.186781:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134912 -> 134920 00010000:00010000:3.0:1789760770.186802:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186816:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186833:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186840:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.186845:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186854:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186874:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.186882:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69062656->69066751] (req 69062656->69066751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.187094:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565387520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6347us (7042us total) trans 4294984169 rc 0/0 00000100:00100000:3.0:1789760770.187104:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16872 00000100:00100000:3.0:1789760770.187115:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708426073376 time 708440988466 state 0x2 ref 0 00000100:00100000:0.0:1789760770.191561:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.191815:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565387648 00000100:00100000:3.0:1789760770.191824:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565387648 00000100:00100000:3.0:1789760770.191881:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708426073376 time 708440988466 state 0x0 ref 1 00000100:00100000:3.0:1789760770.191896:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708441248882 time 708440988466 state 0x1 ref 1 00000100:00100000:3.0:1789760770.191923:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708441248882 time 708452215475 state 0x0 ref 1 00000100:00100000:3.0:1789760770.191937:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565387648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.191993:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69066752, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f08 00010000:00010000:3.0:1789760770.192003:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cc22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.192019:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.192026:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.192032:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cc22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69066752->69070847] (req 69066752->69070847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.192046:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cc22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69066752->69070847] (req 69066752->69070847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.202200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984170 is committed 00000100:00100000:0.0:1789760770.212414:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.220421:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984171 is committed 00000100:00100000:0.0:1789760770.226572:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.228670:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565387904 00000100:00100000:3.0:1789760770.228684:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565387904 00000100:00100000:3.0:1789760770.229248:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708452475891 time 708473890650 state 0x0 ref 1 00000100:00100000:3.0:1789760770.229265:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708474151066 time 708473890650 state 0x1 ref 1 00000100:00100000:3.0:1789760770.229411:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708474151066 time 708489691851 state 0x0 ref 1 00000100:00100000:3.0:1789760770.229430:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565387904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.229478:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69074944, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f18 00010000:00010000:3.0:1789760770.229487:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.229501:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.229505:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.229512:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.229526:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.237030:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984172 is committed 00002000:00010000:3.0:1789760770.237271:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69074944 -> 69079040 00002000:00010000:3.0:1789760770.237276:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134936 -> 134944 00010000:00010000:3.0:1789760770.237290:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237304:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237313:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237320:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.237325:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237335:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237356:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.237364:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69074944->69079039] (req 69074944->69079039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.237590:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565387904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8158us (11021us total) trans 4294984172 rc 0/0 00000100:00100000:3.0:1789760770.237601:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16875 00000100:00100000:3.0:1789760770.237612:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708474151066 time 708489691851 state 0x2 ref 0 00000100:00100000:0.0:1789760770.245487:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1789760770.252378:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760770.254677:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984173 is committed 00000100:00100000:1.0:1789760770.263194:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.273298:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984174 is committed 00000100:00100000:0.0:1789760770.278171:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.278426:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565388288 00000100:00100000:3.0:1789760770.278436:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565388288 00000100:00100000:3.0:1789760770.278489:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708506937575 time 708523732961 state 0x0 ref 1 00000100:00100000:3.0:1789760770.278504:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708523993377 time 708523732961 state 0x1 ref 1 00000100:00100000:3.0:1789760770.278544:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708523993377 time 708538835802 state 0x0 ref 1 00000100:00100000:3.0:1789760770.278556:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.278603:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69087232, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f30 00010000:00010000:3.0:1789760770.278613:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.278630:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.278634:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.278640:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.278654:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.285251:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984175 is committed 00002000:00010000:3.0:1789760770.285645:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69087232 -> 69091328 00002000:00010000:3.0:1789760770.285650:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134960 -> 134968 00010000:00010000:3.0:1789760770.285664:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.285677:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.285685:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.285692:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.285697:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.286263:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.286284:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.286291:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69087232->69091327] (req 69087232->69091327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.286447:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7887us (8286us total) trans 4294984175 rc 0/0 00000100:00100000:3.0:1789760770.286457:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16878 00000100:00100000:3.0:1789760770.286466:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708523993377 time 708538835802 state 0x2 ref 0 00000100:00100000:0.0:1789760770.294489:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.301628:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984176 is committed 00000100:00100000:1.0:1789760770.305464:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.314265:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984177 is committed 00002000:00010000:3.0:1789760770.314486:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69095424 -> 69099520 00002000:00010000:3.0:1789760770.314492:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134976 -> 134984 00010000:00010000:3.0:1789760770.314506:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314518:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314527:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314534:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.314539:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314547:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314569:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.314576:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674cc53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69095424->69099519] (req 69095424->69099519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.314771:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565388544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9088us (9312us total) trans 4294984177 rc 0/0 00000100:00100000:3.0:1789760770.314785:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16880 00000100:00100000:3.0:1789760770.314804:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708556084229 time 708565957075 state 0x2 ref 0 00000100:00100000:1.0:1789760770.322400:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.322520:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565388672 00000100:00100000:3.0:1789760770.322531:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565388672 00000100:00100000:3.0:1789760770.322587:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708556084229 time 708565957075 state 0x0 ref 1 00000100:00100000:3.0:1789760770.322603:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708566217491 time 708565957075 state 0x1 ref 1 00000100:00100000:3.0:1789760770.322638:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708566217491 time 708582930148 state 0x0 ref 1 00000100:00100000:3.0:1789760770.322650:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.322698:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69099520, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f48 00010000:00010000:3.0:1789760770.322752:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.322770:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.322775:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.322781:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.322811:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760770.329084:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984178 is committed 00002000:00010000:0.0:1789760770.329726:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69099520 -> 69103616 00002000:00010000:0.0:1789760770.329732:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 134984 -> 134992 00010000:00010000:0.0:1789760770.329746:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329759:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329769:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329776:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760770.329782:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329804:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329825:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329834:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cc5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69099520->69103615] (req 69099520->69103615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.330042:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7389us (7648us total) trans 4294984178 rc 0/0 00000100:00100000:0.0:1789760770.330053:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16881 00000100:00100000:0.0:1789760770.330063:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708566217491 time 708582930148 state 0x2 ref 0 00000100:00100000:1.0:1789760770.345079:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760770.354652:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984179 is committed 00000100:00100000:1.0:1789760770.359049:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.359143:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565388928 00000100:00100000:3.0:1789760770.359153:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565388928 00000100:00100000:3.0:1789760770.359208:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708583190564 time 708608575773 state 0x0 ref 1 00000100:00100000:3.0:1789760770.359224:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708608836189 time 708608575773 state 0x1 ref 1 00000100:00100000:3.0:1789760770.359254:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708608836189 time 708619546388 state 0x0 ref 1 00000100:00100000:3.0:1789760770.359266:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.359313:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69107712, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f58 00010000:00010000:3.0:1789760770.359322:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.359336:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.359341:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.359347:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.359360:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.367970:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984180 is committed 00002000:00010000:3.0:1789760770.368549:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69107712 -> 69111808 00002000:00010000:3.0:1789760770.368555:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135000 -> 135008 00010000:00010000:3.0:1789760770.368568:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368581:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368591:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368600:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.368605:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368614:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368635:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.368642:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69107712->69111807] (req 69107712->69111807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.368798:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565388928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9520us (10033us total) trans 4294984180 rc 0/0 00000100:00100000:3.0:1789760770.368810:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16883 00000100:00100000:3.0:1789760770.368820:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708608836189 time 708619546388 state 0x2 ref 0 00000100:00100000:1.0:1789760770.374223:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760770.374477:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565389056 00000100:00100000:0.0:1789760770.374486:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565389056 00000100:00100000:0.0:1789760770.374542:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708608836189 time 708619546388 state 0x0 ref 1 00000100:00100000:0.0:1789760770.374558:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708619806804 time 708619546388 state 0x1 ref 1 00000100:00100000:0.0:1789760770.374584:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708619806804 time 708634876830 state 0x0 ref 1 00000100:00100000:0.0:1789760770.374597:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760770.374641:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69111808, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f60 00010000:00010000:0.0:1789760770.374651:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.374667:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1789760770.374671:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760770.374678:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.374691:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760770.381142:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984181 is committed 00002000:00010000:3.0:1789760770.381283:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69111808 -> 69115904 00002000:00010000:3.0:1789760770.381301:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135008 -> 135016 00010000:00010000:3.0:1789760770.381316:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381333:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381343:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381350:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.381355:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381364:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381383:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.381391:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674cc6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69111808->69115903] (req 69111808->69115903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.381494:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6894us (7284us total) trans 4294984181 rc 0/0 00000100:00100000:3.0:1789760770.381505:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16884 00000100:00100000:3.0:1789760770.381516:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708619806804 time 708634876830 state 0x2 ref 0 00000100:00100000:1.0:1789760770.392316:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.399857:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984182 is committed 00000100:00100000:1.0:1789760770.405306:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.405394:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565389312 00000100:00100000:3.0:1789760770.405405:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565389312 00000100:00100000:3.0:1789760770.405459:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708635137246 time 708652965650 state 0x0 ref 1 00000100:00100000:3.0:1789760770.405474:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708653226066 time 708652965650 state 0x1 ref 1 00000100:00100000:3.0:1789760770.405613:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708653226066 time 708665903920 state 0x0 ref 1 00000100:00100000:3.0:1789760770.405628:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.405677:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69120000, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f70 00010000:00010000:3.0:1789760770.405687:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.405733:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.405738:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.405745:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.405759:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.411282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984183 is committed 00002000:00010000:3.0:1789760770.413901:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69120000 -> 69124096 00002000:00010000:3.0:1789760770.413910:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135024 -> 135032 00010000:00010000:3.0:1789760770.413924:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.413937:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.413952:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.413960:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.413965:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.413973:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.413993:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.414001:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69120000->69124095] (req 69120000->69124095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.414410:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8779us (9890us total) trans 4294984183 rc 0/0 00000100:00100000:3.0:1789760770.414420:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16886 00000100:00100000:3.0:1789760770.414494:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708653226066 time 708665903920 state 0x2 ref 0 00000100:00100000:1.0:1789760770.419652:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.419840:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565389440 00000100:00100000:3.0:1789760770.419849:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565389440 00000100:00100000:3.0:1789760770.420009:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708653226066 time 708665903920 state 0x0 ref 1 00000100:00100000:3.0:1789760770.420025:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708666164336 time 708665903920 state 0x1 ref 1 00000100:00100000:3.0:1789760770.420048:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708666164336 time 708680340381 state 0x0 ref 1 00000100:00100000:3.0:1789760770.420062:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565389440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.420109:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69124096, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f78 00010000:00010000:3.0:1789760770.420119:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.421033:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.421042:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.421049:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.421069:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.427691:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984184 is committed 00002000:00010000:1.0:1789760770.432034:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69124096 -> 69128192 00002000:00010000:1.0:1789760770.432045:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135032 -> 135040 00010000:00010000:1.0:1789760770.432059:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432072:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432080:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432087:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.432092:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432101:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432121:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.432129:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69124096->69128191] (req 69124096->69128191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.432685:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565389440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12620us (13037us total) trans 4294984184 rc 0/0 00000100:00100000:1.0:1789760770.432697:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16887 00000100:00100000:1.0:1789760770.432752:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708666164336 time 708680340381 state 0x2 ref 0 00000100:00100000:1.0:1789760770.448610:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.455182:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984185 is committed 00000100:00100000:0.0:1789760770.464670:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.464811:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565389696 00000100:00100000:3.0:1789760770.464820:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565389696 00000100:00100000:3.0:1789760770.464877:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708680600797 time 708709157275 state 0x0 ref 1 00000100:00100000:3.0:1789760770.464972:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708709417691 time 708709157275 state 0x1 ref 1 00000100:00100000:3.0:1789760770.465099:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708709417691 time 708725389825 state 0x0 ref 1 00000100:00100000:3.0:1789760770.465114:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.465163:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69132288, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20f88 00010000:00010000:3.0:1789760770.465173:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.465188:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789760770.465192:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.465198:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.465212:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.470606:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984186 is committed 00002000:00010000:3.0:1789760770.474633:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69132288 -> 69136384 00002000:00010000:3.0:1789760770.474643:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135048 -> 135056 00010000:00010000:3.0:1789760770.474657:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474670:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474679:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474687:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.474691:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474700:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474738:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.474746:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cc92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69132288->69136383] (req 69132288->69136383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.474856:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565389696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9740us (10191us total) trans 4294984186 rc 0/0 00000100:00100000:3.0:1789760770.474866:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16889 00000100:00100000:3.0:1789760770.474876:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708709417691 time 708725389825 state 0x2 ref 0 00000100:00100000:1.0:1789760770.483909:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.491668:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984187 is committed 00000100:00100000:1.0:1789760770.501131:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.506474:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984188 is committed 00002000:00010000:1.0:1789760770.507358:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69140480 -> 69144576 00002000:00010000:1.0:1789760770.507365:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135064 -> 135072 00010000:00010000:1.0:1789760770.507380:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507392:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507407:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507414:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.507419:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507427:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507512:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.507521:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674cca0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69140480->69144575] (req 69140480->69144575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.507664:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565389952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6322us (6598us total) trans 4294984188 rc 0/0 00000100:00100000:1.0:1789760770.507676:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16891 00000100:00100000:1.0:1789760770.507687:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708745685942 time 708761615697 state 0x2 ref 0 00000100:00100000:0.0:1789760770.524548:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.533456:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984189 is committed 00000100:00100000:1.0:1789760770.542287:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.547838:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984190 is committed 00000100:00100000:1.0:1789760770.556329:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.563240:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984191 is committed 00000100:00100000:1.0:1789760770.575240:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.580837:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984192 is committed 00000100:00100000:1.0:1789760770.585456:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.590583:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984193 is committed 00000100:00100000:1.0:1789760770.597151:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.602069:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984194 is committed 00000100:00100000:1.0:1789760770.605574:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.609660:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984195 is committed 00000100:00100000:1.0:1789760770.615589:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.622666:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984196 is committed 00000100:00100000:1.0:1789760770.628556:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760770.628986:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708879034252 time 708889274732 state 0x0 ref 1 00000100:00100000:1.0:1789760770.629000:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565391104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760770.629056:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69177344, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20fe0 00010000:00010000:1.0:1789760770.629065:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.629079:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1789760770.629084:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760770.629089:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.629115:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.633608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984197 is committed 00002000:00010000:1.0:1789760770.633747:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69177344 -> 69181440 00002000:00010000:1.0:1789760770.633752:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135136 -> 135144 00010000:00010000:1.0:1789760770.633765:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633782:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633800:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633807:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.633811:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633819:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633837:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.633848:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ccdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69177344->69181439] (req 69177344->69181439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.634271:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565391104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5268us (5719us total) trans 4294984197 rc 0/0 00000100:00100000:1.0:1789760770.634282:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16900 00000100:00100000:1.0:1789760770.634361:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708879034252 time 708889274732 state 0x2 ref 0 00000100:00100000:1.0:1789760770.638638:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.644213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984198 is committed 00000100:00100000:1.0:1789760770.657129:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565391360 00000100:00100000:1.0:1789760770.657139:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565391360 00000100:00100000:1.0:1789760770.657191:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708889535148 time 708899417382 state 0x0 ref 1 00000100:00100000:1.0:1789760770.657207:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708899677798 time 708899417382 state 0x1 ref 1 00000100:00100000:1.0:1789760770.657237:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708899677798 time 708917529250 state 0x0 ref 1 00000100:00100000:1.0:1789760770.657249:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565391360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760770.657298:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69185536, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x20ff0 00010000:00010000:1.0:1789760770.657307:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.657322:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1789760770.657326:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760770.657332:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.657344:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.663362:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984199 is committed 00002000:00010000:1.0:1789760770.663538:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69185536 -> 69189632 00002000:00010000:1.0:1789760770.663544:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135152 -> 135160 00010000:00010000:1.0:1789760770.663557:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663570:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663579:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663586:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.663590:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663598:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663616:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.663623:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69185536->69189631] (req 69185536->69189631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.663765:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565391360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6514us (6745us total) trans 4294984199 rc 0/0 00000100:00100000:1.0:1789760770.663776:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16902 00000100:00100000:1.0:1789760770.663795:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708899677798 time 708917529250 state 0x2 ref 0 00000100:00100000:1.0:1789760770.670433:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.679691:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984200 is committed 00000100:00100000:0.0:1789760770.685832:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.692252:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984201 is committed 00000100:00100000:1.0:1789760770.714005:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.720701:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984202 is committed 00000100:00100000:0.0:1789760770.738166:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.750068:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984203 is committed 00002000:00010000:3.0:1789760770.750391:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69201920 -> 69206016 00002000:00010000:3.0:1789760770.750397:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135184 -> 135192 00010000:00010000:3.0:1789760770.750411:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750424:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750433:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750441:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.750446:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750460:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750483:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.750491:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cd09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69201920->69206015] (req 69201920->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.750588:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565391872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12212us (12425us total) trans 4294984203 rc 0/0 00000100:00100000:3.0:1789760770.750604:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16906 00000100:00100000:3.0:1789760770.750613:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 708974759302 time 708998652744 state 0x2 ref 0 00000100:00100000:0.0:1789760770.756914:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.767205:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984204 is committed 00000100:00100000:1.0:1789760770.775291:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760770.780604:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984205 is committed 00000100:00100000:0.0:1789760770.787226:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.787416:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565392256 00000100:00100000:3.0:1789760770.787427:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565392256 00000100:00100000:3.0:1789760770.787482:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709017695232 time 709035838711 state 0x0 ref 1 00000100:00100000:3.0:1789760770.787496:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709036099127 time 709035838711 state 0x1 ref 1 00000100:00100000:3.0:1789760770.787528:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709036099127 time 709047820899 state 0x0 ref 1 00000100:00100000:3.0:1789760770.787539:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565392256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.787580:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69214208, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x21028 00010000:00010000:3.0:1789760770.787589:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.787604:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760770.787608:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.787614:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.787628:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760770.796877:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984206 is committed 00002000:00010000:3.0:1789760770.797058:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69214208 -> 69218304 00002000:00010000:3.0:1789760770.797064:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135208 -> 135216 00010000:00010000:3.0:1789760770.797078:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797090:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797098:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797105:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.797110:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797119:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797474:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.797483:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69214208->69218303] (req 69214208->69218303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.797574:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565392256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10031us (10352us total) trans 4294984206 rc 0/0 00000100:00100000:3.0:1789760770.797585:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16909 00000100:00100000:3.0:1789760770.797595:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709036099127 time 709047820899 state 0x2 ref 0 00000100:00100000:0.0:1789760770.801935:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.806835:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984207 is committed 00000100:00100000:1.0:1789760770.816227:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.824037:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984208 is committed 00000100:00100000:0.0:1789760770.829319:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.829401:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565392640 00000100:00100000:3.0:1789760770.829410:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565392640 00000100:00100000:3.0:1789760770.829463:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709062698221 time 709079422302 state 0x0 ref 1 00000100:00100000:3.0:1789760770.829477:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709079682718 time 709079422302 state 0x1 ref 1 00000100:00100000:3.0:1789760770.829506:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709079682718 time 709089798824 state 0x0 ref 1 00000100:00100000:3.0:1789760770.829518:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565392640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.829569:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69226496, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x21040 00010000:00010000:3.0:1789760770.829580:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.829595:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760770.829600:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.829606:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.829622:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.835513:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984209 is committed 00002000:00010000:3.0:1789760770.835995:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69226496 -> 69230592 00002000:00010000:3.0:1789760770.836001:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135232 -> 135240 00010000:00010000:3.0:1789760770.836013:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836026:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836035:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836042:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.836047:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836055:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836073:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.836086:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69226496->69230591] (req 69226496->69230591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.836396:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565392640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6874us (7082us total) trans 4294984209 rc 0/0 00000100:00100000:3.0:1789760770.836407:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16912 00000100:00100000:3.0:1789760770.836417:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709079682718 time 709089798824 state 0x2 ref 0 00000100:00100000:0.0:1789760770.841406:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.848694:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984210 is committed 00000100:00100000:1.0:1789760770.853982:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:1.0:1789760770.861171:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69234688 -> 69238784 00002000:00010000:1.0:1789760770.861177:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135248 -> 135256 00010000:00010000:1.0:1789760770.861191:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861203:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861223:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861232:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.861236:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861246:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861266:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.861281:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cd41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69234688->69238783] (req 69234688->69238783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.861378:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565392896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6770us (7403us total) trans 4294984211 rc 0/0 00000100:00100000:1.0:1789760770.861390:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16914 00000100:00100000:1.0:1789760770.861400:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709102141504 time 709114884092 state 0x2 ref 0 00000100:00100000:0.0:1789760770.866641:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.866864:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565393024 00000100:00100000:3.0:1789760770.866874:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565393024 00000100:00100000:3.0:1789760770.866925:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709102141504 time 709114884092 state 0x0 ref 1 00000100:00100000:3.0:1789760770.866940:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709115144508 time 709114884092 state 0x1 ref 1 00000100:00100000:3.0:1789760770.867681:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709115144508 time 709127967938 state 0x0 ref 1 00000100:00100000:3.0:1789760770.867700:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565393024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.867774:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69238784, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x21058 00010000:00010000:3.0:1789760770.867792:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.867808:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760770.867812:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.867818:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.867838:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760770.877834:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69238784 -> 69242880 00002000:00010000:3.0:1789760770.877839:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135256 -> 135264 00010000:00010000:3.0:1789760770.877853:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877866:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877876:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877883:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760770.877888:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877897:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877916:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.877924:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69238784->69242879] (req 69238784->69242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.878024:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565393024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10324us (11387us total) trans 4294984212 rc 0/0 00000100:00100000:3.0:1789760770.878035:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16915 00000100:00100000:3.0:1789760770.878044:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709115144508 time 709127967938 state 0x2 ref 0 00000100:00100000:0.0:1789760770.883881:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.891166:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984213 is committed 00000100:00100000:1.0:1789760770.904278:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:0.0:1789760770.920585:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69246976 -> 69251072 00002000:00010000:0.0:1789760770.920596:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135272 -> 135280 00010000:00010000:0.0:1789760770.920610:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920624:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920633:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920642:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760770.920647:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920655:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920681:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.920690:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cd56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69246976->69251071] (req 69246976->69251071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.920829:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565393280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16316us (16555us total) trans 4294984214 rc 0/0 00000100:00100000:0.0:1789760770.920848:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16917 00000100:00100000:0.0:1789760770.920861:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709144683103 time 709164788505 state 0x2 ref 0 00000100:00100000:0.0:1789760770.929602:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.929872:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565393408 00000100:00100000:3.0:1789760770.929882:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565393408 00000100:00100000:3.0:1789760770.929929:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709144683103 time 709164788505 state 0x0 ref 1 00000100:00100000:3.0:1789760770.929941:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709165048921 time 709164788505 state 0x1 ref 1 00000100:00100000:3.0:1789760770.930010:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709165048921 time 709190301963 state 0x0 ref 1 00000100:00100000:3.0:1789760770.930020:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565393408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.930060:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69251072, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0x21070 00010000:00010000:3.0:1789760770.930067:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.930080:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760770.930083:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.930088:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.930098:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760770.938853:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984215 is committed 00002000:00010000:1.0:1789760770.943251:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69251072 -> 69255168 00002000:00010000:1.0:1789760770.943261:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760770 -> 1789760771 00002000:00010000:1.0:1789760770.943264:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760770 -> 1789760771 00002000:00010000:1.0:1789760770.943267:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135280 -> 135288 00010000:00010000:1.0:1789760770.943279:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943292:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943301:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943309:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760770.943315:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943325:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943344:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.943352:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674cd5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69251072->69255167] (req 69251072->69255167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.948363:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565393408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18332us (18757us total) trans 4294984215 rc 0/0 00000100:00100000:0.0:1789760770.948379:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16918 00000100:00100000:0.0:1789760770.948389:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709165048921 time 709190301963 state 0x2 ref 0 00000100:00100000:1.0:1789760770.956550:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760770.968296:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984216 is committed 00000100:00100000:1.0:1789760770.984086:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760770.984233:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565393664 00000100:00100000:0.0:1789760770.984244:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565393664 00000100:00100000:0.0:1789760770.984301:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709190562379 time 709220405755 state 0x0 ref 1 00000100:00100000:0.0:1789760770.984317:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709220666171 time 709220405755 state 0x1 ref 1 00000100:00100000:0.0:1789760770.984385:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709220666171 time 709244676200 state 0x0 ref 1 00000100:00100000:0.0:1789760770.984398:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565393664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760770.984446:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69259264, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21080 00010000:00010000:0.0:1789760770.984455:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cd6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.984471:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760770.984475:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760770.984482:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cd6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69259264->69263359] (req 69259264->69263359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.984495:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cd6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69259264->69263359] (req 69259264->69263359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.992800:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984217 is committed 00000100:00100000:0.0:1789760770.998248:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760770.998400:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565393792 00000100:00100000:3.0:1789760770.998408:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565393792 00000100:00100000:3.0:1789760770.998460:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709220666171 time 709244676200 state 0x0 ref 1 00000100:00100000:3.0:1789760770.998475:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709244936616 time 709244676200 state 0x1 ref 1 00000100:00100000:3.0:1789760770.998529:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709244936616 time 709258820960 state 0x0 ref 1 00000100:00100000:3.0:1789760770.998541:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565393792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760770.998582:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69263360, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21088 00010000:00010000:3.0:1789760770.998591:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cd72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.998606:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760770.998610:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.998616:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cd72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69263360->69267455] (req 69263360->69267455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.998629:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674cd72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69263360->69267455] (req 69263360->69267455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.003608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984218 is committed 00000100:00100000:1.0:1789760771.008502:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.016654:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984219 is committed 00000100:00100000:1.0:1789760771.025882:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760771.030941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984220 is committed 00000100:00100000:0.0:1789760771.040510:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.050326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984221 is committed 00000100:00100000:1.0:1789760771.060333:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.066258:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984222 is committed 00000100:00100000:1.0:1789760771.073832:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760771.086049:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984223 is committed 00000100:00100000:0.0:1789760771.093636:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:1.0:1789760771.099301:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984224 is committed 00002000:00010000:3.0:1789760771.099504:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69287936 -> 69292032 00002000:00010000:3.0:1789760771.099519:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135352 -> 135360 00010000:00010000:3.0:1789760771.099532:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099544:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099553:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099560:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.099565:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099573:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099592:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.099600:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cd9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69287936->69292031] (req 69287936->69292031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.099686:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565394560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5711us (6055us total) trans 4294984224 rc 0/0 00000100:00100000:3.0:1789760771.099696:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16927 00000100:00100000:3.0:1789760771.100403:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709334919087 time 709354251786 state 0x2 ref 0 00000100:00100000:1.0:1789760771.103940:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.108655:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984225 is committed 00002000:00010000:3.0:1789760771.109000:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69292032 -> 69296128 00002000:00010000:3.0:1789760771.109006:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135360 -> 135368 00010000:00010000:3.0:1789760771.109022:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109037:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109047:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109056:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.109061:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109071:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109094:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.109103:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cda3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69292032->69296127] (req 69292032->69296127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.109310:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565394688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5152us (5373us total) trans 4294984225 rc 0/0 00000100:00100000:3.0:1789760771.109325:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16928 00000100:00100000:3.0:1789760771.109335:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709354512202 time 709364421030 state 0x2 ref 0 00000100:00100000:1.0:1789760771.114139:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.119013:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984226 is committed 00002000:00010000:1.0:1789760771.119206:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69296128 -> 69300224 00002000:00010000:1.0:1789760771.119211:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135368 -> 135376 00010000:00010000:1.0:1789760771.119224:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119236:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119245:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119252:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.119257:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119266:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119287:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.119295:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cdaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69296128->69300223] (req 69296128->69300223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.119387:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565394816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4849us (5262us total) trans 4294984226 rc 0/0 00000100:00100000:1.0:1789760771.119397:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16929 00000100:00100000:1.0:1789760771.119407:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709364681446 time 709374813820 state 0x2 ref 0 00000100:00100000:0.0:1789760771.124665:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.124811:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565394944 00000100:00100000:3.0:1789760771.124821:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565394944 00000100:00100000:3.0:1789760771.124885:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709364681446 time 709374813820 state 0x0 ref 1 00000100:00100000:3.0:1789760771.124901:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709375074236 time 709374813820 state 0x1 ref 1 00000100:00100000:3.0:1789760771.124922:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709375074236 time 709385214394 state 0x0 ref 1 00000100:00100000:3.0:1789760771.124934:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565394944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.124986:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69300224, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x210d0 00010000:00010000:3.0:1789760771.124996:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.125012:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760771.125016:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.125023:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.125036:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.130824:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984227 is committed 00002000:00010000:0.0:1789760771.130996:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69300224 -> 69304320 00002000:00010000:0.0:1789760771.131001:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135376 -> 135384 00010000:00010000:0.0:1789760771.131014:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131034:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131044:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131051:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.131056:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131065:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131085:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.131093:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674cdb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69300224->69304319] (req 69300224->69304319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.131200:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565394944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6264us (6538us total) trans 4294984227 rc 0/0 00000100:00100000:0.0:1789760771.131211:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16930 00000100:00100000:0.0:1789760771.131222:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709375074236 time 709385214394 state 0x2 ref 0 00000100:00100000:0.0:1789760771.142026:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.142358:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395072 00000100:00100000:3.0:1789760771.142370:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395072 00000100:00100000:3.0:1789760771.142426:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709375074236 time 709385214394 state 0x0 ref 1 00000100:00100000:3.0:1789760771.142441:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709385474810 time 709385214394 state 0x1 ref 1 00000100:00100000:3.0:1789760771.142471:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709385474810 time 709402763091 state 0x0 ref 1 00000100:00100000:3.0:1789760771.142484:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565395072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.143032:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69304320, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x210d8 00010000:00010000:3.0:1789760771.143042:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cdb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.143059:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760771.143063:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.143070:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69304320->69308415] (req 69304320->69308415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.143085:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674cdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69304320->69308415] (req 69304320->69308415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.147885:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984228 is committed 00000100:00100000:1.0:1789760771.154682:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.155038:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395200 00000100:00100000:0.0:1789760771.155049:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395200 00000100:00100000:0.0:1789760771.155107:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709385474810 time 709402763091 state 0x0 ref 1 00000100:00100000:0.0:1789760771.155122:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709403023507 time 709402763091 state 0x1 ref 1 00000100:00100000:0.0:1789760771.155154:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709403023507 time 709415445490 state 0x0 ref 1 00000100:00100000:0.0:1789760771.155177:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565395200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.155222:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69308416, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x210e0 00010000:00010000:0.0:1789760771.155230:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.155244:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.155249:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.155255:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.155269:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760771.169006:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69308416 -> 69312512 00002000:00010000:0.0:1789760771.169012:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135392 -> 135400 00010000:00010000:0.0:1789760771.169026:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169038:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169049:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169062:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.169068:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169077:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169098:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.169105:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674cdbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69308416->69312511] (req 69308416->69312511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.169265:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565395200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14085us (14589us total) trans 4294984229 rc 0/0 00000100:00100000:0.0:1789760771.169276:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16932 00000100:00100000:0.0:1789760771.169287:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709403023507 time 709415445490 state 0x2 ref 0 00000100:00100000:0.0:1789760771.177302:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.177527:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395328 00000100:00100000:3.0:1789760771.177536:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395328 00000100:00100000:3.0:1789760771.177587:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709403023507 time 709415445490 state 0x0 ref 1 00000100:00100000:3.0:1789760771.177601:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709415705906 time 709415445490 state 0x1 ref 1 00000100:00100000:3.0:1789760771.177667:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709415705906 time 709437958678 state 0x0 ref 1 00000100:00100000:3.0:1789760771.177682:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565395328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.177762:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69312512, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x210e8 00010000:00010000:3.0:1789760771.177773:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.177802:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760771.177807:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.177813:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.177827:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760771.184629:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69312512 -> 69316608 00002000:00010000:3.0:1789760771.184634:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135400 -> 135408 00010000:00010000:3.0:1789760771.184648:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184660:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184669:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184676:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.184682:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184691:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184750:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.184759:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cdc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69312512->69316607] (req 69312512->69316607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.184857:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565395328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7174us (7560us total) trans 4294984230 rc 0/0 00000100:00100000:3.0:1789760771.184877:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16933 00000100:00100000:3.0:1789760771.184887:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709415705906 time 709437958678 state 0x2 ref 0 00000100:00100000:1.0:1789760771.188683:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760771.197286:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984231 is committed 00000100:00100000:1.0:1789760771.203510:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.203876:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395584 00000100:00100000:0.0:1789760771.203886:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395584 00000100:00100000:0.0:1789760771.203941:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709438219094 time 709451356547 state 0x0 ref 1 00000100:00100000:0.0:1789760771.203961:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709451616963 time 709451356547 state 0x1 ref 1 00000100:00100000:0.0:1789760771.204372:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709451616963 time 709464661843 state 0x0 ref 1 00000100:00100000:0.0:1789760771.204387:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565395584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.204433:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69320704, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x210f8 00010000:00010000:0.0:1789760771.204442:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.204458:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.204463:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.204469:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.204482:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760771.211379:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69320704 -> 69324800 00002000:00010000:0.0:1789760771.211384:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135416 -> 135424 00010000:00010000:0.0:1789760771.211397:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211411:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211421:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211429:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.211434:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211443:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211463:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.211472:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674cdd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69320704->69324799] (req 69320704->69324799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.211607:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565395584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7219us (8101us total) trans 4294984232 rc 0/0 00000100:00100000:0.0:1789760771.211617:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16935 00000100:00100000:0.0:1789760771.211626:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709451616963 time 709464661843 state 0x2 ref 0 00000100:00100000:0.0:1789760771.215069:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.215248:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395712 00000100:00100000:3.0:1789760771.215258:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395712 00000100:00100000:3.0:1789760771.215310:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709451616963 time 709464661843 state 0x0 ref 1 00000100:00100000:3.0:1789760771.215324:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709464922259 time 709464661843 state 0x1 ref 1 00000100:00100000:3.0:1789760771.215391:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709464922259 time 709475682557 state 0x0 ref 1 00000100:00100000:3.0:1789760771.215404:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565395712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.215453:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69324800, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21100 00010000:00010000:3.0:1789760771.215463:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.215479:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760771.215483:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.215489:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.215503:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760771.222490:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69324800 -> 69328896 00002000:00010000:3.0:1789760771.222496:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135424 -> 135432 00010000:00010000:3.0:1789760771.222508:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222520:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222529:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222537:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.222542:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222555:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222574:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.222582:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69324800->69328895] (req 69324800->69328895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.222672:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565395712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7267us (7612us total) trans 4294984233 rc 0/0 00000100:00100000:3.0:1789760771.222682:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16936 00000100:00100000:3.0:1789760771.222691:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709464922259 time 709475682557 state 0x2 ref 0 00000100:00100000:1.0:1789760771.226514:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.226831:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709475942973 time 709487120847 state 0x0 ref 1 00000100:00100000:3.0:1789760771.226848:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565395840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.227315:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69328896, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21108 00010000:00010000:0.0:1789760771.227326:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674cde2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.227341:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.227346:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.227353:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674cde2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69328896->69332991] (req 69328896->69332991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.227367:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674cde2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69328896->69332991] (req 69328896->69332991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.235169:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984234 is committed 00000100:00100000:1.0:1789760771.239634:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.239791:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565395968 00000100:00100000:0.0:1789760771.239801:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565395968 00000100:00100000:0.0:1789760771.239855:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709475942973 time 709487120847 state 0x0 ref 1 00000100:00100000:0.0:1789760771.239871:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709487381263 time 709487120847 state 0x1 ref 1 00000100:00100000:0.0:1789760771.239890:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709487381263 time 709500182747 state 0x0 ref 1 00000100:00100000:0.0:1789760771.239902:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565395968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.239945:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69332992, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21110 00010000:00010000:0.0:1789760771.239954:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.239970:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.239974:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.239980:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.239994:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760771.248488:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69332992 -> 69337088 00002000:00010000:0.0:1789760771.248494:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135440 -> 135448 00010000:00010000:0.0:1789760771.248507:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248520:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248530:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248539:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.248544:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248554:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248572:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.248581:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674cde9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69332992->69337087] (req 69332992->69337087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.248758:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565395968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8853us (9129us total) trans 4294984235 rc 0/0 00000100:00100000:0.0:1789760771.248770:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16938 00000100:00100000:0.0:1789760771.248789:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709487381263 time 709500182747 state 0x2 ref 0 00000100:00100000:0.0:1789760771.260981:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.264138:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565396096 00000100:00100000:1.0:1789760771.264151:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565396096 00000100:00100000:1.0:1789760771.264214:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709487381263 time 709500182747 state 0x0 ref 1 00000100:00100000:1.0:1789760771.264231:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709500443163 time 709500182747 state 0x1 ref 1 00000100:00100000:1.0:1789760771.266847:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709500443163 time 709527127216 state 0x0 ref 1 00000100:00100000:1.0:1789760771.266876:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565396096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.267575:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69337088, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21118 00010000:00010000:1.0:1789760771.267587:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.267605:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.267609:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.267615:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.267629:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.275862:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984236 is committed 00002000:00010000:1.0:1789760771.276049:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69337088 -> 69341184 00002000:00010000:1.0:1789760771.276055:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135448 -> 135456 00010000:00010000:1.0:1789760771.276068:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276085:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276094:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276101:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.276106:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276116:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276136:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.276143:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674cdf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69337088->69341183] (req 69337088->69341183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.276504:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565396096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9633us (15527us total) trans 4294984236 rc 0/0 00000100:00100000:1.0:1789760771.276523:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16939 00000100:00100000:1.0:1789760771.276533:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709500443163 time 709527127216 state 0x2 ref 0 00010000:00010000:1.0:1789760771.277921:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760771.293820:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.302959:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984237 is committed 00000100:00100000:0.0:1789760771.311049:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565396352 00000100:00100000:0.0:1789760771.311059:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565396352 00000100:00100000:0.0:1789760771.311114:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709527387632 time 709554751370 state 0x0 ref 1 00000100:00100000:0.0:1789760771.311140:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709555011786 time 709554751370 state 0x1 ref 1 00000100:00100000:0.0:1789760771.311198:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709555011786 time 709571489724 state 0x0 ref 1 00000100:00100000:0.0:1789760771.311212:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565396352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.311257:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69345280, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21128 00010000:00010000:0.0:1789760771.311265:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.311280:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.311285:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.311291:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.311304:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760771.321874:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69345280 -> 69349376 00002000:00010000:0.0:1789760771.321879:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135464 -> 135472 00010000:00010000:0.0:1789760771.321892:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321906:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321914:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321921:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.321925:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321933:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321954:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.321962:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674cdfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69345280->69349375] (req 69345280->69349375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.322059:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565396352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10843us (11107us total) trans 4294984238 rc 0/0 00000100:00100000:0.0:1789760771.322071:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16941 00000100:00100000:0.0:1789760771.322080:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709555011786 time 709571489724 state 0x2 ref 0 00000100:00100000:0.0:1789760771.326283:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.326552:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565396480 00000100:00100000:1.0:1789760771.326562:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565396480 00000100:00100000:1.0:1789760771.326617:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709555011786 time 709571489724 state 0x0 ref 1 00000100:00100000:1.0:1789760771.326633:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709571750140 time 709571489724 state 0x1 ref 1 00000100:00100000:1.0:1789760771.326671:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709571750140 time 709586962858 state 0x0 ref 1 00000100:00100000:1.0:1789760771.326684:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565396480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.327024:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69349376, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21130 00010000:00010000:1.0:1789760771.327035:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.327050:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.327054:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.327060:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.327073:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760771.337451:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69349376 -> 69353472 00002000:00010000:1.0:1789760771.337456:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135472 -> 135480 00010000:00010000:1.0:1789760771.337470:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337488:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337497:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337505:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.337509:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337518:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337539:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.337546:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ce05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69349376->69353471] (req 69349376->69353471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.337647:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565396480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10960us (11370us total) trans 4294984239 rc 0/0 00000100:00100000:1.0:1789760771.337659:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16942 00000100:00100000:1.0:1789760771.337668:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709571750140 time 709586962858 state 0x2 ref 0 00000100:00100000:1.0:1789760771.345151:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.353606:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984240 is committed 00000100:00100000:0.0:1789760771.369564:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565396736 00000100:00100000:0.0:1789760771.369574:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565396736 00000100:00100000:0.0:1789760771.369628:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709587223274 time 709605648367 state 0x0 ref 1 00000100:00100000:0.0:1789760771.369644:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709605908783 time 709605648367 state 0x1 ref 1 00000100:00100000:0.0:1789760771.369675:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709605908783 time 709629967286 state 0x0 ref 1 00000100:00100000:0.0:1789760771.369689:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565396736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.369856:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69357568, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21140 00010000:00010000:0.0:1789760771.370004:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.370022:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.370026:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.370033:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.370047:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.382435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984241 is committed 00002000:00010000:0.0:1789760771.386096:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69357568 -> 69361664 00002000:00010000:0.0:1789760771.386166:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135488 -> 135496 00010000:00010000:0.0:1789760771.386180:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386194:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386204:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386211:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.386216:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386225:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386244:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.386252:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ce13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69357568->69361663] (req 69357568->69361663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.386417:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565396736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16726us (16934us total) trans 4294984241 rc 0/0 00000100:00100000:0.0:1789760771.386429:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16944 00000100:00100000:0.0:1789760771.386439:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709605908783 time 709629967286 state 0x2 ref 0 00000100:00100000:0.0:1789760771.397539:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.397641:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565396864 00000100:00100000:1.0:1789760771.397651:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565396864 00000100:00100000:1.0:1789760771.397745:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709605908783 time 709629967286 state 0x0 ref 1 00000100:00100000:1.0:1789760771.397760:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709630227702 time 709629967286 state 0x1 ref 1 00000100:00100000:1.0:1789760771.397789:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709630227702 time 709658081668 state 0x0 ref 1 00000100:00100000:1.0:1789760771.397800:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565396864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.397847:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69361664, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21148 00010000:00010000:1.0:1789760771.397856:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.397883:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.397887:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.397901:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.397919:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.404490:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984242 is committed 00002000:00010000:1.0:1789760771.404849:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69361664 -> 69365760 00002000:00010000:1.0:1789760771.404854:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135496 -> 135504 00010000:00010000:1.0:1789760771.404868:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405039:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405051:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405059:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.405063:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405073:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405094:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.405101:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ce1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69361664->69365759] (req 69361664->69365759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.405510:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565396864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7704us (7976us total) trans 4294984242 rc 0/0 00000100:00100000:1.0:1789760771.405521:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16945 00000100:00100000:1.0:1789760771.405531:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709630227702 time 709658081668 state 0x2 ref 0 00000100:00100000:1.0:1789760771.411570:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:0.0:1789760771.417769:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984243 is committed 00000100:00100000:0.0:1789760771.424186:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397120 00000100:00100000:0.0:1789760771.424195:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397120 00000100:00100000:0.0:1789760771.424247:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709658342084 time 709672202984 state 0x0 ref 1 00000100:00100000:0.0:1789760771.424263:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709672463400 time 709672202984 state 0x1 ref 1 00000100:00100000:0.0:1789760771.424291:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709672463400 time 709684583864 state 0x0 ref 1 00000100:00100000:0.0:1789760771.424304:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565397120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.424346:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69369856, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21158 00010000:00010000:0.0:1789760771.424356:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.424372:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.424376:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.424382:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.424396:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.430226:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984244 is committed 00002000:00010000:0.0:1789760771.430496:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69369856 -> 69373952 00002000:00010000:0.0:1789760771.430502:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135512 -> 135520 00010000:00010000:0.0:1789760771.430520:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430536:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430544:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430551:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.430556:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430565:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430586:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.430595:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674ce28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69369856->69373951] (req 69369856->69373951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.430915:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565397120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6607us (6816us total) trans 4294984244 rc 0/0 00000100:00100000:0.0:1789760771.430927:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16947 00000100:00100000:0.0:1789760771.430937:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709672463400 time 709684583864 state 0x2 ref 0 00000100:00100000:0.0:1789760771.435541:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.435630:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397248 00000100:00100000:1.0:1789760771.435641:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397248 00000100:00100000:1.0:1789760771.436047:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709672463400 time 709684583864 state 0x0 ref 1 00000100:00100000:1.0:1789760771.436068:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709684844280 time 709684583864 state 0x1 ref 1 00000100:00100000:1.0:1789760771.436140:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709684844280 time 709696431589 state 0x0 ref 1 00000100:00100000:1.0:1789760771.436152:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565397248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.436198:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69373952, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21160 00010000:00010000:1.0:1789760771.436208:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.436224:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.436228:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.436235:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.436249:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.442910:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984245 is committed 00002000:00010000:1.0:1789760771.447067:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69373952 -> 69378048 00002000:00010000:1.0:1789760771.447075:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135520 -> 135528 00010000:00010000:1.0:1789760771.447088:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447101:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447111:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447120:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.447191:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447203:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447224:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.447233:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674ce2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69373952->69378047] (req 69373952->69378047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.447341:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565397248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11185us (11805us total) trans 4294984245 rc 0/0 00000100:00100000:1.0:1789760771.447559:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16948 00000100:00100000:1.0:1789760771.447570:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709684844280 time 709696431589 state 0x2 ref 0 00000100:00100000:1.0:1789760771.453035:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000001:00080000:3.0:1789760771.458350:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984246 is committed 00010000:00010000:2.0:1789760771.458543:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69378048->69382143] (req 69378048->69382143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.458559:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69378048->69382143] (req 69378048->69382143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.458580:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69378048->69382143] (req 69378048->69382143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.458588:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69378048->69382143] (req 69378048->69382143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.458683:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565397376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5189us (5651us total) trans 4294984246 rc 0/0 00000100:00100000:2.0:1789760771.458694:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16949 00000100:00100000:2.0:1789760771.458743:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709696692005 time 709713769694 state 0x2 ref 0 00000100:00100000:2.0:1789760771.461974:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.462051:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397504 00000100:00100000:0.0:1789760771.462060:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397504 00000100:00100000:0.0:1789760771.462114:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709696692005 time 709713769694 state 0x0 ref 1 00000100:00100000:0.0:1789760771.462129:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709714030110 time 709713769694 state 0x1 ref 1 00000100:00100000:0.0:1789760771.462157:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709714030110 time 709722449740 state 0x0 ref 1 00000100:00100000:0.0:1789760771.462169:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565397504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.462212:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69382144, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21170 00010000:00010000:0.0:1789760771.462221:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.462237:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.462241:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.462248:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.462262:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.468849:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984247 is committed 00002000:00010000:0.0:1789760771.469008:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69382144 -> 69386240 00002000:00010000:0.0:1789760771.469015:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135536 -> 135544 00010000:00010000:0.0:1789760771.469028:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469041:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469050:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469058:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.469062:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469071:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469091:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.469100:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69382144->69386239] (req 69382144->69386239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.469244:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565397504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7072us (7275us total) trans 4294984247 rc 0/0 00000100:00100000:0.0:1789760771.469255:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16950 00000100:00100000:0.0:1789760771.469264:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709714030110 time 709722449740 state 0x2 ref 0 00000100:00100000:0.0:1789760771.473544:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.473899:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.473981:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.474230:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397760 00000100:00100000:0.0:1789760771.474241:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397760 00000100:00100000:0.0:1789760771.474307:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398016 00000100:00100000:0.0:1789760771.474310:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398016 00000100:00100000:0.0:1789760771.474337:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 457 00000100:00100000:0.0:1789760771.474356:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2360:x1876699565397760:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1789760771.474426:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2360:x1876699565397760:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760771.474433:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 457 00000100:00100000:0.0:1789760771.474458:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 458 00000100:00100000:0.0:1789760771.474465:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565398016:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1789760771.474491:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565398016:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760771.474496:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 458 00000100:00080000:2.0:1789760771.474554:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760771.475033:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.475155:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397888 00000100:00100000:2.0:1789760771.475161:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397888 00000100:00100000:2.0:1789760771.475201:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709714030110 time 709722449740 state 0x0 ref 1 00000100:00100000:2.0:1789760771.475214:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709722710156 time 709722449740 state 0x1 ref 1 00000100:00100000:2.0:1789760771.475241:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709722710156 time 709735532940 state 0x0 ref 1 00000100:00100000:2.0:1789760771.475252:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565397888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.475295:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69386240, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21178 00010000:00010000:2.0:1789760771.475305:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.475325:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.475329:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.475335:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.475354:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.476024:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565397632 00000100:00100000:1.0:1789760771.476032:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565397632 00000100:00100000:1.0:1789760771.476071:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 394 00000100:00100000:1.0:1789760771.476079:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565397632:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760771.476134:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565397632:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760771.476145:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 394 00000001:00080000:1.0:1789760771.481141:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984248 is committed 00002000:00010000:2.0:1789760771.481259:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69386240 -> 69390336 00002000:00010000:2.0:1789760771.481266:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135544 -> 135552 00010000:00010000:2.0:1789760771.481280:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481291:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481300:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481306:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.481312:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481319:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481337:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.481345:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69386240->69390335] (req 69386240->69390335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.481435:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565397888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6180us (6399us total) trans 4294984248 rc 0/0 00000100:00100000:2.0:1789760771.481446:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16951 00000100:00100000:2.0:1789760771.481456:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709722710156 time 709735532940 state 0x2 ref 0 00000100:00100000:1.0:1789760771.486040:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.486119:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398144 00000100:00100000:2.0:1789760771.486129:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398144 00000100:00100000:2.0:1789760771.486182:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709722710156 time 709735532940 state 0x0 ref 1 00000100:00100000:2.0:1789760771.486198:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709735793356 time 709735532940 state 0x1 ref 1 00000100:00100000:2.0:1789760771.486229:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709735793356 time 709746521255 state 0x0 ref 1 00000100:00100000:2.0:1789760771.486242:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.486291:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69390336, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21180 00010000:00010000:2.0:1789760771.486301:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.486316:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.486321:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.486327:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.486341:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.489962:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984249 is committed 00002000:00010000:2.0:1789760771.490204:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69390336 -> 69394432 00002000:00010000:2.0:1789760771.490209:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135552 -> 135560 00010000:00010000:2.0:1789760771.490223:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490235:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490243:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490250:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.490256:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490265:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490286:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.490294:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674ce4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69390336->69394431] (req 69390336->69394431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.490426:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4182us (4391us total) trans 4294984249 rc 0/0 00000100:00100000:2.0:1789760771.490436:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16952 00000100:00100000:2.0:1789760771.490445:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709735793356 time 709746521255 state 0x2 ref 0 00000100:00100000:0.0:1789760771.499150:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.500137:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398272 00000100:00100000:1.0:1789760771.500149:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398272 00000100:00100000:1.0:1789760771.500206:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709735793356 time 709746521255 state 0x0 ref 1 00000100:00100000:1.0:1789760771.500222:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709746781671 time 709746521255 state 0x1 ref 1 00000100:00100000:1.0:1789760771.500340:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709746781671 time 709760630595 state 0x0 ref 1 00000100:00100000:1.0:1789760771.500354:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565398272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.500403:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69394432, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21188 00010000:00010000:1.0:1789760771.500414:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.500430:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.500434:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.500440:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.500454:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.508409:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984250 is committed 00002000:00010000:1.0:1789760771.515275:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69394432 -> 69398528 00002000:00010000:1.0:1789760771.515286:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135560 -> 135568 00010000:00010000:1.0:1789760771.515300:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515313:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515323:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515330:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.515335:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515343:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515363:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.515371:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69394432->69398527] (req 69394432->69398527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.515534:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565398272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15178us (16390us total) trans 4294984250 rc 0/0 00000100:00100000:1.0:1789760771.515546:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16953 00000100:00100000:1.0:1789760771.515557:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709746781671 time 709760630595 state 0x2 ref 0 00000100:00100000:3.0:1789760771.520412:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.524466:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398400 00000100:00100000:2.0:1789760771.524479:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398400 00000100:00100000:2.0:1789760771.524532:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709746781671 time 709760630595 state 0x0 ref 1 00000100:00100000:2.0:1789760771.524545:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709760891011 time 709760630595 state 0x1 ref 1 00000100:00100000:2.0:1789760771.524582:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709760891011 time 709784873989 state 0x0 ref 1 00000100:00100000:2.0:1789760771.524596:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.524646:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69398528, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21190 00010000:00010000:2.0:1789760771.524655:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.524674:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.524678:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.524682:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.524692:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.531068:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984251 is committed 00002000:00010000:3.0:1789760771.531412:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69398528 -> 69402624 00002000:00010000:3.0:1789760771.531418:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135568 -> 135576 00010000:00010000:3.0:1789760771.531432:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531444:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531453:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531461:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.531466:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531474:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531492:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.531499:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674ce59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69398528->69402623] (req 69398528->69402623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.531591:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6994us (11184us total) trans 4294984251 rc 0/0 00000100:00100000:3.0:1789760771.531602:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16954 00000100:00100000:3.0:1789760771.531611:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709760891011 time 709784873989 state 0x2 ref 0 00000100:00100000:2.0:1789760771.537675:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.538086:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398528 00000100:00100000:0.0:1789760771.538097:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398528 00000100:00100000:0.0:1789760771.538163:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709760891011 time 709784873989 state 0x0 ref 1 00000100:00100000:0.0:1789760771.538177:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709785134405 time 709784873989 state 0x1 ref 1 00000100:00100000:0.0:1789760771.538210:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709785134405 time 709798502431 state 0x0 ref 1 00000100:00100000:0.0:1789760771.538227:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565398528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.538277:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69402624, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21198 00010000:00010000:0.0:1789760771.538287:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.538303:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.538307:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.538314:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.538328:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.543860:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984252 is committed 00002000:00010000:0.0:1789760771.543980:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69402624 -> 69406720 00002000:00010000:0.0:1789760771.543986:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135576 -> 135584 00010000:00010000:0.0:1789760771.543999:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544011:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544020:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544027:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.544032:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544041:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544061:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.544068:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ce60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69402624->69406719] (req 69402624->69406719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.544172:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565398528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5943us (6502us total) trans 4294984252 rc 0/0 00000100:00100000:0.0:1789760771.544182:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16955 00000100:00100000:0.0:1789760771.544191:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709785134405 time 709798502431 state 0x2 ref 0 00000100:00100000:0.0:1789760771.551499:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.551695:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398656 00000100:00100000:1.0:1789760771.551731:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398656 00000100:00100000:1.0:1789760771.551791:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709785134405 time 709798502431 state 0x0 ref 1 00000100:00100000:1.0:1789760771.551807:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709798762847 time 709798502431 state 0x1 ref 1 00000100:00100000:1.0:1789760771.551840:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709798762847 time 709812132403 state 0x0 ref 1 00000100:00100000:1.0:1789760771.551853:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.551912:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69406720, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211a0 00010000:00010000:1.0:1789760771.551922:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.551938:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.551942:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.551948:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.551961:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.560532:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984253 is committed 00002000:00010000:1.0:1789760771.560662:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69406720 -> 69410816 00002000:00010000:1.0:1789760771.560668:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135584 -> 135592 00010000:00010000:1.0:1789760771.560681:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560698:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560735:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560743:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.560748:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560758:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560787:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.560795:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69406720->69410815] (req 69406720->69410815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.560894:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9038us (9400us total) trans 4294984253 rc 0/0 00000100:00100000:1.0:1789760771.560905:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16956 00000100:00100000:1.0:1789760771.560914:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709798762847 time 709812132403 state 0x2 ref 0 00000100:00100000:3.0:1789760771.572544:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.573591:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398784 00000100:00100000:1.0:1789760771.573604:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398784 00000100:00100000:1.0:1789760771.573662:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709798762847 time 709812132403 state 0x0 ref 1 00000100:00100000:1.0:1789760771.573678:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709812392819 time 709812132403 state 0x1 ref 1 00000100:00100000:1.0:1789760771.573722:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709812392819 time 709834014449 state 0x0 ref 1 00000100:00100000:1.0:1789760771.573735:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565398784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.573792:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69410816, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211a8 00010000:00010000:1.0:1789760771.573801:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.573817:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.573821:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.573827:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.573840:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.578940:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984254 is committed 00002000:00010000:1.0:1789760771.579096:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69410816 -> 69414912 00002000:00010000:1.0:1789760771.579103:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135592 -> 135600 00010000:00010000:1.0:1789760771.579116:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579140:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579156:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579163:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.579168:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579178:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579198:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.579207:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69410816->69414911] (req 69410816->69414911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.579303:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565398784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5565us (6764us total) trans 4294984254 rc 0/0 00000100:00100000:1.0:1789760771.579315:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16957 00000100:00100000:1.0:1789760771.579323:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709812392819 time 709834014449 state 0x2 ref 0 00000100:00100000:2.0:1789760771.589983:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.591381:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565398912 00000100:00100000:0.0:1789760771.591394:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565398912 00000100:00100000:0.0:1789760771.591462:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709812392819 time 709834014449 state 0x0 ref 1 00000100:00100000:0.0:1789760771.591479:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709834274865 time 709834014449 state 0x1 ref 1 00000100:00100000:0.0:1789760771.591513:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709834274865 time 709851804872 state 0x0 ref 1 00000100:00100000:0.0:1789760771.591527:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.591579:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69414912, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211b0 00010000:00010000:0.0:1789760771.591589:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.591605:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.591609:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.591616:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.591630:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.597558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984255 is committed 00002000:00010000:0.0:1789760771.597908:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69414912 -> 69419008 00002000:00010000:0.0:1789760771.597913:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135600 -> 135608 00010000:00010000:0.0:1789760771.597926:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.597939:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.597949:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.597957:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.597962:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.597976:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.597999:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.598007:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69414912->69419007] (req 69414912->69419007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.598152:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565398912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6622us (8174us total) trans 4294984255 rc 0/0 00000100:00100000:0.0:1789760771.598163:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16958 00000100:00100000:0.0:1789760771.598173:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709834274865 time 709851804872 state 0x2 ref 0 00000100:00100000:0.0:1789760771.607696:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.608569:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399040 00000100:00100000:1.0:1789760771.608581:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399040 00000100:00100000:1.0:1789760771.608641:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709834274865 time 709851804872 state 0x0 ref 1 00000100:00100000:1.0:1789760771.608658:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709852065288 time 709851804872 state 0x1 ref 1 00000100:00100000:1.0:1789760771.609276:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709852065288 time 709869565591 state 0x0 ref 1 00000100:00100000:1.0:1789760771.609293:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565399040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.609343:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69419008, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211b8 00010000:00010000:1.0:1789760771.609353:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.609369:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.609374:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.609381:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.609396:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.618187:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984256 is committed 00002000:00010000:1.0:1789760771.618531:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69419008 -> 69423104 00002000:00010000:1.0:1789760771.618537:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135608 -> 135616 00010000:00010000:1.0:1789760771.618549:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618563:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618573:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618586:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.618591:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618600:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618620:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.618627:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69419008->69423103] (req 69419008->69423103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.619143:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565399040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9847us (11450us total) trans 4294984256 rc 0/0 00000100:00100000:1.0:1789760771.619156:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16959 00000100:00100000:1.0:1789760771.619166:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709852065288 time 709869565591 state 0x2 ref 0 00000100:00100000:2.0:1789760771.623586:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.623695:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399168 00000100:00100000:1.0:1789760771.623836:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399168 00000100:00100000:2.0:1789760771.624030:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709852065288 time 709869565591 state 0x0 ref 1 00000100:00100000:2.0:1789760771.624046:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709869826007 time 709869565591 state 0x1 ref 1 00000100:00100000:2.0:1789760771.624106:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709869826007 time 709884398525 state 0x0 ref 1 00000100:00100000:2.0:1789760771.624119:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565399168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.624174:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69423104, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211c0 00010000:00010000:2.0:1789760771.624185:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.624200:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.624205:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.624211:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.624223:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.629551:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984257 is committed 00002000:00010000:2.0:1789760771.630112:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69423104 -> 69427200 00002000:00010000:2.0:1789760771.630118:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135616 -> 135624 00010000:00010000:2.0:1789760771.630196:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630209:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630219:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630227:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.630232:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630242:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630262:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.630275:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ce83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69423104->69427199] (req 69423104->69427199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.630414:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565399168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6292us (6832us total) trans 4294984257 rc 0/0 00000100:00100000:2.0:1789760771.630435:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16960 00000100:00100000:2.0:1789760771.630444:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709869826007 time 709884398525 state 0x2 ref 0 00000100:00100000:2.0:1789760771.634816:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.635364:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399296 00000100:00100000:0.0:1789760771.635375:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399296 00000100:00100000:0.0:1789760771.635496:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709869826007 time 709884398525 state 0x0 ref 1 00000100:00100000:0.0:1789760771.635512:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709884658941 time 709884398525 state 0x1 ref 1 00000100:00100000:0.0:1789760771.635541:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709884658941 time 709895833112 state 0x0 ref 1 00000100:00100000:0.0:1789760771.635553:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565399296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.635596:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69427200, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211c8 00010000:00010000:0.0:1789760771.635606:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.635623:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.635628:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.635634:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.635648:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.640283:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984258 is committed 00002000:00010000:2.0:1789760771.640527:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69427200 -> 69431296 00002000:00010000:2.0:1789760771.640533:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135624 -> 135632 00010000:00010000:2.0:1789760771.640547:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640561:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640570:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640578:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.640583:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640592:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640613:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.640622:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674ce8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69427200->69431295] (req 69427200->69431295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.640821:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565399296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5264us (6008us total) trans 4294984258 rc 0/0 00000100:00100000:2.0:1789760771.640833:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16961 00000100:00100000:2.0:1789760771.640844:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709884658941 time 709895833112 state 0x2 ref 0 00000100:00100000:0.0:1789760771.645571:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.645649:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399424 00000100:00100000:1.0:1789760771.645659:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399424 00000100:00100000:1.0:1789760771.646222:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709884658941 time 709895833112 state 0x0 ref 1 00000100:00100000:1.0:1789760771.646240:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709896093528 time 709895833112 state 0x1 ref 1 00000100:00100000:1.0:1789760771.646311:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709896093528 time 709906602444 state 0x0 ref 1 00000100:00100000:1.0:1789760771.646326:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565399424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.646375:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69431296, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211d0 00010000:00010000:1.0:1789760771.646384:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.646400:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.646405:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.646412:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.646439:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760771.653318:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984259 is committed 00002000:00010000:0.0:1789760771.653566:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69431296 -> 69435392 00002000:00010000:0.0:1789760771.653571:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135632 -> 135640 00010000:00010000:0.0:1789760771.653584:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653596:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653605:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653612:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.653616:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653630:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653650:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.653658:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674ce91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69431296->69435391] (req 69431296->69435391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.654559:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565399424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8228us (8990us total) trans 4294984259 rc 0/0 00000100:00100000:0.0:1789760771.654571:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16962 00000100:00100000:0.0:1789760771.654581:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709896093528 time 709906602444 state 0x2 ref 0 00000100:00100000:0.0:1789760771.662694:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.663487:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399552 00000100:00100000:2.0:1789760771.663497:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399552 00000100:00100000:2.0:1789760771.663556:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709896093528 time 709906602444 state 0x0 ref 1 00000100:00100000:2.0:1789760771.663572:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709906862860 time 709906602444 state 0x1 ref 1 00000100:00100000:2.0:1789760771.663649:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709906862860 time 709923940599 state 0x0 ref 1 00000100:00100000:2.0:1789760771.663664:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565399552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.663745:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69435392, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211d8 00010000:00010000:2.0:1789760771.663755:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.663771:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.663784:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.663791:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.663805:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760771.667838:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984260 is committed 00002000:00010000:2.0:1789760771.668236:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69435392 -> 69439488 00002000:00010000:2.0:1789760771.668241:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135640 -> 135648 00010000:00010000:2.0:1789760771.668255:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668268:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668278:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668285:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.668290:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668299:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668318:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.668332:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ce98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69435392->69439487] (req 69435392->69439487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.668468:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565399552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4803us (5778us total) trans 4294984260 rc 0/0 00000100:00100000:2.0:1789760771.668479:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16963 00000100:00100000:2.0:1789760771.668488:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709906862860 time 709923940599 state 0x2 ref 0 00000100:00100000:2.0:1789760771.674487:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.674597:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399680 00000100:00100000:0.0:1789760771.674606:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399680 00000100:00100000:0.0:1789760771.674661:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709906862860 time 709923940599 state 0x0 ref 1 00000100:00100000:0.0:1789760771.674677:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709924201015 time 709923940599 state 0x1 ref 1 00000100:00100000:0.0:1789760771.674840:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709924201015 time 709935131045 state 0x0 ref 1 00000100:00100000:0.0:1789760771.674856:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565399680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.674977:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69439488, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211e0 00010000:00010000:0.0:1789760771.674990:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.675005:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.675010:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.675016:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.675030:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.681096:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984261 is committed 00002000:00010000:2.0:1789760771.681389:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69439488 -> 69443584 00002000:00010000:2.0:1789760771.681395:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135648 -> 135656 00010000:00010000:2.0:1789760771.681409:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681504:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681514:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681523:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.681528:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681537:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681558:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.681567:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ce9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69439488->69443583] (req 69439488->69443583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.681663:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565399680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6804us (7246us total) trans 4294984261 rc 0/0 00000100:00100000:2.0:1789760771.681673:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16964 00000100:00100000:2.0:1789760771.681684:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709924201015 time 709935131045 state 0x2 ref 0 00000100:00100000:0.0:1789760771.686174:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760771.686569:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399808 00000100:00100000:1.0:1789760771.686580:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399808 00000100:00100000:1.0:1789760771.686634:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709924201015 time 709935131045 state 0x0 ref 1 00000100:00100000:1.0:1789760771.686649:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709935391461 time 709935131045 state 0x1 ref 1 00000100:00100000:1.0:1789760771.686681:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709935391461 time 709946972536 state 0x0 ref 1 00000100:00100000:1.0:1789760771.686693:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565399808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760771.686927:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69443584, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211e8 00010000:00010000:1.0:1789760771.686936:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.686952:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789760771.686957:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.686963:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.686978:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.691968:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984262 is committed 00002000:00010000:2.0:1789760771.692064:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69443584 -> 69447680 00002000:00010000:2.0:1789760771.692069:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135656 -> 135664 00010000:00010000:2.0:1789760771.692082:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692094:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692103:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692110:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.692115:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692130:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692148:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.692155:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674cea6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69443584->69447679] (req 69443584->69447679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.692251:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565399808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5556us (6090us total) trans 4294984262 rc 0/0 00000100:00100000:2.0:1789760771.692261:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16965 00000100:00100000:2.0:1789760771.692270:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709935391461 time 709946972536 state 0x2 ref 0 00000100:00100000:0.0:1789760771.697081:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.697160:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565399936 00000100:00100000:2.0:1789760771.697181:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565399936 00000100:00100000:2.0:1789760771.697236:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709935391461 time 709946972536 state 0x0 ref 1 00000100:00100000:2.0:1789760771.697252:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709947232952 time 709946972536 state 0x1 ref 1 00000100:00100000:2.0:1789760771.697286:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709947232952 time 709957578281 state 0x0 ref 1 00000100:00100000:2.0:1789760771.697298:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565399936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.697350:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69447680, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211f0 00010000:00010000:2.0:1789760771.697360:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.697377:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.697381:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.697387:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.697402:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.701937:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984263 is committed 00002000:00010000:2.0:1789760771.702054:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69447680 -> 69451776 00002000:00010000:2.0:1789760771.702059:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135664 -> 135672 00010000:00010000:2.0:1789760771.702072:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702084:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702092:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702098:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.702103:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702112:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702135:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.702143:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674cead lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69447680->69451775] (req 69447680->69451775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.702270:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565399936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4969us (5194us total) trans 4294984263 rc 0/0 00000100:00100000:2.0:1789760771.702281:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16966 00000100:00100000:2.0:1789760771.702291:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709947232952 time 709957578281 state 0x2 ref 0 00000100:00100000:2.0:1789760771.708516:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.708688:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400064 00000100:00100000:0.0:1789760771.708698:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400064 00000100:00100000:0.0:1789760771.709323:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709947232952 time 709957578281 state 0x0 ref 1 00000100:00100000:0.0:1789760771.709340:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709957838697 time 709957578281 state 0x1 ref 1 00000100:00100000:0.0:1789760771.709417:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709957838697 time 709969708100 state 0x0 ref 1 00000100:00100000:0.0:1789760771.709432:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.709481:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69451776, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x211f8 00010000:00010000:0.0:1789760771.709490:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.709508:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789760771.709512:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.709519:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.709534:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.713561:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984264 is committed 00002000:00010000:0.0:1789760771.713681:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69451776 -> 69455872 00002000:00010000:0.0:1789760771.713687:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135672 -> 135680 00010000:00010000:0.0:1789760771.713721:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713735:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713743:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713750:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.713756:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713765:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713803:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.713811:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ceb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69451776->69455871] (req 69451776->69455871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.713899:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4465us (5391us total) trans 4294984264 rc 0/0 00000100:00100000:0.0:1789760771.713910:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16967 00000100:00100000:0.0:1789760771.713920:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709957838697 time 709969708100 state 0x2 ref 0 00000100:00100000:1.0:1789760771.722902:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.723023:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400192 00000100:00100000:2.0:1789760771.723038:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400192 00000100:00100000:2.0:1789760771.723097:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709957838697 time 709969708100 state 0x0 ref 1 00000100:00100000:2.0:1789760771.723113:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709969968516 time 709969708100 state 0x1 ref 1 00000100:00100000:2.0:1789760771.723144:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709969968516 time 709983436216 state 0x0 ref 1 00000100:00100000:2.0:1789760771.723157:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.723204:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69455872, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21200 00010000:00010000:2.0:1789760771.723214:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.723348:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789760771.723353:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.723361:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.723376:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.729204:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984265 is committed 00002000:00010000:2.0:1789760771.729317:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69455872 -> 69459968 00002000:00010000:2.0:1789760771.729322:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135680 -> 135688 00010000:00010000:2.0:1789760771.729336:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729349:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729358:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729366:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.729371:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729380:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729403:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.729411:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674cebb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69455872->69459967] (req 69455872->69459967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.729507:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6348us (6611us total) trans 4294984265 rc 0/0 00000100:00100000:2.0:1789760771.729517:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16968 00000100:00100000:2.0:1789760771.729527:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709969968516 time 709983436216 state 0x2 ref 0 00000100:00100000:2.0:1789760771.732783:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.732859:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400320 00000100:00100000:3.0:1789760771.732870:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400320 00000100:00100000:3.0:1789760771.732971:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709969968516 time 709983436216 state 0x0 ref 1 00000100:00100000:3.0:1789760771.732989:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709983696632 time 709983436216 state 0x1 ref 1 00000100:00100000:3.0:1789760771.733020:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709983696632 time 709993312108 state 0x0 ref 1 00000100:00100000:3.0:1789760771.733032:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565400320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.733081:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69459968, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21208 00010000:00010000:3.0:1789760771.733090:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.733107:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789760771.733111:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.733118:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.733136:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.739039:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984266 is committed 00002000:00010000:3.0:1789760771.739297:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69459968 -> 69464064 00002000:00010000:3.0:1789760771.739302:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135688 -> 135696 00010000:00010000:3.0:1789760771.739317:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739330:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739344:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739350:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.739355:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739364:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739384:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.739391:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cec2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69459968->69464063] (req 69459968->69464063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.739562:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565400320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6527us (6790us total) trans 4294984266 rc 0/0 00000100:00100000:3.0:1789760771.739573:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16969 00000100:00100000:3.0:1789760771.739582:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709983696632 time 709993312108 state 0x2 ref 0 00000100:00100000:3.0:1789760771.747162:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.747304:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400448 00000100:00100000:0.0:1789760771.747314:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400448 00000100:00100000:0.0:1789760771.747371:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709983696632 time 709993312108 state 0x0 ref 1 00000100:00100000:0.0:1789760771.747387:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709993572524 time 709993312108 state 0x1 ref 1 00000100:00100000:0.0:1789760771.747423:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709993572524 time 710007714949 state 0x0 ref 1 00000100:00100000:0.0:1789760771.747436:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565400448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.747486:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69464064, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21210 00010000:00010000:0.0:1789760771.747506:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.747527:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760771.747532:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.747538:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.747553:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.752822:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984267 is committed 00002000:00010000:0.0:1789760771.752970:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69464064 -> 69468160 00002000:00010000:0.0:1789760771.752976:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135696 -> 135704 00010000:00010000:0.0:1789760771.752988:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753011:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753020:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753029:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760771.753033:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753042:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753076:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.753084:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cec9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69464064->69468159] (req 69464064->69468159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.753172:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565400448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5734us (6014us total) trans 4294984267 rc 0/0 00000100:00100000:0.0:1789760771.753183:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16970 00000100:00100000:0.0:1789760771.753192:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709993572524 time 710007714949 state 0x2 ref 0 00000100:00100000:1.0:1789760771.762589:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.762749:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400576 00000100:00100000:2.0:1789760771.762760:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400576 00000100:00100000:2.0:1789760771.762824:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 709993572524 time 710007714949 state 0x0 ref 1 00000100:00100000:2.0:1789760771.762839:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710007975365 time 710007714949 state 0x1 ref 1 00000100:00100000:2.0:1789760771.762862:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710007975365 time 710023154762 state 0x0 ref 1 00000100:00100000:2.0:1789760771.762874:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565400576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.762919:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69468160, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21218 00010000:00010000:2.0:1789760771.762928:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.762948:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.762954:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.762960:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.762976:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.773008:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984268 is committed 00002000:00010000:1.0:1789760771.773126:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69468160 -> 69472256 00002000:00010000:1.0:1789760771.773132:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135704 -> 135712 00010000:00010000:1.0:1789760771.773145:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773157:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773166:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773174:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.773179:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773188:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773209:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.773216:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674ced0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69468160->69472255] (req 69468160->69472255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.773366:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565400576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10490us (10783us total) trans 4294984268 rc 0/0 00000100:00100000:1.0:1789760771.773377:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16971 00000100:00100000:1.0:1789760771.773386:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710007975365 time 710023154762 state 0x2 ref 0 00000100:00100000:2.0:1789760771.783505:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.783591:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400704 00000100:00100000:3.0:1789760771.783601:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400704 00000100:00100000:3.0:1789760771.783673:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710007975365 time 710023154762 state 0x0 ref 1 00000100:00100000:3.0:1789760771.783688:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710023415178 time 710023154762 state 0x1 ref 1 00000100:00100000:3.0:1789760771.783888:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710023415178 time 710044178362 state 0x0 ref 1 00000100:00100000:3.0:1789760771.783903:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760771.783958:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69472256, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21220 00010000:00010000:3.0:1789760771.783968:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.783984:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:3.0:1789760771.783988:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.783994:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.784008:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760771.793320:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984269 is committed 00002000:00010000:3.0:1789760771.793522:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69472256 -> 69476352 00002000:00010000:3.0:1789760771.793528:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135712 -> 135720 00010000:00010000:3.0:1789760771.793542:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793561:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793570:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793578:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760771.793582:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793592:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793613:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.793621:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674ced7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69472256->69476351] (req 69472256->69476351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760771.793985:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565400704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10080us (10484us total) trans 4294984269 rc 0/0 00000100:00100000:3.0:1789760771.793996:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16972 00000100:00100000:3.0:1789760771.794006:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710023415178 time 710044178362 state 0x2 ref 0 00000100:00100000:3.0:1789760771.798430:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760771.799450:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400832 00000100:00100000:0.0:1789760771.799461:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400832 00000100:00100000:0.0:1789760771.799518:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710023415178 time 710044178362 state 0x0 ref 1 00000100:00100000:0.0:1789760771.799533:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710044438778 time 710044178362 state 0x1 ref 1 00000100:00100000:0.0:1789760771.799567:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710044438778 time 710059858763 state 0x0 ref 1 00000100:00100000:0.0:1789760771.799580:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565400832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760771.799627:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69476352, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21228 00010000:00010000:0.0:1789760771.799637:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.799736:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760771.799742:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760771.799749:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.799765:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.806104:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984270 is committed 00002000:00010000:2.0:1789760771.806462:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69476352 -> 69480448 00002000:00010000:2.0:1789760771.806468:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135720 -> 135728 00010000:00010000:2.0:1789760771.806598:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806612:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806620:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806627:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.806632:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806641:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806802:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.806878:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674cede lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69476352->69480447] (req 69476352->69480447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.807050:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565400832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7465us (8622us total) trans 4294984270 rc 0/0 00000100:00100000:2.0:1789760771.807064:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16973 00000100:00100000:2.0:1789760771.807075:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710044438778 time 710059858763 state 0x2 ref 0 00000100:00100000:1.0:1789760771.811327:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.811406:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565400960 00000100:00100000:2.0:1789760771.811416:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565400960 00000100:00100000:2.0:1789760771.811474:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710044438778 time 710059858763 state 0x0 ref 1 00000100:00100000:2.0:1789760771.811489:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710060119179 time 710059858763 state 0x1 ref 1 00000100:00100000:2.0:1789760771.811520:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710060119179 time 710071812120 state 0x0 ref 1 00000100:00100000:2.0:1789760771.811532:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565400960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.811581:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69480448, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21230 00010000:00010000:2.0:1789760771.811590:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.811605:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.811611:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.811617:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.811631:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.817168:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984271 is committed 00002000:00010000:2.0:1789760771.817277:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69480448 -> 69484544 00002000:00010000:2.0:1789760771.817282:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135728 -> 135736 00010000:00010000:2.0:1789760771.817295:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817309:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817317:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817325:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.817330:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817339:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817357:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.817370:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cee5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69480448->69484543] (req 69480448->69484543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.817518:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565400960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5983us (6197us total) trans 4294984271 rc 0/0 00000100:00100000:2.0:1789760771.817529:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16974 00000100:00100000:2.0:1789760771.817538:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710060119179 time 710071812120 state 0x2 ref 0 00000100:00100000:0.0:1789760771.823326:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760771.823533:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401088 00000100:00100000:3.0:1789760771.823543:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401088 00000100:00100000:3.0:1789760771.823668:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710060119179 time 710071812120 state 0x0 ref 1 00000100:00100000:3.0:1789760771.823683:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710072072536 time 710071812120 state 0x1 ref 1 00000100:00100000:2.0:1789760771.823764:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710072072536 time 710084054257 state 0x0 ref 1 00000100:00100000:2.0:1789760771.823789:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565401088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.823839:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69484544, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21238 00010000:00010000:2.0:1789760771.823848:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.823863:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.823868:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.823886:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.823908:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.829004:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984272 is committed 00002000:00010000:2.0:1789760771.829276:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69484544 -> 69488640 00002000:00010000:2.0:1789760771.829283:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135736 -> 135744 00010000:00010000:2.0:1789760771.829297:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829308:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829317:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829324:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.829329:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829337:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829355:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.829362:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ceec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69484544->69488639] (req 69484544->69488639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.829523:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565401088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5741us (6204us total) trans 4294984272 rc 0/0 00000100:00100000:2.0:1789760771.829534:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16975 00000100:00100000:2.0:1789760771.829544:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710072072536 time 710084054257 state 0x2 ref 0 00000100:00100000:3.0:1789760771.833283:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.833632:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401216 00000100:00100000:2.0:1789760771.834370:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401216 00000100:00100000:2.0:1789760771.834500:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710072072536 time 710084054257 state 0x0 ref 1 00000100:00100000:2.0:1789760771.834517:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710084314673 time 710084054257 state 0x1 ref 1 00000100:00100000:2.0:1789760771.834596:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710084314673 time 710094887403 state 0x0 ref 1 00000100:00100000:2.0:1789760771.834609:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565401216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.834739:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69488640, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21240 00010000:00010000:2.0:1789760771.834748:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.834763:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.834767:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.834773:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.834801:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.841291:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984273 is committed 00002000:00010000:2.0:1789760771.841504:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69488640 -> 69492736 00002000:00010000:2.0:1789760771.841509:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135744 -> 135752 00010000:00010000:2.0:1789760771.841522:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841542:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841551:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841559:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.841564:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841573:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841594:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.841602:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cef3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69488640->69492735] (req 69488640->69492735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.841700:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565401216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7089us (8421us total) trans 4294984273 rc 0/0 00000100:00100000:2.0:1789760771.841743:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16976 00000100:00100000:2.0:1789760771.841752:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710084314673 time 710094887403 state 0x2 ref 0 00000100:00100000:1.0:1789760771.852654:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.854756:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401344 00000100:00100000:2.0:1789760771.854773:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401344 00000100:00100000:2.0:1789760771.854855:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710084314673 time 710094887403 state 0x0 ref 1 00000100:00100000:2.0:1789760771.854871:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710095147819 time 710094887403 state 0x1 ref 1 00000100:00100000:2.0:1789760771.854903:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710095147819 time 710115194771 state 0x0 ref 1 00000100:00100000:2.0:1789760771.854917:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565401344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.854965:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69492736, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21248 00010000:00010000:2.0:1789760771.854974:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.854988:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.854993:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.854999:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.855014:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760771.861313:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984274 is committed 00002000:00010000:2.0:1789760771.861488:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69492736 -> 69496832 00002000:00010000:2.0:1789760771.861493:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135752 -> 135760 00010000:00010000:2.0:1789760771.861506:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861517:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861531:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861538:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.861543:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861551:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861693:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.861902:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cefa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69492736->69496831] (req 69492736->69496831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.862001:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565401344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7083us (9354us total) trans 4294984274 rc 0/0 00000100:00100000:2.0:1789760771.862011:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16977 00000100:00100000:2.0:1789760771.862021:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710095147819 time 710115194771 state 0x2 ref 0 00000100:00100000:0.0:1789760771.869312:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.869553:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401472 00000100:00100000:2.0:1789760771.869566:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401472 00000100:00100000:2.0:1789760771.869643:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710095147819 time 710115194771 state 0x0 ref 1 00000100:00100000:2.0:1789760771.869661:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710115455187 time 710115194771 state 0x1 ref 1 00000100:00100000:2.0:1789760771.869809:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710115455187 time 710130100104 state 0x0 ref 1 00000100:00100000:2.0:1789760771.869823:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565401472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.869879:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69496832, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21250 00010000:00010000:2.0:1789760771.869889:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.869904:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.869909:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.869915:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.869932:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.874674:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984275 is committed 00002000:00010000:2.0:1789760771.875036:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69496832 -> 69500928 00002000:00010000:2.0:1789760771.875041:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135760 -> 135768 00010000:00010000:2.0:1789760771.875054:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875066:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875074:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875088:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.875093:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875103:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875301:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.875311:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69496832->69500927] (req 69496832->69500927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.875567:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565401472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5741us (6261us total) trans 4294984275 rc 0/0 00000100:00100000:2.0:1789760771.875578:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16978 00000100:00100000:2.0:1789760771.875587:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710115455187 time 710130100104 state 0x2 ref 0 00000100:00100000:3.0:1789760771.887083:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.887167:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401600 00000100:00100000:2.0:1789760771.887179:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401600 00000100:00100000:2.0:1789760771.887229:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710115455187 time 710130100104 state 0x0 ref 1 00000100:00100000:2.0:1789760771.887244:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710130360520 time 710130100104 state 0x1 ref 1 00000100:00100000:2.0:1789760771.887272:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710130360520 time 710147564107 state 0x0 ref 1 00000100:00100000:2.0:1789760771.887289:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565401600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.887337:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69500928, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21258 00010000:00010000:2.0:1789760771.887348:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.887365:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.887369:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.887376:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.887390:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.891618:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984276 is committed 00002000:00010000:2.0:1789760771.891760:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69500928 -> 69505024 00002000:00010000:2.0:1789760771.891766:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135768 -> 135776 00010000:00010000:2.0:1789760771.891793:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891932:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891943:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891950:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.891956:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891966:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891987:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.891994:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69500928->69505023] (req 69500928->69505023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.892163:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565401600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4871us (5084us total) trans 4294984276 rc 0/0 00000100:00100000:2.0:1789760771.892174:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16979 00000100:00100000:2.0:1789760771.892184:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710130360520 time 710147564107 state 0x2 ref 0 00000100:00100000:1.0:1789760771.901673:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.901818:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401728 00000100:00100000:2.0:1789760771.901828:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401728 00000100:00100000:2.0:1789760771.901892:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710130360520 time 710147564107 state 0x0 ref 1 00000100:00100000:2.0:1789760771.901908:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710147824523 time 710147564107 state 0x1 ref 1 00000100:00100000:2.0:1789760771.901939:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710147824523 time 710162230781 state 0x0 ref 1 00000100:00100000:2.0:1789760771.901952:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565401728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.901998:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69505024, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21260 00010000:00010000:2.0:1789760771.902008:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.902025:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.902029:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.902036:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.902049:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.910332:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984277 is committed 00002000:00010000:1.0:1789760771.910656:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69505024 -> 69509120 00002000:00010000:1.0:1789760771.910662:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135776 -> 135784 00010000:00010000:1.0:1789760771.910676:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910688:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910698:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910724:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.910729:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910738:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910757:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.910764:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674cf0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69505024->69509119] (req 69505024->69509119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.911253:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565401728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9297us (9584us total) trans 4294984277 rc 0/0 00000100:00100000:1.0:1789760771.911264:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16980 00000100:00100000:1.0:1789760771.911275:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710147824523 time 710162230781 state 0x2 ref 0 00000100:00100000:0.0:1789760771.914226:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.914317:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401856 00000100:00100000:2.0:1789760771.914326:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401856 00000100:00100000:2.0:1789760771.914377:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710147824523 time 710162230781 state 0x0 ref 1 00000100:00100000:2.0:1789760771.914394:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710162491197 time 710162230781 state 0x1 ref 1 00000100:00100000:2.0:1789760771.914434:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710162491197 time 710174725876 state 0x0 ref 1 00000100:00100000:2.0:1789760771.914448:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565401856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.914493:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69509120, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21268 00010000:00010000:2.0:1789760771.914502:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.914518:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.914522:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.914530:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.914544:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.922330:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984278 is committed 00002000:00010000:2.0:1789760771.922468:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69509120 -> 69513216 00002000:00010000:2.0:1789760771.922473:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135784 -> 135792 00010000:00010000:2.0:1789760771.922487:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922500:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922509:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922516:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.922521:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922530:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922552:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.922564:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69509120->69513215] (req 69509120->69513215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.922668:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565401856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8218us (8447us total) trans 4294984278 rc 0/0 00000100:00100000:2.0:1789760771.922679:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16981 00000100:00100000:2.0:1789760771.922689:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710162491197 time 710174725876 state 0x2 ref 0 00000100:00100000:3.0:1789760771.928044:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.928261:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565401984 00000100:00100000:2.0:1789760771.928271:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565401984 00000100:00100000:2.0:1789760771.928326:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710162491197 time 710174725876 state 0x0 ref 1 00000100:00100000:2.0:1789760771.928342:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710174986292 time 710174725876 state 0x1 ref 1 00000100:00100000:2.0:1789760771.928374:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710174986292 time 710188666871 state 0x0 ref 1 00000100:00100000:2.0:1789760771.928387:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565401984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.928438:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69513216, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0x21270 00010000:00010000:2.0:1789760771.928448:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.928463:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.928467:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.928473:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.928492:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.935759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984279 is committed 00002000:00010000:2.0:1789760771.936061:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69513216 -> 69517312 00002000:00010000:2.0:1789760771.936066:0:6957:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760771 -> 1789760772 00002000:00010000:2.0:1789760771.936069:0:6957:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760771 -> 1789760772 00002000:00010000:2.0:1789760771.936072:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135792 -> 135800 00010000:00010000:2.0:1789760771.936087:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.936101:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.936109:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.936116:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.938151:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.938169:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.938191:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.938204:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69513216->69517311] (req 69513216->69517311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.938304:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565401984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9913us (10263us total) trans 4294984279 rc 0/0 00000100:00100000:2.0:1789760771.938317:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16982 00000100:00100000:2.0:1789760771.938327:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710174986292 time 710188666871 state 0x2 ref 0 00000100:00100000:1.0:1789760771.954808:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.955038:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402112 00000100:00100000:2.0:1789760771.955048:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402112 00000100:00100000:2.0:1789760771.955168:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710174986292 time 710188666871 state 0x0 ref 1 00000100:00100000:2.0:1789760771.955183:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710188927287 time 710188666871 state 0x1 ref 1 00000100:00100000:2.0:1789760771.955251:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710188927287 time 710215542630 state 0x0 ref 1 00000100:00100000:2.0:1789760771.955274:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565402112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.955323:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69517312, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21278 00010000:00010000:2.0:1789760771.955333:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.955349:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.955354:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.955360:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.955378:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.961279:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984280 is committed 00002000:00010000:1.0:1789760771.961435:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69517312 -> 69521408 00002000:00010000:1.0:1789760771.961441:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135800 -> 135808 00010000:00010000:1.0:1789760771.961454:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961468:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961478:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961486:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760771.961492:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961502:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961522:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.961531:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674cf24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69517312->69521407] (req 69517312->69521407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760771.961619:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565402112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6351us (6823us total) trans 4294984280 rc 0/0 00000100:00100000:1.0:1789760771.961631:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16983 00000100:00100000:1.0:1789760771.961641:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710188927287 time 710215542630 state 0x2 ref 0 00000100:00100000:0.0:1789760771.965896:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.966140:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402240 00000100:00100000:2.0:1789760771.966151:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402240 00000100:00100000:2.0:1789760771.966204:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710188927287 time 710215542630 state 0x0 ref 1 00000100:00100000:2.0:1789760771.966219:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710215803046 time 710215542630 state 0x1 ref 1 00000100:00100000:2.0:1789760771.966251:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710215803046 time 710226543214 state 0x0 ref 1 00000100:00100000:2.0:1789760771.966264:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.966316:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69521408, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21280 00010000:00010000:2.0:1789760771.966325:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.966341:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.966346:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.966352:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.966366:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.973500:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984281 is committed 00002000:00010000:2.0:1789760771.973999:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69521408 -> 69525504 00002000:00010000:2.0:1789760771.974004:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135808 -> 135816 00010000:00010000:2.0:1789760771.974017:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974029:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974037:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974044:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.974048:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974057:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974078:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.974085:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69521408->69525503] (req 69521408->69525503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.974244:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7977us (8351us total) trans 4294984281 rc 0/0 00000100:00100000:2.0:1789760771.974255:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16984 00000100:00100000:2.0:1789760771.974265:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710215803046 time 710226543214 state 0x2 ref 0 00000100:00100000:3.0:1789760771.981589:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.983053:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402368 00000100:00100000:2.0:1789760771.983068:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402368 00000100:00100000:2.0:1789760771.983143:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710215803046 time 710226543214 state 0x0 ref 1 00000100:00100000:2.0:1789760771.983161:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710226803630 time 710226543214 state 0x1 ref 1 00000100:00100000:2.0:1789760771.983197:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710226803630 time 710243489340 state 0x0 ref 1 00000100:00100000:2.0:1789760771.983212:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565402368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.983260:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69525504, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21288 00010000:00010000:2.0:1789760771.983270:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.983287:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.983291:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.983298:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.983313:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.988312:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984282 is committed 00002000:00010000:2.0:1789760771.988436:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69525504 -> 69529600 00002000:00010000:2.0:1789760771.988441:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135816 -> 135824 00010000:00010000:2.0:1789760771.988456:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988469:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988479:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988486:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760771.988491:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988501:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988522:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.988529:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69525504->69529599] (req 69525504->69529599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.988616:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565402368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5403us (7219us total) trans 4294984282 rc 0/0 00000100:00100000:2.0:1789760771.988626:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16985 00000100:00100000:2.0:1789760771.988635:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710226803630 time 710243489340 state 0x2 ref 0 00000100:00100000:1.0:1789760771.996296:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760771.996367:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402496 00000100:00100000:2.0:1789760771.996378:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402496 00000100:00100000:2.0:1789760771.996435:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710226803630 time 710243489340 state 0x0 ref 1 00000100:00100000:2.0:1789760771.996451:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710243749756 time 710243489340 state 0x1 ref 1 00000100:00100000:2.0:1789760771.996477:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710243749756 time 710256769430 state 0x0 ref 1 00000100:00100000:2.0:1789760771.996489:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760771.996536:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69529600, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21290 00010000:00010000:2.0:1789760771.996545:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.996575:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760771.996580:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.996586:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.996601:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.001202:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984283 is committed 00002000:00010000:1.0:1789760772.001364:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69529600 -> 69533696 00002000:00010000:1.0:1789760772.001369:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135824 -> 135832 00010000:00010000:1.0:1789760772.001381:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001394:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001404:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001423:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.001428:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001438:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001457:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.001465:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674cf39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69529600->69533695] (req 69529600->69533695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.001569:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5077us (5279us total) trans 4294984283 rc 0/0 00000100:00100000:1.0:1789760772.001580:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16986 00000100:00100000:1.0:1789760772.001590:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710243749756 time 710256769430 state 0x2 ref 0 00000100:00100000:0.0:1789760772.007497:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.007838:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402624 00000100:00100000:2.0:1789760772.007848:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402624 00000100:00100000:2.0:1789760772.007935:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710243749756 time 710256769430 state 0x0 ref 1 00000100:00100000:2.0:1789760772.007952:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710257029846 time 710256769430 state 0x1 ref 1 00000100:00100000:2.0:1789760772.008034:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710257029846 time 710268325022 state 0x0 ref 1 00000100:00100000:2.0:1789760772.008048:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565402624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.008103:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69533696, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21298 00010000:00010000:2.0:1789760772.008112:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.008136:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.008141:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.008148:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.008163:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760772.009898:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760772.012938:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984284 is committed 00002000:00010000:2.0:1789760772.013224:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69533696 -> 69537792 00002000:00010000:2.0:1789760772.013229:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135832 -> 135840 00010000:00010000:2.0:1789760772.013244:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013256:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013264:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013275:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.013280:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013288:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013308:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.013315:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69533696->69537791] (req 69533696->69537791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.014012:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565402624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5960us (6519us total) trans 4294984284 rc 0/0 00000100:00100000:2.0:1789760772.014022:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16987 00000100:00100000:2.0:1789760772.014032:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710257029846 time 710268325022 state 0x2 ref 0 00000100:00100000:3.0:1789760772.018271:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.018346:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402752 00000100:00100000:2.0:1789760772.018355:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402752 00000100:00100000:2.0:1789760772.018422:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710257029846 time 710268325022 state 0x0 ref 1 00000100:00100000:2.0:1789760772.018437:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710268585438 time 710268325022 state 0x1 ref 1 00000100:00100000:2.0:1789760772.018465:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710268585438 time 710278757284 state 0x0 ref 1 00000100:00100000:2.0:1789760772.018480:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565402752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.018535:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69537792, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212a0 00010000:00010000:2.0:1789760772.018544:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.018560:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.018565:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.018571:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.018585:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.027199:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984285 is committed 00002000:00010000:2.0:1789760772.027336:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69537792 -> 69541888 00002000:00010000:2.0:1789760772.027340:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135840 -> 135848 00010000:00010000:2.0:1789760772.027351:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027361:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027367:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027371:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.027375:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027381:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027396:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.027400:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69537792->69541887] (req 69537792->69541887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.028822:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565402752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10333us (10550us total) trans 4294984285 rc 0/0 00000100:00100000:2.0:1789760772.028837:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16988 00000100:00100000:2.0:1789760772.028847:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710268585438 time 710278757284 state 0x2 ref 0 00000100:00100000:1.0:1789760772.034341:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.035023:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565402880 00000100:00100000:2.0:1789760772.035033:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565402880 00000100:00100000:2.0:1789760772.035212:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710268585438 time 710278757284 state 0x0 ref 1 00000100:00100000:2.0:1789760772.035228:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710279017700 time 710278757284 state 0x1 ref 1 00000100:00100000:2.0:1789760772.035307:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710279017700 time 710295598096 state 0x0 ref 1 00000100:00100000:2.0:1789760772.035320:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.035366:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69541888, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212a8 00010000:00010000:2.0:1789760772.035377:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.035393:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.035397:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.035404:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.035418:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.048594:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984286 is committed 00002000:00010000:2.0:1789760772.048742:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69541888 -> 69545984 00002000:00010000:2.0:1789760772.048748:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135848 -> 135856 00010000:00010000:2.0:1789760772.048762:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048785:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048796:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048804:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.048808:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048816:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048836:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.048844:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69541888->69545983] (req 69541888->69545983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.048937:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565402880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13615us (14602us total) trans 4294984286 rc 0/0 00000100:00100000:2.0:1789760772.048948:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16989 00000100:00100000:2.0:1789760772.048957:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710279017700 time 710295598096 state 0x2 ref 0 00000100:00100000:1.0:1789760772.057582:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.057755:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403008 00000100:00100000:2.0:1789760772.057766:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403008 00000100:00100000:2.0:1789760772.057831:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710279017700 time 710295598096 state 0x0 ref 1 00000100:00100000:2.0:1789760772.057846:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710295858512 time 710295598096 state 0x1 ref 1 00000100:00100000:2.0:1789760772.057877:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710295858512 time 710318169046 state 0x0 ref 1 00000100:00100000:2.0:1789760772.057891:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.057941:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69545984, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212b0 00010000:00010000:2.0:1789760772.057951:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.057968:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.057973:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.057980:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.057992:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.064830:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984287 is committed 00002000:00010000:2.0:1789760772.064939:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69545984 -> 69550080 00002000:00010000:2.0:1789760772.064944:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135856 -> 135864 00010000:00010000:2.0:1789760772.064958:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.064970:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.064980:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.064988:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.064993:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.065001:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.065022:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.065035:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69545984->69550079] (req 69545984->69550079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.068666:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10764us (11080us total) trans 4294984287 rc 0/0 00000100:00100000:3.0:1789760772.068680:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16990 00000100:00100000:3.0:1789760772.068691:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710295858512 time 710318169046 state 0x2 ref 0 00000100:00100000:3.0:1789760772.075363:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.075578:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403136 00000100:00100000:2.0:1789760772.075588:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403136 00000100:00100000:2.0:1789760772.075641:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710295858512 time 710318169046 state 0x0 ref 1 00000100:00100000:2.0:1789760772.075658:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710318429462 time 710318169046 state 0x1 ref 1 00000100:00100000:2.0:1789760772.075694:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710318429462 time 710335985765 state 0x0 ref 1 00000100:00100000:2.0:1789760772.075742:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565403136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.075799:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69550080, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212b8 00010000:00010000:2.0:1789760772.075808:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.075823:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.075828:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.075834:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.075848:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.085488:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984288 is committed 00002000:00010000:3.0:1789760772.085789:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69550080 -> 69554176 00002000:00010000:3.0:1789760772.085795:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135864 -> 135872 00010000:00010000:3.0:1789760772.085809:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085821:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085830:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085843:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760772.085849:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085857:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085876:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.085884:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674cf5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69550080->69554175] (req 69550080->69554175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.086032:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565403136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10323us (10673us total) trans 4294984288 rc 0/0 00000100:00100000:3.0:1789760772.086044:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16991 00000100:00100000:3.0:1789760772.086053:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710318429462 time 710335985765 state 0x2 ref 0 00000100:00100000:1.0:1789760772.102890:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.104670:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403264 00000100:00100000:2.0:1789760772.104692:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403264 00000100:00100000:2.0:1789760772.104822:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710318429462 time 710335985765 state 0x0 ref 1 00000100:00100000:2.0:1789760772.104837:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710336246181 time 710335985765 state 0x1 ref 1 00000100:00100000:2.0:1789760772.104871:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710336246181 time 710365163142 state 0x0 ref 1 00000100:00100000:2.0:1789760772.104883:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565403264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.104939:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69554176, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212c0 00010000:00010000:2.0:1789760772.104948:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.104963:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.104967:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.104974:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.104988:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.112173:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984289 is committed 00002000:00010000:2.0:1789760772.112384:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69554176 -> 69558272 00002000:00010000:2.0:1789760772.112389:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135872 -> 135880 00010000:00010000:2.0:1789760772.112402:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112414:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112428:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112435:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.112440:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112449:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112467:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.112475:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69554176->69558271] (req 69554176->69558271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.112625:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565403264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7738us (9739us total) trans 4294984289 rc 0/0 00000100:00100000:2.0:1789760772.112635:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16992 00000100:00100000:2.0:1789760772.112644:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710336246181 time 710365163142 state 0x2 ref 0 00000100:00100000:1.0:1789760772.117916:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760772.118167:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403392 00000100:00100000:3.0:1789760772.118178:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403392 00000100:00100000:3.0:1789760772.118238:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710336246181 time 710365163142 state 0x0 ref 1 00000100:00100000:3.0:1789760772.118252:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710365423558 time 710365163142 state 0x1 ref 1 00000100:00100000:3.0:1789760772.118280:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710365423558 time 710378572351 state 0x0 ref 1 00000100:00100000:3.0:1789760772.118294:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565403392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760772.118339:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69558272, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212c8 00010000:00010000:3.0:1789760772.118349:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.118365:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:3.0:1789760772.118370:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760772.118380:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.118397:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.123391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984290 is committed 00002000:00010000:3.0:1789760772.123514:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69558272 -> 69562368 00002000:00010000:3.0:1789760772.123519:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135880 -> 135888 00010000:00010000:3.0:1789760772.123532:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123545:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123554:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123562:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760772.123567:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123577:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123597:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.123604:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674cf6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69558272->69562367] (req 69558272->69562367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.123698:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565403392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5396us (5783us total) trans 4294984290 rc 0/0 00000100:00100000:3.0:1789760772.123783:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16993 00000100:00100000:3.0:1789760772.123793:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710365423558 time 710378572351 state 0x2 ref 0 00000100:00100000:3.0:1789760772.133300:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.133525:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403520 00000100:00100000:0.0:1789760772.133535:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403520 00000100:00100000:0.0:1789760772.133593:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710365423558 time 710378572351 state 0x0 ref 1 00000100:00100000:0.0:1789760772.133607:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710378832767 time 710378572351 state 0x1 ref 1 00000100:00100000:0.0:1789760772.133649:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710378832767 time 710393941350 state 0x0 ref 1 00000100:00100000:0.0:1789760772.133661:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565403520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.133744:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69562368, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212d0 00010000:00010000:0.0:1789760772.133762:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.133785:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.133789:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.133796:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.133809:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.139302:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984291 is committed 00002000:00010000:3.0:1789760772.139811:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69562368 -> 69566464 00002000:00010000:3.0:1789760772.139817:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135888 -> 135896 00010000:00010000:3.0:1789760772.139830:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139844:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139854:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139862:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760772.139866:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139874:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139892:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.139898:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674cf71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69562368->69566463] (req 69562368->69566463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.139992:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565403520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6328us (6697us total) trans 4294984291 rc 0/0 00000100:00100000:3.0:1789760772.140002:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16994 00000100:00100000:3.0:1789760772.140010:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710378832767 time 710393941350 state 0x2 ref 0 00000100:00100000:1.0:1789760772.145148:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.145614:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403648 00000100:00100000:2.0:1789760772.145624:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403648 00000100:00100000:2.0:1789760772.145681:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710378832767 time 710393941350 state 0x0 ref 1 00000100:00100000:2.0:1789760772.145698:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710394201766 time 710393941350 state 0x1 ref 1 00000100:00100000:2.0:1789760772.145911:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710394201766 time 710406202072 state 0x0 ref 1 00000100:00100000:2.0:1789760772.145926:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.145979:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69566464, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212d8 00010000:00010000:2.0:1789760772.145989:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.146005:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.146010:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.146017:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.146032:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.156074:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984292 is committed 00002000:00010000:1.0:1789760772.156229:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69566464 -> 69570560 00002000:00010000:1.0:1789760772.156234:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135896 -> 135904 00010000:00010000:1.0:1789760772.156248:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156259:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156268:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156276:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.156281:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156290:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156310:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.156324:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674cf78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69566464->69570559] (req 69566464->69570559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.156487:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10559us (11344us total) trans 4294984292 rc 0/0 00000100:00100000:1.0:1789760772.156497:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16995 00000100:00100000:1.0:1789760772.156507:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710394201766 time 710406202072 state 0x2 ref 0 00000100:00100000:1.0:1789760772.163842:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760772.167663:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403776 00000100:00100000:3.0:1789760772.167678:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403776 00000100:00100000:3.0:1789760772.167785:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710394201766 time 710406202072 state 0x0 ref 1 00000100:00100000:3.0:1789760772.167801:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710406462488 time 710406202072 state 0x1 ref 1 00000100:00100000:3.0:1789760772.167901:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710406462488 time 710428191767 state 0x0 ref 1 00000100:00100000:3.0:1789760772.167918:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760772.167965:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69570560, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212e0 00010000:00010000:3.0:1789760772.167974:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.167990:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:3.0:1789760772.167994:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760772.168000:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.168013:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.174400:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984293 is committed 00002000:00010000:2.0:1789760772.176943:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69570560 -> 69574656 00002000:00010000:2.0:1789760772.176953:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135904 -> 135912 00010000:00010000:2.0:1789760772.176966:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.176979:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.176989:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.177002:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.177007:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.177017:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.177037:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.177045:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674cf7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69570560->69574655] (req 69570560->69574655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.177224:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9302us (13385us total) trans 4294984293 rc 0/0 00000100:00100000:2.0:1789760772.177236:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16996 00000100:00100000:2.0:1789760772.177246:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710406462488 time 710428191767 state 0x2 ref 0 00000100:00100000:3.0:1789760772.185890:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.186101:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565403904 00000100:00100000:0.0:1789760772.186111:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565403904 00000100:00100000:0.0:1789760772.186167:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710406462488 time 710428191767 state 0x0 ref 1 00000100:00100000:0.0:1789760772.186181:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710428452183 time 710428191767 state 0x1 ref 1 00000100:00100000:0.0:1789760772.186211:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710428452183 time 710446503864 state 0x0 ref 1 00000100:00100000:0.0:1789760772.186224:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.186268:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69574656, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212e8 00010000:00010000:0.0:1789760772.186278:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.186293:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.186297:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.186304:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.186317:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.191611:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984294 is committed 00002000:00010000:3.0:1789760772.191834:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69574656 -> 69578752 00002000:00010000:3.0:1789760772.191839:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135912 -> 135920 00010000:00010000:3.0:1789760772.191853:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191866:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191874:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191881:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760772.191887:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191895:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191914:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.191921:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674cf86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69574656->69578751] (req 69574656->69578751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.192015:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565403904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5789us (6130us total) trans 4294984294 rc 0/0 00000100:00100000:3.0:1789760772.192025:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16997 00000100:00100000:3.0:1789760772.192035:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710428452183 time 710446503864 state 0x2 ref 0 00000100:00100000:1.0:1789760772.195221:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.195467:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404032 00000100:00100000:2.0:1789760772.195477:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404032 00000100:00100000:2.0:1789760772.195532:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710428452183 time 710446503864 state 0x0 ref 1 00000100:00100000:2.0:1789760772.195546:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710446764280 time 710446503864 state 0x1 ref 1 00000100:00100000:2.0:1789760772.196046:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710446764280 time 710456336475 state 0x0 ref 1 00000100:00100000:2.0:1789760772.196065:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.196113:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69578752, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212f0 00010000:00010000:2.0:1789760772.196122:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.196137:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.196141:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.196147:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.196160:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.204750:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984295 is committed 00002000:00010000:2.0:1789760772.204883:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69578752 -> 69582848 00002000:00010000:2.0:1789760772.204889:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135920 -> 135928 00010000:00010000:2.0:1789760772.204902:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204914:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204924:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204931:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.204936:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204945:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204966:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.204973:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69578752->69582847] (req 69578752->69582847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.205064:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8999us (9848us total) trans 4294984295 rc 0/0 00000100:00100000:2.0:1789760772.205074:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16998 00000100:00100000:2.0:1789760772.205084:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710446764280 time 710456336475 state 0x2 ref 0 00000100:00100000:1.0:1789760772.213521:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.214263:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404160 00000100:00100000:2.0:1789760772.214274:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404160 00000100:00100000:2.0:1789760772.214337:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710446764280 time 710456336475 state 0x0 ref 1 00000100:00100000:2.0:1789760772.214353:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710456596891 time 710456336475 state 0x1 ref 1 00000100:00100000:2.0:1789760772.214427:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710456596891 time 710474718566 state 0x0 ref 1 00000100:00100000:2.0:1789760772.214440:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.214490:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69582848, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x212f8 00010000:00010000:2.0:1789760772.214500:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.214515:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.214520:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.214527:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.214541:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.223089:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984296 is committed 00002000:00010000:0.0:1789760772.225541:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69582848 -> 69586944 00002000:00010000:0.0:1789760772.225552:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135928 -> 135936 00010000:00010000:0.0:1789760772.225569:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225584:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225595:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225609:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.225614:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225625:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225649:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.225657:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674cf94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69582848->69586943] (req 69582848->69586943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.226119:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11675us (12602us total) trans 4294984296 rc 0/0 00000100:00100000:0.0:1789760772.226131:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 16999 00000100:00100000:0.0:1789760772.226146:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710456596891 time 710474718566 state 0x2 ref 0 00000100:00100000:3.0:1789760772.233308:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.233409:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404288 00000100:00100000:0.0:1789760772.233419:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404288 00000100:00100000:0.0:1789760772.233474:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710456596891 time 710474718566 state 0x0 ref 1 00000100:00100000:0.0:1789760772.233490:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710474978982 time 710474718566 state 0x1 ref 1 00000100:00100000:0.0:1789760772.233522:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710474978982 time 710493814896 state 0x0 ref 1 00000100:00100000:0.0:1789760772.233539:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.233584:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69586944, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21300 00010000:00010000:0.0:1789760772.233593:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.233610:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.233614:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.233620:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.233634:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.240358:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984297 is committed 00002000:00010000:0.0:1789760772.240587:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69586944 -> 69591040 00002000:00010000:0.0:1789760772.240592:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135936 -> 135944 00010000:00010000:0.0:1789760772.240606:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240618:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240627:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240635:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.240640:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240650:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240670:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.240677:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cf9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69586944->69591039] (req 69586944->69591039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.240825:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7284us (7520us total) trans 4294984297 rc 0/0 00000100:00100000:0.0:1789760772.240836:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17000 00000100:00100000:0.0:1789760772.240845:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710474978982 time 710493814896 state 0x2 ref 0 00000100:00100000:2.0:1789760772.248024:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.248253:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404416 00000100:00100000:1.0:1789760772.248262:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404416 00000100:00100000:1.0:1789760772.248314:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710474978982 time 710493814896 state 0x0 ref 1 00000100:00100000:1.0:1789760772.248325:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710494075312 time 710493814896 state 0x1 ref 1 00000100:00100000:1.0:1789760772.248355:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710494075312 time 710508646358 state 0x0 ref 1 00000100:00100000:1.0:1789760772.248367:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.248427:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69591040, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21308 00010000:00010000:1.0:1789760772.248437:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.248462:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.248467:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.248473:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.248487:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.255853:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984298 is committed 00002000:00010000:1.0:1789760772.256061:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69591040 -> 69595136 00002000:00010000:1.0:1789760772.256067:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135944 -> 135952 00010000:00010000:1.0:1789760772.256081:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256093:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256100:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256108:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.256112:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256121:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256145:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.256153:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69591040->69595135] (req 69591040->69595135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.256256:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7886us (8247us total) trans 4294984298 rc 0/0 00000100:00100000:1.0:1789760772.256266:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17001 00000100:00100000:1.0:1789760772.256277:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710494075312 time 710508646358 state 0x2 ref 0 00000100:00100000:2.0:1789760772.261819:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.264893:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404544 00000100:00100000:0.0:1789760772.264909:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404544 00000100:00100000:0.0:1789760772.264979:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710494075312 time 710508646358 state 0x0 ref 1 00000100:00100000:0.0:1789760772.264995:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710508906774 time 710508646358 state 0x1 ref 1 00000100:00100000:0.0:1789760772.265062:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710508906774 time 710525353934 state 0x0 ref 1 00000100:00100000:0.0:1789760772.265076:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565404544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.265127:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69595136, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21310 00010000:00010000:0.0:1789760772.265137:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.265152:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.265156:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.265162:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.265177:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.270057:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984299 is committed 00002000:00010000:0.0:1789760772.270181:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69595136 -> 69599232 00002000:00010000:0.0:1789760772.270186:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135952 -> 135960 00010000:00010000:0.0:1789760772.270200:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270894:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270904:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270912:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.270916:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270926:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270949:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.270957:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69595136->69599231] (req 69595136->69599231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.271159:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565404544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6081us (9345us total) trans 4294984299 rc 0/0 00000100:00100000:0.0:1789760772.271170:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17002 00000100:00100000:0.0:1789760772.271180:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710508906774 time 710525353934 state 0x2 ref 0 00000100:00100000:3.0:1789760772.278363:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.278680:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404672 00000100:00100000:0.0:1789760772.278698:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404672 00000100:00100000:0.0:1789760772.278791:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710508906774 time 710525353934 state 0x0 ref 1 00000100:00100000:0.0:1789760772.278807:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710525614350 time 710525353934 state 0x1 ref 1 00000100:00100000:0.0:1789760772.278844:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710525614350 time 710539135638 state 0x0 ref 1 00000100:00100000:0.0:1789760772.278857:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.278904:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69599232, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21318 00010000:00010000:0.0:1789760772.278914:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.278929:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.278935:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.278941:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.278956:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.288093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984300 is committed 00002000:00010000:0.0:1789760772.288302:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69599232 -> 69603328 00002000:00010000:0.0:1789760772.288307:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135960 -> 135968 00010000:00010000:0.0:1789760772.288319:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288343:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288507:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288515:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.288519:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288528:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288548:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.288562:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69599232->69603327] (req 69599232->69603327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.288662:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9802us (10303us total) trans 4294984300 rc 0/0 00000100:00100000:0.0:1789760772.288673:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17003 00000100:00100000:0.0:1789760772.288682:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710525614350 time 710539135638 state 0x2 ref 0 00010000:00010000:1.0:1789760772.300386:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760772.307406:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.309026:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404800 00000100:00100000:1.0:1789760772.309040:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404800 00000100:00100000:1.0:1789760772.309107:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710525614350 time 710539135638 state 0x0 ref 1 00000100:00100000:1.0:1789760772.309122:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710539396054 time 710539135638 state 0x1 ref 1 00000100:00100000:1.0:1789760772.309158:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710539396054 time 710569449538 state 0x0 ref 1 00000100:00100000:1.0:1789760772.309172:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.309216:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69603328, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21320 00010000:00010000:1.0:1789760772.309226:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.309246:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.309250:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.309256:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.309268:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.314060:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984301 is committed 00002000:00010000:2.0:1789760772.314364:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69603328 -> 69607424 00002000:00010000:2.0:1789760772.314369:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135968 -> 135976 00010000:00010000:2.0:1789760772.314383:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314396:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314405:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314413:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.314418:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314427:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314446:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.314454:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674cfb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69603328->69607423] (req 69603328->69607423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.314560:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565404800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5386us (7158us total) trans 4294984301 rc 0/0 00000100:00100000:2.0:1789760772.314570:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17004 00000100:00100000:2.0:1789760772.314581:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710539396054 time 710569449538 state 0x2 ref 0 00000100:00100000:2.0:1789760772.319795:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.321208:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565404928 00000100:00100000:0.0:1789760772.321222:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565404928 00000100:00100000:0.0:1789760772.321285:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710539396054 time 710569449538 state 0x0 ref 1 00000100:00100000:0.0:1789760772.321300:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710569709954 time 710569449538 state 0x1 ref 1 00000100:00100000:0.0:1789760772.321335:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710569709954 time 710581627393 state 0x0 ref 1 00000100:00100000:0.0:1789760772.321348:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.321398:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69607424, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21328 00010000:00010000:0.0:1789760772.321408:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.321424:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.321429:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.321437:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.321459:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.326225:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984302 is committed 00002000:00010000:0.0:1789760772.328300:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69607424 -> 69611520 00002000:00010000:0.0:1789760772.328315:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135976 -> 135984 00010000:00010000:0.0:1789760772.328329:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328342:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328352:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328360:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.328365:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328374:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328395:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.328403:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69607424->69611519] (req 69607424->69611519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.328810:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565404928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7457us (9028us total) trans 4294984302 rc 0/0 00000100:00100000:0.0:1789760772.328823:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17005 00000100:00100000:0.0:1789760772.328832:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710569709954 time 710581627393 state 0x2 ref 0 00000100:00100000:3.0:1789760772.335837:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.336045:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405056 00000100:00100000:0.0:1789760772.336054:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405056 00000100:00100000:0.0:1789760772.336110:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710569709954 time 710581627393 state 0x0 ref 1 00000100:00100000:0.0:1789760772.336135:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710581887809 time 710581627393 state 0x1 ref 1 00000100:00100000:0.0:1789760772.336167:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710581887809 time 710596459214 state 0x0 ref 1 00000100:00100000:0.0:1789760772.336180:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.336227:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69611520, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21330 00010000:00010000:0.0:1789760772.336238:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.336254:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.336258:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.336265:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.336280:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.343543:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984303 is committed 00002000:00010000:0.0:1789760772.343784:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69611520 -> 69615616 00002000:00010000:0.0:1789760772.343790:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135984 -> 135992 00010000:00010000:0.0:1789760772.343803:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343815:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343823:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343830:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.343835:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343844:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343862:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.343870:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69611520->69615615] (req 69611520->69615615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.343962:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7779us (8128us total) trans 4294984303 rc 0/0 00000100:00100000:0.0:1789760772.343977:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17006 00000100:00100000:0.0:1789760772.343988:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710581887809 time 710596459214 state 0x2 ref 0 00000100:00100000:2.0:1789760772.354126:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.354392:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405184 00000100:00100000:1.0:1789760772.354401:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405184 00000100:00100000:1.0:1789760772.354462:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710581887809 time 710596459214 state 0x0 ref 1 00000100:00100000:1.0:1789760772.354477:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710596719630 time 710596459214 state 0x1 ref 1 00000100:00100000:1.0:1789760772.354504:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710596719630 time 710614796179 state 0x0 ref 1 00000100:00100000:1.0:1789760772.354516:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.354570:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69615616, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21338 00010000:00010000:1.0:1789760772.354580:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.354596:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.354601:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.354608:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.354621:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.361622:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984304 is committed 00002000:00010000:1.0:1789760772.361857:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69615616 -> 69619712 00002000:00010000:1.0:1789760772.361862:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135992 -> 136000 00010000:00010000:1.0:1789760772.361876:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361889:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361899:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361906:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.361911:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361920:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361940:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.361953:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674cfcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69615616->69619711] (req 69615616->69619711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.362046:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7526us (7924us total) trans 4294984304 rc 0/0 00000100:00100000:1.0:1789760772.362056:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17007 00000100:00100000:1.0:1789760772.362065:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710596719630 time 710614796179 state 0x2 ref 0 00000100:00100000:1.0:1789760772.366370:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.366450:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405312 00000100:00100000:0.0:1789760772.366461:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405312 00000100:00100000:0.0:1789760772.366519:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710596719630 time 710614796179 state 0x0 ref 1 00000100:00100000:0.0:1789760772.366545:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710615056595 time 710614796179 state 0x1 ref 1 00000100:00100000:0.0:1789760772.366574:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710615056595 time 710626866106 state 0x0 ref 1 00000100:00100000:0.0:1789760772.366586:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.366632:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69619712, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21340 00010000:00010000:0.0:1789760772.366642:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.366657:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.366661:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.366667:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.366680:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.367303:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4774b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580065024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760772.367359:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760772.367514:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065024 00000100:00100000:2.0:1789760772.367521:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065024 00000100:00100000:2.0:1789760772.367592:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789760772.367600:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580065024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760772.367617:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484946496 pending 28672 free 3854192640 avail 3621580800 00000100:00100000:2.0:1789760772.367672:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580065024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760772.367679:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789760772.367784:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4774b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580065024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789760772.367884:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760772.370892:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984305 is committed 00002000:00010000:0.0:1789760772.371017:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69619712 -> 69623808 00002000:00010000:0.0:1789760772.371022:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136000 -> 136008 00010000:00010000:0.0:1789760772.371034:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371046:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371055:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371062:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.371067:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371075:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371094:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.371102:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69619712->69623807] (req 69619712->69623807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.371208:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4619us (4841us total) trans 4294984305 rc 0/0 00000100:00100000:0.0:1789760772.371218:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17008 00000100:00100000:0.0:1789760772.371228:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710615056595 time 710626866106 state 0x2 ref 0 00000100:00100000:3.0:1789760772.376409:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.377208:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405440 00000100:00100000:0.0:1789760772.377221:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405440 00000100:00100000:0.0:1789760772.377281:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710615056595 time 710626866106 state 0x0 ref 1 00000100:00100000:0.0:1789760772.377297:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710627126522 time 710626866106 state 0x1 ref 1 00000100:00100000:0.0:1789760772.377324:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710627126522 time 710637615789 state 0x0 ref 1 00000100:00100000:0.0:1789760772.377338:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.377389:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69623808, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21348 00010000:00010000:0.0:1789760772.377399:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.377413:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.377418:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.377424:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.377437:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.381544:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984306 is committed 00002000:00010000:0.0:1789760772.381655:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69623808 -> 69627904 00002000:00010000:0.0:1789760772.381661:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136008 -> 136016 00010000:00010000:0.0:1789760772.381675:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381690:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381699:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381885:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.381890:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381899:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381920:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.381928:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69623808->69627903] (req 69623808->69627903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.382052:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4713us (5647us total) trans 4294984306 rc 0/0 00000100:00100000:0.0:1789760772.382063:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17009 00000100:00100000:0.0:1789760772.382073:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710627126522 time 710637615789 state 0x2 ref 0 00000100:00100000:2.0:1789760772.391016:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.391419:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405568 00000100:00100000:1.0:1789760772.391429:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405568 00000100:00100000:1.0:1789760772.391487:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710627126522 time 710637615789 state 0x0 ref 1 00000100:00100000:1.0:1789760772.391502:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710637876205 time 710637615789 state 0x1 ref 1 00000100:00100000:1.0:1789760772.391536:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710637876205 time 710651828807 state 0x0 ref 1 00000100:00100000:1.0:1789760772.391548:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.391592:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69627904, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21350 00010000:00010000:1.0:1789760772.391601:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.391623:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.391628:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.391634:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.391647:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.395766:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984307 is committed 00002000:00010000:1.0:1789760772.396021:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69627904 -> 69632000 00002000:00010000:1.0:1789760772.396026:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136016 -> 136024 00010000:00010000:1.0:1789760772.396039:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396050:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396058:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396064:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.396069:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396077:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396098:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.396105:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674cfe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69627904->69631999] (req 69627904->69631999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.396409:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4857us (5464us total) trans 4294984307 rc 0/0 00000100:00100000:1.0:1789760772.396420:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17010 00000100:00100000:1.0:1789760772.396430:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710637876205 time 710651828807 state 0x2 ref 0 00000100:00100000:1.0:1789760772.403685:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.403817:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405696 00000100:00100000:0.0:1789760772.403828:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405696 00000100:00100000:0.0:1789760772.403885:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710637876205 time 710651828807 state 0x0 ref 1 00000100:00100000:0.0:1789760772.403904:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710652089223 time 710651828807 state 0x1 ref 1 00000100:00100000:0.0:1789760772.403969:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710652089223 time 710664260772 state 0x0 ref 1 00000100:00100000:0.0:1789760772.403983:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.404026:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69632000, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21358 00010000:00010000:0.0:1789760772.404036:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.404049:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.404053:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.404059:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.404070:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.408341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984308 is committed 00002000:00010000:0.0:1789760772.408594:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69632000 -> 69636096 00002000:00010000:0.0:1789760772.408600:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136024 -> 136032 00010000:00010000:0.0:1789760772.408614:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408626:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408640:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408648:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.408653:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408662:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408682:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.408689:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674cfe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69632000->69636095] (req 69632000->69636095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.409064:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5077us (5381us total) trans 4294984308 rc 0/0 00000100:00100000:0.0:1789760772.409076:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17011 00000100:00100000:0.0:1789760772.409087:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710652089223 time 710664260772 state 0x2 ref 0 00000100:00100000:3.0:1789760772.413579:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.414107:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405824 00000100:00100000:0.0:1789760772.414118:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405824 00000100:00100000:0.0:1789760772.414399:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710652089223 time 710664260772 state 0x0 ref 1 00000100:00100000:0.0:1789760772.414415:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710664521188 time 710664260772 state 0x1 ref 1 00000100:00100000:0.0:1789760772.414494:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710664521188 time 710674786014 state 0x0 ref 1 00000100:00100000:0.0:1789760772.414510:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.414562:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69636096, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21360 00010000:00010000:0.0:1789760772.414572:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.414588:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.414592:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.414599:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.414613:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.418478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984309 is committed 00002000:00010000:0.0:1789760772.418935:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69636096 -> 69640192 00002000:00010000:0.0:1789760772.419010:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136032 -> 136040 00010000:00010000:0.0:1789760772.419024:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419037:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419045:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419057:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.419061:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419069:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419088:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.419096:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cfef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69636096->69640191] (req 69636096->69640191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.419279:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565405824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4768us (5704us total) trans 4294984309 rc 0/0 00000100:00100000:0.0:1789760772.419297:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17012 00000100:00100000:0.0:1789760772.419307:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710664521188 time 710674786014 state 0x2 ref 0 00000100:00100000:2.0:1789760772.423891:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.424053:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565405952 00000100:00100000:1.0:1789760772.424063:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565405952 00000100:00100000:1.0:1789760772.424124:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710664521188 time 710674786014 state 0x0 ref 1 00000100:00100000:1.0:1789760772.424266:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710675046430 time 710674786014 state 0x1 ref 1 00000100:00100000:1.0:1789760772.424353:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710675046430 time 710684642961 state 0x0 ref 1 00000100:00100000:1.0:1789760772.424368:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.424414:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69640192, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21368 00010000:00010000:1.0:1789760772.424475:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.424496:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.424500:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.424507:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.424521:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.433112:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984310 is committed 00002000:00010000:1.0:1789760772.433313:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69640192 -> 69644288 00002000:00010000:1.0:1789760772.433320:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136040 -> 136048 00010000:00010000:1.0:1789760772.433335:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433347:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433356:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433364:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.433369:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433377:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433401:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.433408:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674cff6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69640192->69644287] (req 69640192->69644287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.433506:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565405952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9137us (9619us total) trans 4294984310 rc 0/0 00000100:00100000:1.0:1789760772.433516:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17013 00000100:00100000:1.0:1789760772.433526:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710675046430 time 710684642961 state 0x2 ref 0 00000100:00100000:1.0:1789760772.442354:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.442508:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406080 00000100:00100000:0.0:1789760772.442518:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406080 00000100:00100000:0.0:1789760772.442572:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710675046430 time 710684642961 state 0x0 ref 1 00000100:00100000:0.0:1789760772.442586:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710684903377 time 710684642961 state 0x1 ref 1 00000100:00100000:0.0:1789760772.442621:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710684903377 time 710702912863 state 0x0 ref 1 00000100:00100000:0.0:1789760772.442637:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.442683:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69644288, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21370 00010000:00010000:0.0:1789760772.442693:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.442741:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.442746:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.444224:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.444250:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.452104:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984311 is committed 00002000:00010000:0.0:1789760772.452318:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69644288 -> 69648384 00002000:00010000:0.0:1789760772.452323:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136048 -> 136056 00010000:00010000:0.0:1789760772.452346:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452358:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452368:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452375:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.452381:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452390:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452420:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.452428:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674cffd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69644288->69648383] (req 69644288->69648383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.452531:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9892us (10180us total) trans 4294984311 rc 0/0 00000100:00100000:0.0:1789760772.452542:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17014 00000100:00100000:0.0:1789760772.452552:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710684903377 time 710702912863 state 0x2 ref 0 00000100:00100000:3.0:1789760772.461571:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.464853:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406208 00000100:00100000:0.0:1789760772.464867:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406208 00000100:00100000:0.0:1789760772.464934:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710684903377 time 710702912863 state 0x0 ref 1 00000100:00100000:0.0:1789760772.464950:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710703173279 time 710702912863 state 0x1 ref 1 00000100:00100000:0.0:1789760772.465049:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710703173279 time 710725339397 state 0x0 ref 1 00000100:00100000:0.0:1789760772.465065:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565406208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.465120:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69648384, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21378 00010000:00010000:0.0:1789760772.465130:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.465146:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.465151:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.465157:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.465171:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.472100:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984312 is committed 00002000:00010000:0.0:1789760772.472312:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69648384 -> 69652480 00002000:00010000:0.0:1789760772.472316:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136056 -> 136064 00010000:00010000:0.0:1789760772.472330:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472344:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472353:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472360:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.472365:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472374:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472396:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.472404:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d004 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69648384->69652479] (req 69648384->69652479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.472564:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565406208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7497us (10997us total) trans 4294984312 rc 0/0 00000100:00100000:0.0:1789760772.472576:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17015 00000100:00100000:0.0:1789760772.472585:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710703173279 time 710725339397 state 0x2 ref 0 00000100:00100000:2.0:1789760772.485151:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.485347:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406336 00000100:00100000:1.0:1789760772.485356:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406336 00000100:00100000:1.0:1789760772.485412:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710703173279 time 710725339397 state 0x0 ref 1 00000100:00100000:1.0:1789760772.486012:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710725599813 time 710725339397 state 0x1 ref 1 00000100:00100000:1.0:1789760772.486096:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710725599813 time 710746386664 state 0x0 ref 1 00000100:00100000:1.0:1789760772.486114:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.486161:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69652480, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21380 00010000:00010000:1.0:1789760772.486171:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.486192:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.486201:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.486208:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.486224:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.493366:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984313 is committed 00002000:00010000:1.0:1789760772.494084:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69652480 -> 69656576 00002000:00010000:1.0:1789760772.494092:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136064 -> 136072 00010000:00010000:1.0:1789760772.494106:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494118:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494127:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494135:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.494139:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494149:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494172:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.494179:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d00b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69652480->69656575] (req 69652480->69656575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.494265:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8152us (9120us total) trans 4294984313 rc 0/0 00000100:00100000:1.0:1789760772.494275:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17016 00000100:00100000:1.0:1789760772.494284:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710725599813 time 710746386664 state 0x2 ref 0 00000100:00100000:1.0:1789760772.503551:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.503660:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406464 00000100:00100000:0.0:1789760772.503670:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406464 00000100:00100000:0.0:1789760772.503788:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710725599813 time 710746386664 state 0x0 ref 1 00000100:00100000:0.0:1789760772.503803:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710746647080 time 710746386664 state 0x1 ref 1 00000100:00100000:0.0:1789760772.503873:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710746647080 time 710764164838 state 0x0 ref 1 00000100:00100000:0.0:1789760772.503887:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.503935:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69656576, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21388 00010000:00010000:0.0:1789760772.503944:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.503959:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.503965:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.503972:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.503985:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.511279:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984314 is committed 00002000:00010000:0.0:1789760772.515075:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69656576 -> 69660672 00002000:00010000:0.0:1789760772.515084:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136072 -> 136080 00010000:00010000:0.0:1789760772.515097:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.515110:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.516968:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.516978:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.516983:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.516992:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.517013:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.517024:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d012 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69656576->69660671] (req 69656576->69660671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.517213:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13325us (13667us total) trans 4294984314 rc 0/0 00000100:00100000:0.0:1789760772.517224:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17017 00000100:00100000:0.0:1789760772.517233:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710746647080 time 710764164838 state 0x2 ref 0 00000100:00100000:3.0:1789760772.521281:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.521446:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406592 00000100:00100000:0.0:1789760772.521457:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406592 00000100:00100000:0.0:1789760772.521515:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710746647080 time 710764164838 state 0x0 ref 1 00000100:00100000:0.0:1789760772.521667:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710764425254 time 710764164838 state 0x1 ref 1 00000100:00100000:0.0:1789760772.521700:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710764425254 time 710781992376 state 0x0 ref 1 00000100:00100000:0.0:1789760772.521804:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.523328:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69660672, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21390 00010000:00010000:0.0:1789760772.523339:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.523355:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.523359:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.523365:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.523385:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.529264:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984315 is committed 00002000:00010000:0.0:1789760772.529375:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69660672 -> 69664768 00002000:00010000:0.0:1789760772.529380:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136080 -> 136088 00010000:00010000:0.0:1789760772.529394:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529407:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529417:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529424:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.529429:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529439:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529460:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.529467:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d019 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69660672->69664767] (req 69660672->69664767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.529674:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7870us (8398us total) trans 4294984315 rc 0/0 00000100:00100000:0.0:1789760772.529685:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17018 00000100:00100000:0.0:1789760772.529694:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710764425254 time 710781992376 state 0x2 ref 0 00000100:00100000:2.0:1789760772.536453:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.536635:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406720 00000100:00100000:1.0:1789760772.536647:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406720 00000100:00100000:1.0:1789760772.538099:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710764425254 time 710781992376 state 0x0 ref 1 00000100:00100000:1.0:1789760772.538125:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710782252792 time 710781992376 state 0x1 ref 1 00000100:00100000:1.0:1789760772.538172:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710782252792 time 710798463948 state 0x0 ref 1 00000100:00100000:1.0:1789760772.538191:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.538244:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69664768, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21398 00010000:00010000:1.0:1789760772.538255:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.538276:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.538280:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.538286:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.538300:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.543560:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984316 is committed 00002000:00010000:1.0:1789760772.543732:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69664768 -> 69668864 00002000:00010000:1.0:1789760772.543737:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136088 -> 136096 00010000:00010000:1.0:1789760772.543751:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543764:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543788:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543795:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.543801:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543810:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543835:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.543843:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d020 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69664768->69668863] (req 69664768->69668863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.543953:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5765us (7503us total) trans 4294984316 rc 0/0 00000100:00100000:1.0:1789760772.543964:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17019 00000100:00100000:1.0:1789760772.543973:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710782252792 time 710798463948 state 0x2 ref 0 00000100:00100000:1.0:1789760772.551976:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.552055:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406848 00000100:00100000:0.0:1789760772.552065:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406848 00000100:00100000:0.0:1789760772.552115:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710782252792 time 710798463948 state 0x0 ref 1 00000100:00100000:0.0:1789760772.552319:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710798724364 time 710798463948 state 0x1 ref 1 00000100:00100000:0.0:1789760772.552434:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710798724364 time 710812725271 state 0x0 ref 1 00000100:00100000:0.0:1789760772.552448:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.552493:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69668864, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213a0 00010000:00010000:0.0:1789760772.552501:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.552515:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.552520:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.552525:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.552539:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.561263:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984317 is committed 00002000:00010000:0.0:1789760772.561451:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69668864 -> 69672960 00002000:00010000:0.0:1789760772.561456:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136096 -> 136104 00010000:00010000:0.0:1789760772.561468:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561481:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561490:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561498:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.561503:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561512:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561594:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.561602:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d027 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69668864->69672959] (req 69668864->69672959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.561826:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565406848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9374us (9853us total) trans 4294984317 rc 0/0 00000100:00100000:0.0:1789760772.561838:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17020 00000100:00100000:0.0:1789760772.561847:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710798724364 time 710812725271 state 0x2 ref 0 00000100:00100000:3.0:1789760772.569186:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.571396:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565406976 00000100:00100000:0.0:1789760772.571416:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565406976 00000100:00100000:0.0:1789760772.571486:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710798724364 time 710812725271 state 0x0 ref 1 00000100:00100000:0.0:1789760772.571503:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710812985687 time 710812725271 state 0x1 ref 1 00000100:00100000:0.0:1789760772.571597:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710812985687 time 710831888037 state 0x0 ref 1 00000100:00100000:0.0:1789760772.571612:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.571665:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69672960, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213a8 00010000:00010000:0.0:1789760772.571677:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.571694:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.571700:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.571731:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.571749:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.577217:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984318 is committed 00002000:00010000:0.0:1789760772.577352:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69672960 -> 69677056 00002000:00010000:0.0:1789760772.577357:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136104 -> 136112 00010000:00010000:0.0:1789760772.577373:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577387:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577396:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577405:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.577410:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577420:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577450:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.577457:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d02e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69672960->69677055] (req 69672960->69677055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.577551:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565406976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5937us (8371us total) trans 4294984318 rc 0/0 00000100:00100000:0.0:1789760772.577562:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17021 00000100:00100000:0.0:1789760772.577570:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710812985687 time 710831888037 state 0x2 ref 0 00000100:00100000:2.0:1789760772.583397:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.583926:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407104 00000100:00100000:1.0:1789760772.583936:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407104 00000100:00100000:1.0:1789760772.583999:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710812985687 time 710831888037 state 0x0 ref 1 00000100:00100000:1.0:1789760772.584016:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710832148453 time 710831888037 state 0x1 ref 1 00000100:00100000:1.0:1789760772.584051:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710832148453 time 710844341967 state 0x0 ref 1 00000100:00100000:1.0:1789760772.584067:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.584139:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69677056, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213b0 00010000:00010000:1.0:1789760772.584157:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.584181:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.584186:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.584195:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.584209:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.592319:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984319 is committed 00002000:00010000:1.0:1789760772.592519:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69677056 -> 69681152 00002000:00010000:1.0:1789760772.592524:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136112 -> 136120 00010000:00010000:1.0:1789760772.592548:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592561:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592571:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592578:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.592583:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592823:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592851:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.592859:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d035 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69677056->69681151] (req 69677056->69681151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.593006:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8939us (9617us total) trans 4294984319 rc 0/0 00000100:00100000:1.0:1789760772.593017:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17022 00000100:00100000:1.0:1789760772.593027:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710832148453 time 710844341967 state 0x2 ref 0 00000100:00100000:1.0:1789760772.597064:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.597164:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407232 00000100:00100000:0.0:1789760772.597173:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407232 00000100:00100000:0.0:1789760772.597229:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710832148453 time 710844341967 state 0x0 ref 1 00000100:00100000:0.0:1789760772.597245:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710844602383 time 710844341967 state 0x1 ref 1 00000100:00100000:0.0:1789760772.597280:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710844602383 time 710857571613 state 0x0 ref 1 00000100:00100000:0.0:1789760772.597293:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.597341:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69681152, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213b8 00010000:00010000:0.0:1789760772.597350:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.597365:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.597370:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.597376:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.597390:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.609065:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984320 is committed 00002000:00010000:0.0:1789760772.609215:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69681152 -> 69685248 00002000:00010000:0.0:1789760772.609220:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136120 -> 136128 00010000:00010000:0.0:1789760772.609235:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609255:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609265:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609273:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.609278:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609287:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609307:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.609315:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d03c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69681152->69685247] (req 69681152->69685247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.609417:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12122us (12358us total) trans 4294984320 rc 0/0 00000100:00100000:0.0:1789760772.609437:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17023 00000100:00100000:0.0:1789760772.609446:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710844602383 time 710857571613 state 0x2 ref 0 00000100:00100000:3.0:1789760772.614034:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.614637:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407360 00000100:00100000:0.0:1789760772.614647:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407360 00000100:00100000:0.0:1789760772.614747:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710844602383 time 710857571613 state 0x0 ref 1 00000100:00100000:0.0:1789760772.614765:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710857832029 time 710857571613 state 0x1 ref 1 00000100:00100000:0.0:1789760772.614806:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710857832029 time 710875097944 state 0x0 ref 1 00000100:00100000:0.0:1789760772.614819:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.614879:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69685248, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213c0 00010000:00010000:0.0:1789760772.614890:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.614908:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.614912:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.614919:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.614933:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.620829:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984321 is committed 00002000:00010000:0.0:1789760772.621004:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69685248 -> 69689344 00002000:00010000:0.0:1789760772.621011:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136128 -> 136136 00010000:00010000:0.0:1789760772.621025:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621039:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621054:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621062:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.621067:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621076:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621097:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.621105:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d043 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69685248->69689343] (req 69685248->69689343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.621220:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6398us (7188us total) trans 4294984321 rc 0/0 00000100:00100000:0.0:1789760772.621231:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17024 00000100:00100000:0.0:1789760772.621243:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710857832029 time 710875097944 state 0x2 ref 0 00000100:00100000:2.0:1789760772.626102:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.626310:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407488 00000100:00100000:1.0:1789760772.626320:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407488 00000100:00100000:1.0:1789760772.626373:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710857832029 time 710875097944 state 0x0 ref 1 00000100:00100000:1.0:1789760772.626387:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710875358360 time 710875097944 state 0x1 ref 1 00000100:00100000:1.0:1789760772.626414:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710875358360 time 710886706688 state 0x0 ref 1 00000100:00100000:1.0:1789760772.626425:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.626473:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69689344, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213c8 00010000:00010000:1.0:1789760772.626482:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.626499:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.626504:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.626511:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.626526:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.634128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984322 is committed 00002000:00010000:1.0:1789760772.634444:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69689344 -> 69693440 00002000:00010000:1.0:1789760772.634450:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136136 -> 136144 00010000:00010000:1.0:1789760772.634465:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634478:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634488:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634496:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.634500:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634509:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634532:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.634539:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d04a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69689344->69693439] (req 69689344->69693439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.634636:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8208us (8538us total) trans 4294984322 rc 0/0 00000100:00100000:1.0:1789760772.634647:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17025 00000100:00100000:1.0:1789760772.634656:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710875358360 time 710886706688 state 0x2 ref 0 00000100:00100000:1.0:1789760772.641603:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.641700:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407616 00000100:00100000:0.0:1789760772.641756:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407616 00000100:00100000:0.0:1789760772.642256:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710875358360 time 710886706688 state 0x0 ref 1 00000100:00100000:0.0:1789760772.642281:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710886967104 time 710886706688 state 0x1 ref 1 00000100:00100000:0.0:1789760772.642319:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710886967104 time 710902611314 state 0x0 ref 1 00000100:00100000:0.0:1789760772.642334:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.642385:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69693440, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213d0 00010000:00010000:0.0:1789760772.642395:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.642413:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.642417:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.642424:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.642439:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.649048:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984323 is committed 00002000:00010000:0.0:1789760772.649181:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69693440 -> 69697536 00002000:00010000:0.0:1789760772.649186:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136144 -> 136152 00010000:00010000:0.0:1789760772.649202:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649213:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649223:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649236:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.649240:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649249:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649269:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.649277:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d051 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69693440->69697535] (req 69693440->69697535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.649372:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565407616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7036us (7773us total) trans 4294984323 rc 0/0 00000100:00100000:0.0:1789760772.649381:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17026 00000100:00100000:0.0:1789760772.649391:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710886967104 time 710902611314 state 0x2 ref 0 00000100:00100000:3.0:1789760772.653537:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.654651:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407744 00000100:00100000:0.0:1789760772.654662:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407744 00000100:00100000:0.0:1789760772.654733:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710886967104 time 710902611314 state 0x0 ref 1 00000100:00100000:0.0:1789760772.654747:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710902871730 time 710902611314 state 0x1 ref 1 00000100:00100000:3.0:1789760772.654826:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710902871730 time 710915110826 state 0x0 ref 1 00000100:00100000:3.0:1789760772.654843:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760772.654888:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69697536, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213d8 00010000:00010000:3.0:1789760772.654898:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.654913:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:3.0:1789760772.654918:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760772.654924:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.654943:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.661246:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984324 is committed 00002000:00010000:3.0:1789760772.662104:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69697536 -> 69701632 00002000:00010000:3.0:1789760772.662112:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136152 -> 136160 00010000:00010000:3.0:1789760772.662136:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662150:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662159:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662167:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760772.662172:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662182:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662202:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.662210:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d058 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69697536->69701631] (req 69697536->69701631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.662311:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565407744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7468us (8780us total) trans 4294984324 rc 0/0 00000100:00100000:3.0:1789760772.662322:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17027 00000100:00100000:3.0:1789760772.662332:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710902871730 time 710915110826 state 0x2 ref 0 00000100:00100000:2.0:1789760772.668831:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.668931:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565407872 00000100:00100000:1.0:1789760772.668941:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565407872 00000100:00100000:1.0:1789760772.668990:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710902871730 time 710915110826 state 0x0 ref 1 00000100:00100000:1.0:1789760772.669003:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710915371242 time 710915110826 state 0x1 ref 1 00000100:00100000:1.0:1789760772.669036:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710915371242 time 710929327568 state 0x0 ref 1 00000100:00100000:1.0:1789760772.669049:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565407872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.669097:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69701632, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213e0 00010000:00010000:1.0:1789760772.669108:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.669129:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1789760772.669133:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.669140:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.669152:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.675293:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984325 is committed 00002000:00010000:1.0:1789760772.675431:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69701632 -> 69705728 00002000:00010000:1.0:1789760772.675436:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136160 -> 136168 00010000:00010000:1.0:1789760772.675449:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675461:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675471:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675478:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.675483:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675492:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675516:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.675524:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d05f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69701632->69705727] (req 69701632->69705727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.675667:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565407872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6614us (6844us total) trans 4294984325 rc 0/0 00000100:00100000:1.0:1789760772.675678:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17028 00000100:00100000:1.0:1789760772.675687:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710915371242 time 710929327568 state 0x2 ref 0 00000100:00100000:1.0:1789760772.686392:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.689277:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408000 00000100:00100000:0.0:1789760772.689291:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408000 00000100:00100000:0.0:1789760772.689359:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710915371242 time 710929327568 state 0x0 ref 1 00000100:00100000:0.0:1789760772.689376:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710929587984 time 710929327568 state 0x1 ref 1 00000100:00100000:0.0:1789760772.689407:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710929587984 time 710949699026 state 0x0 ref 1 00000100:00100000:0.0:1789760772.689430:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.689479:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69705728, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213e8 00010000:00010000:0.0:1789760772.689488:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.689504:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.689509:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.689515:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.689529:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.696682:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984326 is committed 00002000:00010000:0.0:1789760772.696816:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69705728 -> 69709824 00002000:00010000:0.0:1789760772.696819:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136168 -> 136176 00010000:00010000:0.0:1789760772.696830:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696839:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696855:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696861:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.696865:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696871:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696884:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.696888:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d066 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69705728->69709823] (req 69705728->69709823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.697150:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7718us (10760us total) trans 4294984326 rc 0/0 00000100:00100000:0.0:1789760772.697160:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17029 00000100:00100000:0.0:1789760772.697168:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710929587984 time 710949699026 state 0x2 ref 0 00000100:00100000:3.0:1789760772.703621:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.703732:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408128 00000100:00100000:0.0:1789760772.703742:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408128 00000100:00100000:0.0:1789760772.703812:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710929587984 time 710949699026 state 0x0 ref 1 00000100:00100000:0.0:1789760772.703828:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710949959442 time 710949699026 state 0x1 ref 1 00000100:00100000:0.0:1789760772.703865:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710949959442 time 710964156612 state 0x0 ref 1 00000100:00100000:0.0:1789760772.703878:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.703925:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69709824, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213f0 00010000:00010000:0.0:1789760772.703934:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.703948:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.703952:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.703958:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.703972:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.709745:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984327 is committed 00002000:00010000:0.0:1789760772.709870:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69709824 -> 69713920 00002000:00010000:0.0:1789760772.709876:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136176 -> 136184 00010000:00010000:0.0:1789760772.709888:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709901:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709910:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709924:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.709929:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709938:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709956:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.709963:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d06d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69709824->69713919] (req 69709824->69713919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.710049:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6168us (6434us total) trans 4294984327 rc 0/0 00000100:00100000:0.0:1789760772.710059:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17030 00000100:00100000:0.0:1789760772.710069:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710949959442 time 710964156612 state 0x2 ref 0 00000100:00100000:1.0:1789760772.719947:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.720336:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408256 00000100:00100000:2.0:1789760772.720347:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408256 00000100:00100000:2.0:1789760772.720413:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710949959442 time 710964156612 state 0x0 ref 1 00000100:00100000:2.0:1789760772.720428:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710964417028 time 710964156612 state 0x1 ref 1 00000100:00100000:2.0:1789760772.720461:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710964417028 time 710980753622 state 0x0 ref 1 00000100:00100000:2.0:1789760772.720473:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.720531:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69713920, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x213f8 00010000:00010000:2.0:1789760772.720540:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.720557:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1789760772.720561:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.720569:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.720582:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.729394:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984328 is committed 00002000:00010000:2.0:1789760772.729888:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69713920 -> 69718016 00002000:00010000:2.0:1789760772.729894:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136184 -> 136192 00010000:00010000:2.0:1789760772.729907:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.729920:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.729929:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.729937:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.729942:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.729951:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.730049:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.730058:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d074 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69713920->69718015] (req 69713920->69718015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.730150:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9673us (10208us total) trans 4294984328 rc 0/0 00000100:00100000:2.0:1789760772.730161:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17031 00000100:00100000:2.0:1789760772.730170:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710964417028 time 710980753622 state 0x2 ref 0 00000100:00100000:1.0:1789760772.739492:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.739853:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408384 00000100:00100000:0.0:1789760772.739863:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408384 00000100:00100000:0.0:1789760772.739917:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710964417028 time 710980753622 state 0x0 ref 1 00000100:00100000:0.0:1789760772.739932:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710981014038 time 710980753622 state 0x1 ref 1 00000100:00100000:0.0:1789760772.739971:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710981014038 time 711000263452 state 0x0 ref 1 00000100:00100000:0.0:1789760772.739989:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.740035:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69718016, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21400 00010000:00010000:0.0:1789760772.740045:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.740060:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1789760772.740065:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.740071:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.740096:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.748419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984329 is committed 00002000:00010000:2.0:1789760772.752965:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69718016 -> 69722112 00002000:00010000:2.0:1789760772.752974:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136192 -> 136200 00010000:00010000:2.0:1789760772.752987:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753000:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753009:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753017:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.753022:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753037:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753060:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.753069:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d07b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69718016->69722111] (req 69718016->69722111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.753174:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13183us (13685us total) trans 4294984329 rc 0/0 00000100:00100000:2.0:1789760772.753186:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17032 00000100:00100000:2.0:1789760772.753196:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710981014038 time 711000263452 state 0x2 ref 0 00000100:00100000:3.0:1789760772.763253:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.763662:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408512 00000100:00100000:0.0:1789760772.763672:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408512 00000100:00100000:0.0:1789760772.763951:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 710981014038 time 711000263452 state 0x0 ref 1 00000100:00100000:0.0:1789760772.763967:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711000523868 time 711000263452 state 0x1 ref 1 00000100:00100000:0.0:1789760772.763999:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711000523868 time 711024290879 state 0x0 ref 1 00000100:00100000:0.0:1789760772.764013:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.764059:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69722112, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21408 00010000:00010000:0.0:1789760772.764068:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.764085:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.764089:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.764096:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.764110:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.770032:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984330 is committed 00002000:00010000:0.0:1789760772.770152:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69722112 -> 69726208 00002000:00010000:0.0:1789760772.770170:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136200 -> 136208 00010000:00010000:0.0:1789760772.770184:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770198:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770209:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770216:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.770222:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770231:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770255:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.770264:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d082 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69722112->69726207] (req 69722112->69726207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.770354:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565408512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6340us (7107us total) trans 4294984330 rc 0/0 00000100:00100000:0.0:1789760772.770366:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17033 00000100:00100000:0.0:1789760772.770375:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711000523868 time 711024290879 state 0x2 ref 0 00000100:00100000:1.0:1789760772.778928:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.779016:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408640 00000100:00100000:2.0:1789760772.779026:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408640 00000100:00100000:2.0:1789760772.779081:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711000523868 time 711024290879 state 0x0 ref 1 00000100:00100000:2.0:1789760772.779096:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711024551295 time 711024290879 state 0x1 ref 1 00000100:00100000:2.0:1789760772.779176:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711024551295 time 711039466369 state 0x0 ref 1 00000100:00100000:2.0:1789760772.779189:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565408640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.779238:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69726208, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21410 00010000:00010000:2.0:1789760772.779247:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.779263:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760772.779268:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.779274:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.779287:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.786580:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984331 is committed 00002000:00010000:2.0:1789760772.786699:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69726208 -> 69730304 00002000:00010000:2.0:1789760772.786732:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136208 -> 136216 00010000:00010000:2.0:1789760772.786748:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786761:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786779:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786786:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.786791:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786799:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786921:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.786930:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d089 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69726208->69730303] (req 69726208->69730303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.787015:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565408640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7824us (8093us total) trans 4294984331 rc 0/0 00000100:00100000:2.0:1789760772.787025:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17034 00000100:00100000:2.0:1789760772.787034:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711024551295 time 711039466369 state 0x2 ref 0 00000100:00100000:1.0:1789760772.793931:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.794082:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408768 00000100:00100000:2.0:1789760772.794092:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408768 00000100:00100000:2.0:1789760772.794202:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711024551295 time 711039466369 state 0x0 ref 1 00000100:00100000:2.0:1789760772.794218:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711039726785 time 711039466369 state 0x1 ref 1 00000100:00100000:2.0:1789760772.794257:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711039726785 time 711054541465 state 0x0 ref 1 00000100:00100000:2.0:1789760772.794270:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565408768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.794327:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69730304, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21418 00010000:00010000:2.0:1789760772.794337:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.794353:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760772.794358:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.794364:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.794377:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.800095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984332 is committed 00002000:00010000:2.0:1789760772.803087:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69730304 -> 69734400 00002000:00010000:2.0:1789760772.803097:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136216 -> 136224 00010000:00010000:2.0:1789760772.803111:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803124:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803132:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803139:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.803143:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803152:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803172:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.803185:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d090 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69730304->69734399] (req 69730304->69734399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.803396:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565408768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9123us (9479us total) trans 4294984332 rc 0/0 00000100:00100000:2.0:1789760772.803407:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17035 00000100:00100000:2.0:1789760772.804091:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711039726785 time 711054541465 state 0x2 ref 0 00000100:00100000:3.0:1789760772.818323:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.818438:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565408896 00000100:00100000:0.0:1789760772.818449:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565408896 00000100:00100000:0.0:1789760772.818516:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711039726785 time 711054541465 state 0x0 ref 1 00000100:00100000:0.0:1789760772.818533:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711054801881 time 711054541465 state 0x1 ref 1 00000100:00100000:0.0:1789760772.818567:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711054801881 time 711078859669 state 0x0 ref 1 00000100:00100000:0.0:1789760772.818579:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565408896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.818633:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69734400, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21420 00010000:00010000:0.0:1789760772.818642:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.818658:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.818663:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.818670:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.818685:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.825273:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984333 is committed 00002000:00010000:0.0:1789760772.828835:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69734400 -> 69738496 00002000:00010000:0.0:1789760772.828846:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136224 -> 136232 00010000:00010000:0.0:1789760772.828860:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828873:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828882:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828890:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.828895:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828905:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828924:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.828937:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d097 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69734400->69738495] (req 69734400->69738495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.829069:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565408896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10486us (10751us total) trans 4294984333 rc 0/0 00000100:00100000:0.0:1789760772.829079:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17036 00000100:00100000:0.0:1789760772.829089:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711054801881 time 711078859669 state 0x2 ref 0 00000100:00100000:1.0:1789760772.833157:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760772.833253:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409024 00000100:00100000:2.0:1789760772.833263:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409024 00000100:00100000:2.0:1789760772.833317:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711054801881 time 711078859669 state 0x0 ref 1 00000100:00100000:2.0:1789760772.833332:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711079120085 time 711078859669 state 0x1 ref 1 00000100:00100000:2.0:1789760772.833362:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711079120085 time 711093653831 state 0x0 ref 1 00000100:00100000:2.0:1789760772.833375:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760772.833445:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69738496, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21428 00010000:00010000:2.0:1789760772.833454:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.833470:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760772.833474:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.833480:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.833500:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.838754:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984334 is committed 00002000:00010000:2.0:1789760772.838893:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69738496 -> 69742592 00002000:00010000:2.0:1789760772.838899:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136232 -> 136240 00010000:00010000:2.0:1789760772.838912:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838924:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838932:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838939:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.838943:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838951:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838970:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.838979:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d09e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69738496->69742591] (req 69738496->69742591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.839114:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5736us (5961us total) trans 4294984334 rc 0/0 00000100:00100000:2.0:1789760772.839125:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17037 00000100:00100000:2.0:1789760772.839136:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711079120085 time 711093653831 state 0x2 ref 0 00000100:00100000:2.0:1789760772.844519:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.844640:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409152 00000100:00100000:0.0:1789760772.844650:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409152 00000100:00100000:0.0:1789760772.844738:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711079120085 time 711093653831 state 0x0 ref 1 00000100:00100000:0.0:1789760772.844754:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711093914247 time 711093653831 state 0x1 ref 1 00000100:00100000:0.0:1789760772.844787:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711093914247 time 711105079250 state 0x0 ref 1 00000100:00100000:0.0:1789760772.844801:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565409152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.844848:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69742592, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21430 00010000:00010000:0.0:1789760772.844857:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.844872:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.844877:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.844883:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.844902:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.851432:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984335 is committed 00002000:00010000:0.0:1789760772.851564:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69742592 -> 69746688 00002000:00010000:0.0:1789760772.851570:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136240 -> 136248 00010000:00010000:0.0:1789760772.851582:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851595:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851603:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851609:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.851613:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851621:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851640:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.851647:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69742592->69746687] (req 69742592->69746687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.851893:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565409152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7090us (7379us total) trans 4294984335 rc 0/0 00000100:00100000:0.0:1789760772.851904:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17038 00000100:00100000:0.0:1789760772.851921:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711093914247 time 711105079250 state 0x2 ref 0 00000100:00100000:3.0:1789760772.856205:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.856472:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409280 00000100:00100000:0.0:1789760772.856482:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409280 00000100:00100000:0.0:1789760772.856539:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711093914247 time 711105079250 state 0x0 ref 1 00000100:00100000:0.0:1789760772.856555:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711105339666 time 711105079250 state 0x1 ref 1 00000100:00100000:0.0:1789760772.856624:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711105339666 time 711116915725 state 0x0 ref 1 00000100:00100000:0.0:1789760772.856638:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.856687:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69746688, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21438 00010000:00010000:0.0:1789760772.856697:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.856755:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.856761:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.856777:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.856792:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.862416:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984336 is committed 00002000:00010000:0.0:1789760772.862582:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69746688 -> 69750784 00002000:00010000:0.0:1789760772.862587:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136248 -> 136256 00010000:00010000:0.0:1789760772.862600:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862611:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862620:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862627:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.862632:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862641:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862667:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.862674:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69746688->69750783] (req 69746688->69750783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.862842:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6202us (6642us total) trans 4294984336 rc 0/0 00000100:00100000:0.0:1789760772.862852:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17039 00000100:00100000:0.0:1789760772.862862:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711105339666 time 711116915725 state 0x2 ref 0 00000100:00100000:2.0:1789760772.866011:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.866114:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409408 00000100:00100000:1.0:1789760772.866229:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409408 00000100:00100000:1.0:1789760772.866285:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711105339666 time 711116915725 state 0x0 ref 1 00000100:00100000:1.0:1789760772.866301:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711117176141 time 711116915725 state 0x1 ref 1 00000100:00100000:1.0:1789760772.866369:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711117176141 time 711126659603 state 0x0 ref 1 00000100:00100000:1.0:1789760772.866383:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565409408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.866441:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69750784, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21440 00010000:00010000:1.0:1789760772.866451:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.866467:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760772.866471:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.866477:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.866491:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.872174:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984337 is committed 00002000:00010000:1.0:1789760772.872307:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69750784 -> 69754880 00002000:00010000:1.0:1789760772.872313:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136256 -> 136264 00010000:00010000:1.0:1789760772.872327:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872340:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872349:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872357:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.872362:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872370:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872388:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.872397:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69750784->69754879] (req 69750784->69754879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.872524:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565409408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6138us (6517us total) trans 4294984337 rc 0/0 00000100:00100000:1.0:1789760772.872535:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17040 00000100:00100000:1.0:1789760772.872545:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711117176141 time 711126659603 state 0x2 ref 0 00000100:00100000:2.0:1789760772.880978:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.881158:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409536 00000100:00100000:0.0:1789760772.881167:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409536 00000100:00100000:0.0:1789760772.881220:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711117176141 time 711126659603 state 0x0 ref 1 00000100:00100000:0.0:1789760772.881235:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711126920019 time 711126659603 state 0x1 ref 1 00000100:00100000:0.0:1789760772.881264:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711126920019 time 711141555816 state 0x0 ref 1 00000100:00100000:0.0:1789760772.881278:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565409536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.881328:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69754880, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21448 00010000:00010000:0.0:1789760772.881337:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.881352:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.881357:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.881363:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.881378:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760772.887461:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984338 is committed 00002000:00010000:0.0:1789760772.887919:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69754880 -> 69758976 00002000:00010000:0.0:1789760772.887925:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136264 -> 136272 00010000:00010000:0.0:1789760772.887941:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.887954:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.888040:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.888049:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.888053:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.888063:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.888085:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.888094:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69754880->69758975] (req 69754880->69758975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.888304:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565409536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7023us (7332us total) trans 4294984338 rc 0/0 00000100:00100000:0.0:1789760772.888315:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17041 00000100:00100000:0.0:1789760772.888324:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711126920019 time 711141555816 state 0x2 ref 0 00000100:00100000:3.0:1789760772.892460:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.895187:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409664 00000100:00100000:0.0:1789760772.895200:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409664 00000100:00100000:0.0:1789760772.895257:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711126920019 time 711141555816 state 0x0 ref 1 00000100:00100000:0.0:1789760772.895271:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711141816232 time 711141555816 state 0x1 ref 1 00000100:00100000:0.0:1789760772.895343:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711141816232 time 711155634771 state 0x0 ref 1 00000100:00100000:0.0:1789760772.895357:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.895404:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69758976, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21450 00010000:00010000:0.0:1789760772.895413:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.895431:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.895435:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.895441:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.895453:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.903746:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984339 is committed 00002000:00010000:0.0:1789760772.903979:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69758976 -> 69763072 00002000:00010000:0.0:1789760772.903987:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136272 -> 136280 00010000:00010000:0.0:1789760772.904004:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904019:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904026:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904033:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.904041:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904050:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904072:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.904081:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69758976->69763071] (req 69758976->69763071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.904182:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565409664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8823us (11727us total) trans 4294984339 rc 0/0 00000100:00100000:0.0:1789760772.904192:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17042 00000100:00100000:0.0:1789760772.904202:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711141816232 time 711155634771 state 0x2 ref 0 00000100:00100000:2.0:1789760772.909122:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.909159:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409792 00000100:00100000:1.0:1789760772.909170:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409792 00000100:00100000:1.0:1789760772.909224:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711141816232 time 711155634771 state 0x0 ref 1 00000100:00100000:1.0:1789760772.909240:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711155895187 time 711155634771 state 0x1 ref 1 00000100:00100000:1.0:1789760772.909266:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711155895187 time 711169558005 state 0x0 ref 1 00000100:00100000:1.0:1789760772.909278:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565409792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.909334:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69763072, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21458 00010000:00010000:1.0:1789760772.909344:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.909360:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760772.909364:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.909371:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.909385:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.918242:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984340 is committed 00002000:00010000:1.0:1789760772.918363:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69763072 -> 69767168 00002000:00010000:1.0:1789760772.918369:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136280 -> 136288 00010000:00010000:1.0:1789760772.918381:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918396:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918405:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918412:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760772.918416:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918430:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918448:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.918455:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69763072->69767167] (req 69763072->69767167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.918552:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565409792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9267us (9439us total) trans 4294984340 rc 0/0 00000100:00100000:1.0:1789760772.918565:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17043 00000100:00100000:1.0:1789760772.918577:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711155895187 time 711169558005 state 0x2 ref 0 00000100:00100000:2.0:1789760772.923851:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.923945:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565409920 00000100:00100000:0.0:1789760772.923956:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565409920 00000100:00100000:0.0:1789760772.924014:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711155895187 time 711169558005 state 0x0 ref 1 00000100:00100000:0.0:1789760772.924030:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711169818421 time 711169558005 state 0x1 ref 1 00000100:00100000:0.0:1789760772.924064:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711169818421 time 711184355243 state 0x0 ref 1 00000100:00100000:0.0:1789760772.924077:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565409920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.924130:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69767168, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21460 00010000:00010000:0.0:1789760772.924140:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.924155:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.924159:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.924170:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.924185:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.930208:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984341 is committed 00002000:00010000:0.0:1789760772.930502:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69767168 -> 69771264 00002000:00010000:0.0:1789760772.930508:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136288 -> 136296 00010000:00010000:0.0:1789760772.930522:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930535:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930550:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930558:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.930563:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930572:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930592:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.930599:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d0cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69767168->69771263] (req 69767168->69771263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.930782:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565409920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6694us (6928us total) trans 4294984341 rc 0/0 00000100:00100000:0.0:1789760772.930794:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17044 00000100:00100000:0.0:1789760772.930804:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711169818421 time 711184355243 state 0x2 ref 0 00000100:00100000:2.0:1789760772.936136:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.936471:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410048 00000100:00100000:0.0:1789760772.936481:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410048 00000100:00100000:0.0:1789760772.936538:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711169818421 time 711184355243 state 0x0 ref 1 00000100:00100000:0.0:1789760772.936553:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711184615659 time 711184355243 state 0x1 ref 1 00000100:00100000:0.0:1789760772.936623:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711184615659 time 711196913898 state 0x0 ref 1 00000100:00100000:0.0:1789760772.936637:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565410048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.936687:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69771264, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0x21468 00010000:00010000:0.0:1789760772.936696:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.936740:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.936744:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.936751:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.936764:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.942635:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984342 is committed 00002000:00010000:0.0:1789760772.942787:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69771264 -> 69775360 00002000:00010000:0.0:1789760772.942792:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760772 -> 1789760773 00002000:00010000:0.0:1789760772.942794:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760772 -> 1789760773 00002000:00010000:0.0:1789760772.942796:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136296 -> 136304 00010000:00010000:0.0:1789760772.942809:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942822:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942831:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942838:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.942843:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942852:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942882:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.942890:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69771264->69775359] (req 69771264->69775359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.942983:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565410048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6345us (6852us total) trans 4294984342 rc 0/0 00000100:00100000:0.0:1789760772.942993:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17045 00000100:00100000:0.0:1789760772.943003:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711184615659 time 711196913898 state 0x2 ref 0 00000100:00100000:2.0:1789760772.954481:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760772.954585:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410176 00000100:00100000:1.0:1789760772.954595:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410176 00000100:00100000:1.0:1789760772.954648:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711184615659 time 711196913898 state 0x0 ref 1 00000100:00100000:1.0:1789760772.954672:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711197174314 time 711196913898 state 0x1 ref 1 00000100:00100000:1.0:1789760772.954700:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711197174314 time 711214992334 state 0x0 ref 1 00000100:00100000:1.0:1789760772.954746:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760772.954800:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69775360, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21470 00010000:00010000:1.0:1789760772.954810:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.954826:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760772.954830:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760772.954836:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.954851:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.960824:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984343 is committed 00002000:00010000:2.0:1789760772.961442:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69775360 -> 69779456 00002000:00010000:2.0:1789760772.961448:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136304 -> 136312 00010000:00010000:2.0:1789760772.961464:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961476:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961486:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961493:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760772.961499:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961507:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961524:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.961533:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69775360->69779455] (req 69775360->69779455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.961824:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7075us (7348us total) trans 4294984343 rc 0/0 00000100:00100000:2.0:1789760772.961834:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17046 00000100:00100000:2.0:1789760772.961844:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711197174314 time 711214992334 state 0x2 ref 0 00000100:00100000:2.0:1789760772.969376:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.969469:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410304 00000100:00100000:0.0:1789760772.969478:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410304 00000100:00100000:0.0:1789760772.969537:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711197174314 time 711214992334 state 0x0 ref 1 00000100:00100000:0.0:1789760772.969553:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711215252750 time 711214992334 state 0x1 ref 1 00000100:00100000:0.0:1789760772.969577:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711215252750 time 711229869565 state 0x0 ref 1 00000100:00100000:0.0:1789760772.969594:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565410304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.969645:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69779456, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21478 00010000:00010000:0.0:1789760772.969654:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.969670:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.969674:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.969680:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.969692:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.978509:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984344 is committed 00002000:00010000:0.0:1789760772.978684:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69779456 -> 69783552 00002000:00010000:0.0:1789760772.978689:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136312 -> 136320 00010000:00010000:0.0:1789760772.978702:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978784:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978793:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978800:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.978806:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978816:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978835:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.978843:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69779456->69783551] (req 69779456->69783551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.978982:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565410304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9386us (9609us total) trans 4294984344 rc 0/0 00000100:00100000:0.0:1789760772.978993:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17047 00000100:00100000:0.0:1789760772.979003:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711215252750 time 711229869565 state 0x2 ref 0 00000100:00100000:3.0:1789760772.983674:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760772.983956:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410432 00000100:00100000:0.0:1789760772.983965:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410432 00000100:00100000:0.0:1789760772.984023:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711215252750 time 711229869565 state 0x0 ref 1 00000100:00100000:0.0:1789760772.984038:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711230129981 time 711229869565 state 0x1 ref 1 00000100:00100000:0.0:1789760772.984067:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711230129981 time 711244359798 state 0x0 ref 1 00000100:00100000:0.0:1789760772.984079:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565410432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760772.984134:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69783552, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21480 00010000:00010000:0.0:1789760772.984142:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.984164:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760772.984169:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.984175:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.984190:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760772.991912:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984345 is committed 00002000:00010000:0.0:1789760772.992036:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69783552 -> 69787648 00002000:00010000:0.0:1789760772.992041:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136320 -> 136328 00010000:00010000:0.0:1789760772.992059:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992072:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992081:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992089:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760772.992093:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992102:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992295:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.992304:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69783552->69787647] (req 69783552->69787647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.992447:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565410432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8364us (8776us total) trans 4294984345 rc 0/0 00000100:00100000:0.0:1789760772.992457:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17048 00000100:00100000:0.0:1789760772.992467:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711230129981 time 711244359798 state 0x2 ref 0 00000100:00100000:2.0:1789760773.000242:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.000349:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410560 00000100:00100000:1.0:1789760773.000359:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410560 00000100:00100000:1.0:1789760773.000410:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711230129981 time 711244359798 state 0x0 ref 1 00000100:00100000:1.0:1789760773.000425:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711244620214 time 711244359798 state 0x1 ref 1 00000100:00100000:1.0:1789760773.000451:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711244620214 time 711260743180 state 0x0 ref 1 00000100:00100000:1.0:1789760773.000464:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565410560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.000512:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69787648, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21488 00010000:00010000:1.0:1789760773.000522:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.000539:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.000543:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.000549:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.000563:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.005409:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984346 is committed 00002000:00010000:1.0:1789760773.005602:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69787648 -> 69791744 00002000:00010000:1.0:1789760773.005607:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136328 -> 136336 00010000:00010000:1.0:1789760773.005620:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005633:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005642:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005650:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.005655:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005664:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005683:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.005695:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d0f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69787648->69791743] (req 69787648->69791743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.005917:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565410560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5450us (5687us total) trans 4294984346 rc 0/0 00000100:00100000:1.0:1789760773.005928:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17049 00000100:00100000:1.0:1789760773.005938:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711244620214 time 711260743180 state 0x2 ref 0 00000100:00100000:2.0:1789760773.011991:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.012087:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410688 00000100:00100000:0.0:1789760773.012097:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410688 00000100:00100000:0.0:1789760773.012175:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711244620214 time 711260743180 state 0x0 ref 1 00000100:00100000:0.0:1789760773.012192:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711261003596 time 711260743180 state 0x1 ref 1 00000100:00100000:0.0:1789760773.012222:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711261003596 time 711272513401 state 0x0 ref 1 00000100:00100000:0.0:1789760773.012235:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.012283:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69791744, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21490 00010000:00010000:0.0:1789760773.012293:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.012308:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.012314:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.012320:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.012334:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.019482:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984347 is committed 00002000:00010000:0.0:1789760773.019609:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69791744 -> 69795840 00002000:00010000:0.0:1789760773.019615:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136336 -> 136344 00010000:00010000:0.0:1789760773.019629:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019643:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019653:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019662:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.019667:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019677:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019700:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.019940:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d0f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69791744->69795839] (req 69791744->69795839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.020033:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7796us (8046us total) trans 4294984347 rc 0/0 00000100:00100000:0.0:1789760773.020045:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17050 00000100:00100000:0.0:1789760773.020054:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711261003596 time 711272513401 state 0x2 ref 0 00000100:00100000:3.0:1789760773.031053:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.031185:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410816 00000100:00100000:0.0:1789760773.031195:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410816 00000100:00100000:0.0:1789760773.031283:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711261003596 time 711272513401 state 0x0 ref 1 00000100:00100000:0.0:1789760773.031299:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711272773817 time 711272513401 state 0x1 ref 1 00000100:00100000:0.0:1789760773.031328:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711272773817 time 711291620763 state 0x0 ref 1 00000100:00100000:0.0:1789760773.031341:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565410816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.031580:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69795840, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21498 00010000:00010000:0.0:1789760773.031590:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.031606:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.031610:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.031617:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.031636:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.041379:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984348 is committed 00002000:00010000:0.0:1789760773.041632:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69795840 -> 69799936 00002000:00010000:0.0:1789760773.041638:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136344 -> 136352 00010000:00010000:0.0:1789760773.041662:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.041677:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.041687:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.041693:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.041697:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.042211:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.042234:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.042243:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69795840->69799935] (req 69795840->69799935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.042564:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565410816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11219us (11513us total) trans 4294984348 rc 0/0 00000100:00100000:0.0:1789760773.042575:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17051 00000100:00100000:0.0:1789760773.042584:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711272773817 time 711291620763 state 0x2 ref 0 00000100:00100000:2.0:1789760773.047878:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.048022:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565410944 00000100:00100000:1.0:1789760773.048032:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565410944 00000100:00100000:1.0:1789760773.048088:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711272773817 time 711291620763 state 0x0 ref 1 00000100:00100000:1.0:1789760773.048104:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711291881179 time 711291620763 state 0x1 ref 1 00000100:00100000:1.0:1789760773.048197:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711291881179 time 711308487596 state 0x0 ref 1 00000100:00100000:1.0:1789760773.048210:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.048258:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69799936, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214a0 00010000:00010000:1.0:1789760773.048267:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.048283:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.048286:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.048293:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.048306:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.054677:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984349 is committed 00002000:00010000:1.0:1789760773.055021:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69799936 -> 69804032 00002000:00010000:1.0:1789760773.055027:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136352 -> 136360 00010000:00010000:1.0:1789760773.055040:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055053:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055062:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055068:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.055073:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055082:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055099:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.055173:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d107 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69799936->69804031] (req 69799936->69804031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.055268:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565410944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7056us (7399us total) trans 4294984349 rc 0/0 00000100:00100000:1.0:1789760773.055277:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17052 00000100:00100000:1.0:1789760773.055286:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711291881179 time 711308487596 state 0x2 ref 0 00000100:00100000:2.0:1789760773.061897:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.062363:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411072 00000100:00100000:0.0:1789760773.062373:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411072 00000100:00100000:0.0:1789760773.062435:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711291881179 time 711308487596 state 0x0 ref 1 00000100:00100000:0.0:1789760773.062457:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711308748012 time 711308487596 state 0x1 ref 1 00000100:00100000:0.0:1789760773.062535:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711308748012 time 711322826049 state 0x0 ref 1 00000100:00100000:0.0:1789760773.062549:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565411072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.062601:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69804032, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214a8 00010000:00010000:0.0:1789760773.062611:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.062626:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.062631:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.062637:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.062655:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.070164:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984350 is committed 00002000:00010000:0.0:1789760773.070980:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69804032 -> 69808128 00002000:00010000:0.0:1789760773.070986:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136360 -> 136368 00010000:00010000:0.0:1789760773.071066:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071080:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071089:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071098:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.071103:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071113:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071133:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.071141:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d10e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69804032->69808127] (req 69804032->69808127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.071236:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565411072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8686us (9344us total) trans 4294984350 rc 0/0 00000100:00100000:0.0:1789760773.071247:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17053 00000100:00100000:0.0:1789760773.071255:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711308748012 time 711322826049 state 0x2 ref 0 00000100:00100000:3.0:1789760773.076413:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.076601:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411200 00000100:00100000:0.0:1789760773.076611:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411200 00000100:00100000:0.0:1789760773.076666:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711308748012 time 711322826049 state 0x0 ref 1 00000100:00100000:0.0:1789760773.076681:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711323086465 time 711322826049 state 0x1 ref 1 00000100:00100000:0.0:1789760773.076739:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711323086465 time 711337029403 state 0x0 ref 1 00000100:00100000:0.0:1789760773.076753:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565411200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.076814:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69808128, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214b0 00010000:00010000:0.0:1789760773.076824:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.076841:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.076846:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.076852:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.076867:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.088461:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984351 is committed 00002000:00010000:0.0:1789760773.089806:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69808128 -> 69812224 00002000:00010000:0.0:1789760773.089814:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136368 -> 136376 00010000:00010000:0.0:1789760773.089829:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089846:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089855:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089862:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.089867:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089875:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089895:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.089904:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d115 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69808128->69812223] (req 69808128->69812223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.090005:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565411200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13250us (13597us total) trans 4294984351 rc 0/0 00000100:00100000:0.0:1789760773.090017:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17054 00000100:00100000:0.0:1789760773.090027:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711323086465 time 711337029403 state 0x2 ref 0 00000100:00100000:2.0:1789760773.098949:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.099021:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411328 00000100:00100000:1.0:1789760773.099030:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411328 00000100:00100000:1.0:1789760773.099080:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711323086465 time 711337029403 state 0x0 ref 1 00000100:00100000:1.0:1789760773.099095:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711337289819 time 711337029403 state 0x1 ref 1 00000100:00100000:1.0:1789760773.099127:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711337289819 time 711359418824 state 0x0 ref 1 00000100:00100000:1.0:1789760773.099139:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565411328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.099183:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69812224, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214b8 00010000:00010000:1.0:1789760773.099192:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.099207:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.099211:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.099217:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.099237:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.108508:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984352 is committed 00002000:00010000:1.0:1789760773.108639:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69812224 -> 69816320 00002000:00010000:1.0:1789760773.108645:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136376 -> 136384 00010000:00010000:1.0:1789760773.108658:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108672:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108681:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108691:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.108697:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108883:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108904:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.108912:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d11c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69812224->69816319] (req 69812224->69816319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.109050:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565411328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9908us (10107us total) trans 4294984352 rc 0/0 00000100:00100000:1.0:1789760773.109062:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17055 00000100:00100000:1.0:1789760773.109073:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711337289819 time 711359418824 state 0x2 ref 0 00000100:00100000:3.0:1789760773.113127:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.113187:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411456 00000100:00100000:0.0:1789760773.113196:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411456 00000100:00100000:0.0:1789760773.113248:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711337289819 time 711359418824 state 0x0 ref 1 00000100:00100000:0.0:1789760773.113263:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711359679240 time 711359418824 state 0x1 ref 1 00000100:00100000:0.0:1789760773.113295:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711359679240 time 711373587633 state 0x0 ref 1 00000100:00100000:0.0:1789760773.113307:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.113354:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69816320, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214c0 00010000:00010000:0.0:1789760773.113363:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.113378:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.113382:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.113390:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.113404:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.118876:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984353 is committed 00002000:00010000:0.0:1789760773.119005:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69816320 -> 69820416 00002000:00010000:0.0:1789760773.119011:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136384 -> 136392 00010000:00010000:0.0:1789760773.119024:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119044:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119054:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119061:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.119066:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119075:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119096:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.119103:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69816320->69820415] (req 69816320->69820415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.119212:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5901us (6100us total) trans 4294984353 rc 0/0 00000100:00100000:0.0:1789760773.119224:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17056 00000100:00100000:0.0:1789760773.119234:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711359679240 time 711373587633 state 0x2 ref 0 00000100:00100000:2.0:1789760773.124795:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.124931:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411584 00000100:00100000:0.0:1789760773.124941:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411584 00000100:00100000:0.0:1789760773.124996:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711359679240 time 711373587633 state 0x0 ref 1 00000100:00100000:0.0:1789760773.125012:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711373848049 time 711373587633 state 0x1 ref 1 00000100:00100000:0.0:1789760773.125035:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711373848049 time 711385327967 state 0x0 ref 1 00000100:00100000:0.0:1789760773.125048:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565411584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.125093:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69820416, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214c8 00010000:00010000:0.0:1789760773.125102:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.125116:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.125121:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.125127:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.125141:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.129992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984354 is committed 00002000:00010000:0.0:1789760773.134844:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69820416 -> 69824512 00002000:00010000:0.0:1789760773.134856:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136392 -> 136400 00010000:00010000:0.0:1789760773.134870:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134884:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134899:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134906:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.134911:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134920:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134941:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.134949:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d12a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69820416->69824511] (req 69820416->69824511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.135055:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565411584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10005us (10264us total) trans 4294984354 rc 0/0 00000100:00100000:0.0:1789760773.135067:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17057 00000100:00100000:0.0:1789760773.135077:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711373848049 time 711385327967 state 0x2 ref 0 00000100:00100000:2.0:1789760773.140887:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.140967:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411712 00000100:00100000:3.0:1789760773.140976:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411712 00000100:00100000:3.0:1789760773.141030:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711373848049 time 711385327967 state 0x0 ref 1 00000100:00100000:3.0:1789760773.141046:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711385588383 time 711385327967 state 0x1 ref 1 00000100:00100000:3.0:1789760773.141078:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711385588383 time 711401370499 state 0x0 ref 1 00000100:00100000:3.0:1789760773.141091:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565411712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.141146:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69824512, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214d0 00010000:00010000:3.0:1789760773.141156:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.141172:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.141176:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.141183:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.141197:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.145312:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984355 is committed 00002000:00010000:2.0:1789760773.153851:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69824512 -> 69828608 00002000:00010000:2.0:1789760773.153860:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136400 -> 136408 00010000:00010000:2.0:1789760773.153873:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153885:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153893:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153901:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.153907:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153916:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153935:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.153944:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d131 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69824512->69828607] (req 69824512->69828607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.154037:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565411712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12944us (13155us total) trans 4294984355 rc 0/0 00000100:00100000:2.0:1789760773.154048:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17058 00000100:00100000:2.0:1789760773.154059:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711385588383 time 711401370499 state 0x2 ref 0 00000100:00100000:3.0:1789760773.157490:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.157912:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411840 00000100:00100000:2.0:1789760773.157923:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411840 00000100:00100000:2.0:1789760773.157980:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711385588383 time 711401370499 state 0x0 ref 1 00000100:00100000:2.0:1789760773.157996:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711401630915 time 711401370499 state 0x1 ref 1 00000100:00100000:2.0:1789760773.158026:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711401630915 time 711418318166 state 0x0 ref 1 00000100:00100000:2.0:1789760773.158038:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.158087:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69828608, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214d8 00010000:00010000:2.0:1789760773.158096:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.158122:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760773.158128:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.158135:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.158150:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.162281:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984356 is committed 00002000:00010000:2.0:1789760773.162556:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69828608 -> 69832704 00002000:00010000:2.0:1789760773.162561:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136408 -> 136416 00010000:00010000:2.0:1789760773.162576:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162595:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162604:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162612:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.162618:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162628:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162652:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.162661:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d138 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69828608->69832703] (req 69828608->69832703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.162836:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4795us (5352us total) trans 4294984356 rc 0/0 00000100:00100000:2.0:1789760773.162848:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17059 00000100:00100000:2.0:1789760773.162859:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711401630915 time 711418318166 state 0x2 ref 0 00000100:00100000:1.0:1789760773.169129:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.169253:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565411968 00000100:00100000:0.0:1789760773.169265:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565411968 00000100:00100000:0.0:1789760773.169326:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711401630915 time 711418318166 state 0x0 ref 1 00000100:00100000:0.0:1789760773.169341:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711418578582 time 711418318166 state 0x1 ref 1 00000100:00100000:0.0:1789760773.169372:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711418578582 time 711429664761 state 0x0 ref 1 00000100:00100000:0.0:1789760773.169384:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.169431:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69832704, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214e0 00010000:00010000:0.0:1789760773.169441:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.169456:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.169460:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.169467:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.169481:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.174032:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984357 is committed 00002000:00010000:0.0:1789760773.174361:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69832704 -> 69836800 00002000:00010000:0.0:1789760773.174367:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136416 -> 136424 00010000:00010000:0.0:1789760773.174380:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174394:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174403:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174418:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.174422:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174431:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174450:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.174457:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d13f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69832704->69836799] (req 69832704->69836799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.174611:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565411968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5223us (5485us total) trans 4294984357 rc 0/0 00000100:00100000:0.0:1789760773.174624:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17060 00000100:00100000:0.0:1789760773.174635:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711418578582 time 711429664761 state 0x2 ref 0 00000100:00100000:1.0:1789760773.192422:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.192743:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412096 00000100:00100000:2.0:1789760773.192754:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412096 00000100:00100000:2.0:1789760773.192926:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711418578582 time 711429664761 state 0x0 ref 1 00000100:00100000:2.0:1789760773.192953:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711429925177 time 711429664761 state 0x1 ref 1 00000100:00100000:2.0:1789760773.192983:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711429925177 time 711453275389 state 0x0 ref 1 00000100:00100000:2.0:1789760773.192996:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565412096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.193047:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69836800, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214e8 00010000:00010000:2.0:1789760773.193055:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.193072:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760773.193077:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.193085:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.193099:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.201037:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984358 is committed 00002000:00010000:2.0:1789760773.201309:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69836800 -> 69840896 00002000:00010000:2.0:1789760773.201315:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136424 -> 136432 00010000:00010000:2.0:1789760773.201329:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201342:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201357:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201364:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.201369:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201377:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201397:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.201405:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d146 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69836800->69840895] (req 69836800->69840895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.201537:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565412096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8539us (9119us total) trans 4294984358 rc 0/0 00000100:00100000:2.0:1789760773.201547:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17061 00000100:00100000:2.0:1789760773.201557:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711429925177 time 711453275389 state 0x2 ref 0 00000100:00100000:2.0:1789760773.207880:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.208034:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412224 00000100:00100000:0.0:1789760773.208044:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412224 00000100:00100000:0.0:1789760773.208096:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711429925177 time 711453275389 state 0x0 ref 1 00000100:00100000:0.0:1789760773.208109:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711453535805 time 711453275389 state 0x1 ref 1 00000100:00100000:0.0:1789760773.208140:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711453535805 time 711468433127 state 0x0 ref 1 00000100:00100000:0.0:1789760773.208151:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.208192:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69840896, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214f0 00010000:00010000:0.0:1789760773.208199:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.208211:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.208215:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.208219:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.208229:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.213563:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984359 is committed 00002000:00010000:0.0:1789760773.213847:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69840896 -> 69844992 00002000:00010000:0.0:1789760773.213853:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136432 -> 136440 00010000:00010000:0.0:1789760773.213866:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213878:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213888:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213895:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.213901:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213909:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213929:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.213937:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d14d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69840896->69844991] (req 69840896->69844991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.214030:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5873us (6153us total) trans 4294984359 rc 0/0 00000100:00100000:0.0:1789760773.214042:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17062 00000100:00100000:0.0:1789760773.214051:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711453535805 time 711468433127 state 0x2 ref 0 00000100:00100000:1.0:1789760773.221985:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.222041:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412352 00000100:00100000:0.0:1789760773.222051:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412352 00000100:00100000:0.0:1789760773.222105:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711453535805 time 711468433127 state 0x0 ref 1 00000100:00100000:0.0:1789760773.222121:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711468693543 time 711468433127 state 0x1 ref 1 00000100:00100000:0.0:1789760773.222149:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711468693543 time 711482440893 state 0x0 ref 1 00000100:00100000:0.0:1789760773.222162:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.222208:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69844992, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x214f8 00010000:00010000:0.0:1789760773.222230:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.222245:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.222250:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.222257:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.222482:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.228093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984360 is committed 00002000:00010000:0.0:1789760773.228531:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69844992 -> 69849088 00002000:00010000:0.0:1789760773.228536:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136440 -> 136448 00010000:00010000:0.0:1789760773.228553:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228565:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228574:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228583:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.228588:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228597:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228619:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.228627:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d154 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69844992->69849087] (req 69844992->69849087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.228781:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6618us (6804us total) trans 4294984360 rc 0/0 00000100:00100000:0.0:1789760773.228792:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17063 00000100:00100000:0.0:1789760773.228810:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711468693543 time 711482440893 state 0x2 ref 0 00000100:00100000:1.0:1789760773.234132:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.234383:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412480 00000100:00100000:2.0:1789760773.234393:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412480 00000100:00100000:2.0:1789760773.234454:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711468693543 time 711482440893 state 0x0 ref 1 00000100:00100000:2.0:1789760773.234473:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711482701309 time 711482440893 state 0x1 ref 1 00000100:00100000:2.0:1789760773.234539:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711482701309 time 711494830505 state 0x0 ref 1 00000100:00100000:2.0:1789760773.234552:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565412480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.234596:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69849088, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21500 00010000:00010000:2.0:1789760773.234606:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.234640:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760773.234645:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.234651:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.234676:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.240318:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984361 is committed 00002000:00010000:2.0:1789760773.240500:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69849088 -> 69853184 00002000:00010000:2.0:1789760773.240505:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136448 -> 136456 00010000:00010000:2.0:1789760773.240520:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240534:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240543:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240551:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.240556:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240565:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240584:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.240592:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d15b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69849088->69853183] (req 69849088->69853183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.240684:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565412480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6129us (6557us total) trans 4294984361 rc 0/0 00000100:00100000:2.0:1789760773.240696:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17064 00000100:00100000:2.0:1789760773.241041:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711482701309 time 711494830505 state 0x2 ref 0 00000100:00100000:2.0:1789760773.244335:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.244508:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412608 00000100:00100000:0.0:1789760773.244517:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412608 00000100:00100000:0.0:1789760773.244563:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711482701309 time 711494830505 state 0x0 ref 1 00000100:00100000:0.0:1789760773.244575:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711495090921 time 711494830505 state 0x1 ref 1 00000100:00100000:0.0:1789760773.244597:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711495090921 time 711504889762 state 0x0 ref 1 00000100:00100000:0.0:1789760773.244610:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565412608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.244656:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69853184, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21508 00010000:00010000:0.0:1789760773.244665:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.244685:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.244690:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.244696:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.244730:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.249961:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984362 is committed 00002000:00010000:0.0:1789760773.260077:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69853184 -> 69857280 00002000:00010000:0.0:1789760773.260089:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136456 -> 136464 00010000:00010000:0.0:1789760773.260105:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260120:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260129:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260136:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.260141:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260150:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260175:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.260183:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d162 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69853184->69857279] (req 69853184->69857279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.260287:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565412608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15665us (15948us total) trans 4294984362 rc 0/0 00000100:00100000:0.0:1789760773.260299:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17065 00000100:00100000:0.0:1789760773.260308:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711495090921 time 711504889762 state 0x2 ref 0 00000100:00100000:1.0:1789760773.265534:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.266643:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412736 00000100:00100000:0.0:1789760773.266655:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412736 00000100:00100000:0.0:1789760773.266732:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711495090921 time 711504889762 state 0x0 ref 1 00000100:00100000:0.0:1789760773.266747:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711505150178 time 711504889762 state 0x1 ref 1 00000100:00100000:0.0:1789760773.266784:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711505150178 time 711527075432 state 0x0 ref 1 00000100:00100000:0.0:1789760773.266798:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.266875:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69857280, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21510 00010000:00010000:0.0:1789760773.266885:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.266901:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.266906:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.266913:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.266926:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.272077:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984363 is committed 00002000:00010000:1.0:1789760773.277669:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69857280 -> 69861376 00002000:00010000:1.0:1789760773.277680:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136464 -> 136472 00010000:00010000:1.0:1789760773.277694:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277736:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277746:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277759:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.277773:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277783:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277805:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.277813:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d169 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69857280->69861375] (req 69857280->69861375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.277912:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11111us (12382us total) trans 4294984363 rc 0/0 00000100:00100000:1.0:1789760773.277924:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17066 00000100:00100000:1.0:1789760773.277932:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711505150178 time 711527075432 state 0x2 ref 0 00000100:00100000:1.0:1789760773.285647:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.285742:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412864 00000100:00100000:2.0:1789760773.285752:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412864 00000100:00100000:2.0:1789760773.285816:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711505150178 time 711527075432 state 0x0 ref 1 00000100:00100000:2.0:1789760773.285830:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711527335848 time 711527075432 state 0x1 ref 1 00000100:00100000:2.0:1789760773.285862:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711527335848 time 711546153995 state 0x0 ref 1 00000100:00100000:2.0:1789760773.285877:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565412864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.285924:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69861376, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21518 00010000:00010000:2.0:1789760773.285934:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.285951:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789760773.285956:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.285962:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.285976:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.292683:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984364 is committed 00002000:00010000:2.0:1789760773.292906:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69861376 -> 69865472 00002000:00010000:2.0:1789760773.292911:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136472 -> 136480 00010000:00010000:2.0:1789760773.292925:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293064:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293074:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293081:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.293087:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293097:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293123:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.293134:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d170 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69861376->69865471] (req 69861376->69865471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.293267:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565412864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7388us (7638us total) trans 4294984364 rc 0/0 00000100:00100000:2.0:1789760773.293278:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17067 00000100:00100000:2.0:1789760773.293287:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711527335848 time 711546153995 state 0x2 ref 0 00000100:00100000:2.0:1789760773.298505:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.298941:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565412992 00000100:00100000:0.0:1789760773.298951:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565412992 00000100:00100000:1.0:1789760773.299086:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711527335848 time 711546153995 state 0x0 ref 1 00000100:00100000:1.0:1789760773.299103:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711546414411 time 711546153995 state 0x1 ref 1 00000100:00100000:1.0:1789760773.299235:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711546414411 time 711559524953 state 0x0 ref 1 00000100:00100000:1.0:1789760773.299251:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.299300:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69865472, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21520 00010000:00010000:1.0:1789760773.299310:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.299326:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.299330:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.299336:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.299350:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.304489:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984365 is committed 00002000:00010000:1.0:1789760773.304615:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69865472 -> 69869568 00002000:00010000:1.0:1789760773.304620:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136480 -> 136488 00010000:00010000:1.0:1789760773.304634:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304648:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304657:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304664:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.304669:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304678:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304698:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.304748:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d177 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69865472->69869567] (req 69865472->69869567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.304850:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565412992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5596us (6351us total) trans 4294984365 rc 0/0 00000100:00100000:1.0:1789760773.304861:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17068 00000100:00100000:1.0:1789760773.304871:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711546414411 time 711559524953 state 0x2 ref 0 00000100:00100000:1.0:1789760773.309336:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.309417:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413120 00000100:00100000:3.0:1789760773.309427:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413120 00000100:00100000:3.0:1789760773.309482:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711546414411 time 711559524953 state 0x0 ref 1 00000100:00100000:3.0:1789760773.309497:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711559785369 time 711559524953 state 0x1 ref 1 00000100:00100000:3.0:1789760773.309526:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711559785369 time 711569818094 state 0x0 ref 1 00000100:00100000:3.0:1789760773.309538:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565413120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.309585:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69869568, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21528 00010000:00010000:3.0:1789760773.309594:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.309608:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.309613:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.309620:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.309633:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.314751:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984366 is committed 00002000:00010000:3.0:1789760773.314891:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69869568 -> 69873664 00002000:00010000:3.0:1789760773.314897:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136488 -> 136496 00010000:00010000:3.0:1789760773.314910:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314928:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314937:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314945:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.314949:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314958:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314977:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.314985:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d17e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69869568->69873663] (req 69869568->69873663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.315081:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565413120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5540us (5749us total) trans 4294984366 rc 0/0 00000100:00100000:3.0:1789760773.315092:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17069 00000100:00100000:3.0:1789760773.315101:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711559785369 time 711569818094 state 0x2 ref 0 00000100:00100000:2.0:1789760773.321253:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.321443:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413248 00000100:00100000:1.0:1789760773.321498:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413248 00000100:00100000:1.0:1789760773.321556:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711559785369 time 711569818094 state 0x0 ref 1 00000100:00100000:1.0:1789760773.321571:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711570078510 time 711569818094 state 0x1 ref 1 00000100:00100000:1.0:1789760773.321639:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711570078510 time 711581930317 state 0x0 ref 1 00000100:00100000:1.0:1789760773.321652:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.321852:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69873664, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21530 00010000:00010000:1.0:1789760773.321864:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.321880:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.321884:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.321890:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.321903:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.323869:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760773.326747:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984367 is committed 00002000:00010000:2.0:1789760773.326876:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69873664 -> 69877760 00002000:00010000:2.0:1789760773.326881:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136496 -> 136504 00010000:00010000:2.0:1789760773.326893:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326907:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326921:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326928:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.326933:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326941:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326960:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.326968:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d185 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69873664->69877759] (req 69873664->69877759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.327063:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5408us (5815us total) trans 4294984367 rc 0/0 00000100:00100000:2.0:1789760773.327074:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17070 00000100:00100000:2.0:1789760773.327084:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711570078510 time 711581930317 state 0x2 ref 0 00000100:00100000:2.0:1789760773.333280:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.333624:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413376 00000100:00100000:1.0:1789760773.333634:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413376 00000100:00100000:1.0:1789760773.333688:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711570078510 time 711581930317 state 0x0 ref 1 00000100:00100000:1.0:1789760773.333798:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711582190733 time 711581930317 state 0x1 ref 1 00000100:00100000:1.0:1789760773.333823:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711582190733 time 711594113920 state 0x0 ref 1 00000100:00100000:1.0:1789760773.333836:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565413376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.333883:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69877760, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21538 00010000:00010000:1.0:1789760773.333893:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.333914:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.333918:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.333924:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.333937:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.339846:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984368 is committed 00002000:00010000:1.0:1789760773.340020:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69877760 -> 69881856 00002000:00010000:1.0:1789760773.340025:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136504 -> 136512 00010000:00010000:1.0:1789760773.340037:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340050:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340059:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340066:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.340071:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340080:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340104:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.340112:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d18c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69877760->69881855] (req 69877760->69881855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.340263:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565413376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6425us (6987us total) trans 4294984368 rc 0/0 00000100:00100000:1.0:1789760773.340274:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17071 00000100:00100000:1.0:1789760773.340646:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711582190733 time 711594113920 state 0x2 ref 0 00000100:00100000:1.0:1789760773.345207:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.345380:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413504 00000100:00100000:3.0:1789760773.345390:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413504 00000100:00100000:3.0:1789760773.345443:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711582190733 time 711594113920 state 0x0 ref 1 00000100:00100000:3.0:1789760773.345458:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711594374336 time 711594113920 state 0x1 ref 1 00000100:00100000:3.0:1789760773.345490:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711594374336 time 711605781451 state 0x0 ref 1 00000100:00100000:3.0:1789760773.345502:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.345546:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69881856, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21540 00010000:00010000:3.0:1789760773.345555:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.345571:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.345576:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.345583:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.345596:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.355558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984369 is committed 00002000:00010000:3.0:1789760773.357915:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69881856 -> 69885952 00002000:00010000:3.0:1789760773.357923:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136512 -> 136520 00010000:00010000:3.0:1789760773.357936:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.357957:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.357972:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.357981:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.357985:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.357994:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.358011:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.358018:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d193 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69881856->69885951] (req 69881856->69885951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.358107:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12602us (12904us total) trans 4294984369 rc 0/0 00000100:00100000:3.0:1789760773.358117:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17072 00000100:00100000:3.0:1789760773.358126:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711594374336 time 711605781451 state 0x2 ref 0 00000100:00100000:2.0:1789760773.366825:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.366948:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413632 00000100:00100000:1.0:1789760773.366957:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413632 00000100:00100000:1.0:1789760773.367007:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711594374336 time 711605781451 state 0x0 ref 1 00000100:00100000:1.0:1789760773.367023:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711606041867 time 711605781451 state 0x1 ref 1 00000100:00100000:1.0:1789760773.367054:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711606041867 time 711627346726 state 0x0 ref 1 00000100:00100000:1.0:1789760773.367066:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.367109:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69885952, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21548 00010000:00010000:1.0:1789760773.367118:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.367243:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.367249:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.367255:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.367269:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.374501:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984370 is committed 00002000:00010000:1.0:1789760773.374690:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69885952 -> 69890048 00002000:00010000:1.0:1789760773.374695:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136520 -> 136528 00010000:00010000:1.0:1789760773.374887:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374901:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374909:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374916:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.374921:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374931:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374957:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.374965:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d19a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69885952->69890047] (req 69885952->69890047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.375092:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8022us (8272us total) trans 4294984370 rc 0/0 00000100:00100000:1.0:1789760773.375102:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17073 00000100:00100000:1.0:1789760773.375122:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711606041867 time 711627346726 state 0x2 ref 0 00000100:00100000:2.0:1789760773.378633:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.378902:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413760 00000100:00100000:1.0:1789760773.378912:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413760 00000100:00100000:1.0:1789760773.378965:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711606041867 time 711627346726 state 0x0 ref 1 00000100:00100000:1.0:1789760773.378980:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711627607142 time 711627346726 state 0x1 ref 1 00000100:00100000:1.0:1789760773.379008:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711627607142 time 711639301043 state 0x0 ref 1 00000100:00100000:1.0:1789760773.379021:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.379067:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69890048, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21550 00010000:00010000:1.0:1789760773.379076:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.379092:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.379097:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.379103:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.379127:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.386823:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984371 is committed 00002000:00010000:3.0:1789760773.388132:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69890048 -> 69894144 00002000:00010000:3.0:1789760773.388140:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136528 -> 136536 00010000:00010000:3.0:1789760773.388151:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388161:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388167:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388172:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.388175:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388182:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388196:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.388201:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d1a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69890048->69894143] (req 69890048->69894143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.388337:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565413760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9313us (9707us total) trans 4294984371 rc 0/0 00000100:00100000:3.0:1789760773.388348:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17074 00000100:00100000:3.0:1789760773.388357:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711627607142 time 711639301043 state 0x2 ref 0 00000100:00100000:2.0:1789760773.396784:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.396917:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565413888 00000100:00100000:3.0:1789760773.396928:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565413888 00000100:00100000:3.0:1789760773.397212:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711627607142 time 711639301043 state 0x0 ref 1 00000100:00100000:3.0:1789760773.397231:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711639561459 time 711639301043 state 0x1 ref 1 00000100:00100000:3.0:1789760773.397265:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711639561459 time 711657557083 state 0x0 ref 1 00000100:00100000:3.0:1789760773.397333:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565413888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.397377:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69894144, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21558 00010000:00010000:3.0:1789760773.397386:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.397402:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.397407:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.397413:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.397427:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.402045:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984372 is committed 00002000:00010000:2.0:1789760773.402408:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69894144 -> 69898240 00002000:00010000:2.0:1789760773.402413:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136536 -> 136544 00010000:00010000:2.0:1789760773.402428:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402441:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402451:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402459:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.402464:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402474:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402495:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.402503:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69894144->69898239] (req 69894144->69898239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.402847:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565413888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5512us (6076us total) trans 4294984372 rc 0/0 00000100:00100000:2.0:1789760773.402859:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17075 00000100:00100000:2.0:1789760773.402869:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711639561459 time 711657557083 state 0x2 ref 0 00000100:00100000:2.0:1789760773.411015:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.411143:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414016 00000100:00100000:1.0:1789760773.411155:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414016 00000100:00100000:1.0:1789760773.411209:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711639561459 time 711657557083 state 0x0 ref 1 00000100:00100000:1.0:1789760773.411225:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711657817499 time 711657557083 state 0x1 ref 1 00000100:00100000:1.0:1789760773.411380:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711657817499 time 711671670627 state 0x0 ref 1 00000100:00100000:1.0:1789760773.411399:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.411456:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69898240, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21560 00010000:00010000:1.0:1789760773.411466:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.411482:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.411486:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.411492:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.411506:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.419674:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984373 is committed 00002000:00010000:1.0:1789760773.419810:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69898240 -> 69902336 00002000:00010000:1.0:1789760773.419816:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136544 -> 136552 00010000:00010000:1.0:1789760773.419837:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419850:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419859:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419866:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.419870:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419878:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419896:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.419904:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69898240->69902335] (req 69898240->69902335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.420013:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8617us (9001us total) trans 4294984373 rc 0/0 00000100:00100000:1.0:1789760773.420024:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17076 00000100:00100000:1.0:1789760773.420034:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711657817499 time 711671670627 state 0x2 ref 0 00000100:00100000:0.0:1789760773.424895:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.424999:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414144 00000100:00100000:3.0:1789760773.425008:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414144 00000100:00100000:3.0:1789760773.425181:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711657817499 time 711671670627 state 0x0 ref 1 00000100:00100000:3.0:1789760773.425197:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711671931043 time 711671670627 state 0x1 ref 1 00000100:00100000:3.0:1789760773.425324:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711671931043 time 711685614817 state 0x0 ref 1 00000100:00100000:3.0:1789760773.425340:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.425397:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69902336, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21568 00010000:00010000:3.0:1789760773.425407:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.425425:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.425429:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.425436:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.425451:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.430599:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984374 is committed 00002000:00010000:3.0:1789760773.430755:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69902336 -> 69906432 00002000:00010000:3.0:1789760773.430761:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136552 -> 136560 00010000:00010000:3.0:1789760773.430783:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430795:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430805:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430812:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.430817:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430825:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430845:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.430852:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69902336->69906431] (req 69902336->69906431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.430941:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5599us (6050us total) trans 4294984374 rc 0/0 00000100:00100000:3.0:1789760773.430952:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17077 00000100:00100000:3.0:1789760773.430963:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711671931043 time 711685614817 state 0x2 ref 0 00000100:00100000:2.0:1789760773.437021:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.437137:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414272 00000100:00100000:1.0:1789760773.437147:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414272 00000100:00100000:1.0:1789760773.437192:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711671931043 time 711685614817 state 0x0 ref 1 00000100:00100000:1.0:1789760773.437202:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711685875233 time 711685614817 state 0x1 ref 1 00000100:00100000:1.0:1789760773.437226:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711685875233 time 711697518220 state 0x0 ref 1 00000100:00100000:1.0:1789760773.437238:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.437288:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69906432, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21570 00010000:00010000:1.0:1789760773.437297:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.437311:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.437315:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.437321:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.437340:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.446254:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984375 is committed 00002000:00010000:2.0:1789760773.446551:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69906432 -> 69910528 00002000:00010000:2.0:1789760773.446556:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136560 -> 136568 00010000:00010000:2.0:1789760773.446569:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446582:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446592:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446600:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.446604:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446614:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446633:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.446641:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d1bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69906432->69910527] (req 69906432->69910527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.446817:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9575us (9800us total) trans 4294984375 rc 0/0 00000100:00100000:2.0:1789760773.446828:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17078 00000100:00100000:2.0:1789760773.446837:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711685875233 time 711697518220 state 0x2 ref 0 00000100:00100000:2.0:1789760773.452115:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.452422:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414400 00000100:00100000:1.0:1789760773.452432:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414400 00000100:00100000:1.0:1789760773.452482:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711685875233 time 711697518220 state 0x0 ref 1 00000100:00100000:1.0:1789760773.452498:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711697778636 time 711697518220 state 0x1 ref 1 00000100:00100000:1.0:1789760773.452534:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711697778636 time 711712825569 state 0x0 ref 1 00000100:00100000:1.0:1789760773.452552:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565414400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.452600:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69910528, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21578 00010000:00010000:1.0:1789760773.452609:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.452626:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.452630:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.452636:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.452650:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.460164:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984376 is committed 00002000:00010000:1.0:1789760773.460512:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69910528 -> 69914624 00002000:00010000:1.0:1789760773.460519:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136568 -> 136576 00010000:00010000:1.0:1789760773.460534:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460549:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460565:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460574:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.460580:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460589:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460609:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.460618:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69910528->69914623] (req 69910528->69914623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.461311:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565414400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8759us (9198us total) trans 4294984376 rc 0/0 00000100:00100000:1.0:1789760773.461334:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17079 00000100:00100000:1.0:1789760773.461344:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711697778636 time 711712825569 state 0x2 ref 0 00000100:00100000:0.0:1789760773.464900:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.465412:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414528 00000100:00100000:3.0:1789760773.465421:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414528 00000100:00100000:3.0:1789760773.465476:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711697778636 time 711712825569 state 0x0 ref 1 00000100:00100000:3.0:1789760773.465491:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711713085985 time 711712825569 state 0x1 ref 1 00000100:00100000:3.0:1789760773.465521:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711713085985 time 711725813861 state 0x0 ref 1 00000100:00100000:3.0:1789760773.465533:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.465579:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69914624, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21580 00010000:00010000:3.0:1789760773.465588:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.465603:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.465607:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.465613:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.465626:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.471758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984377 is committed 00002000:00010000:3.0:1789760773.471916:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69914624 -> 69918720 00002000:00010000:3.0:1789760773.471921:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136576 -> 136584 00010000:00010000:3.0:1789760773.471935:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.471947:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.471956:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.471963:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.471967:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.471975:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.471994:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.472002:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69914624->69918719] (req 69914624->69918719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.472132:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565414528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6595us (7329us total) trans 4294984377 rc 0/0 00000100:00100000:3.0:1789760773.472143:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17080 00000100:00100000:3.0:1789760773.472152:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711713085985 time 711725813861 state 0x2 ref 0 00000100:00100000:2.0:1789760773.477038:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.477122:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414656 00000100:00100000:1.0:1789760773.477133:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414656 00000100:00100000:1.0:1789760773.477196:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711713085985 time 711725813861 state 0x0 ref 1 00000100:00100000:1.0:1789760773.477211:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711726074277 time 711725813861 state 0x1 ref 1 00000100:00100000:1.0:1789760773.477243:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711726074277 time 711737535329 state 0x0 ref 1 00000100:00100000:1.0:1789760773.477255:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565414656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.477305:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69918720, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21588 00010000:00010000:1.0:1789760773.477314:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.477341:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.477345:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.477351:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.477365:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.484498:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984378 is committed 00002000:00010000:0.0:1789760773.484804:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69918720 -> 69922816 00002000:00010000:0.0:1789760773.484810:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136584 -> 136592 00010000:00010000:0.0:1789760773.484823:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484836:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484845:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484851:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.484856:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484871:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484890:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.484897:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d1d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69918720->69922815] (req 69918720->69922815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.485027:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565414656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7768us (7992us total) trans 4294984378 rc 0/0 00000100:00100000:0.0:1789760773.485038:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17081 00000100:00100000:0.0:1789760773.485047:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711726074277 time 711737535329 state 0x2 ref 0 00000100:00100000:2.0:1789760773.491255:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.491410:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414784 00000100:00100000:1.0:1789760773.491420:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414784 00000100:00100000:1.0:1789760773.491476:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711726074277 time 711737535329 state 0x0 ref 1 00000100:00100000:1.0:1789760773.491494:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711737795745 time 711737535329 state 0x1 ref 1 00000100:00100000:1.0:1789760773.491555:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711737795745 time 711751846660 state 0x0 ref 1 00000100:00100000:1.0:1789760773.491569:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565414784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.491619:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69922816, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21590 00010000:00010000:1.0:1789760773.491630:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.491646:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.491651:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.491658:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.491672:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.496920:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984379 is committed 00002000:00010000:1.0:1789760773.497092:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69922816 -> 69926912 00002000:00010000:1.0:1789760773.497098:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136592 -> 136600 00010000:00010000:1.0:1789760773.497398:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497412:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497422:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497430:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.497435:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497444:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497465:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.497473:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69922816->69926911] (req 69922816->69926911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.497569:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565414784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5997us (6319us total) trans 4294984379 rc 0/0 00000100:00100000:1.0:1789760773.497579:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17082 00000100:00100000:1.0:1789760773.497588:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711737795745 time 711751846660 state 0x2 ref 0 00000100:00100000:2.0:1789760773.501614:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.501700:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565414912 00000100:00100000:3.0:1789760773.501912:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565414912 00000100:00100000:3.0:1789760773.501969:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711737795745 time 711751846660 state 0x0 ref 1 00000100:00100000:3.0:1789760773.501985:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711752107076 time 711751846660 state 0x1 ref 1 00000100:00100000:3.0:1789760773.502015:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711752107076 time 711762307677 state 0x0 ref 1 00000100:00100000:3.0:1789760773.502029:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565414912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.502076:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69926912, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21598 00010000:00010000:3.0:1789760773.502085:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.502107:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.502122:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.502129:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.502144:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.507939:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984380 is committed 00002000:00010000:3.0:1789760773.508067:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69926912 -> 69931008 00002000:00010000:3.0:1789760773.508072:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136600 -> 136608 00010000:00010000:3.0:1789760773.508084:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508097:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508106:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508126:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.508130:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508139:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508277:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.508288:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69926912->69931007] (req 69926912->69931007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.508496:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565414912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6464us (6886us total) trans 4294984380 rc 0/0 00000100:00100000:3.0:1789760773.508507:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17083 00000100:00100000:3.0:1789760773.508517:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711752107076 time 711762307677 state 0x2 ref 0 00000100:00100000:2.0:1789760773.516492:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.516577:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415040 00000100:00100000:0.0:1789760773.516585:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415040 00000100:00100000:0.0:1789760773.516637:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711752107076 time 711762307677 state 0x0 ref 1 00000100:00100000:0.0:1789760773.516652:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711762568093 time 711762307677 state 0x1 ref 1 00000100:00100000:0.0:1789760773.516680:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711762568093 time 711776972580 state 0x0 ref 1 00000100:00100000:0.0:1789760773.516693:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.516786:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69931008, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215a0 00010000:00010000:0.0:1789760773.516797:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.516813:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.516817:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.516823:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.516838:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.521154:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984381 is committed 00002000:00010000:0.0:1789760773.521281:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69931008 -> 69935104 00002000:00010000:0.0:1789760773.521287:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136608 -> 136616 00010000:00010000:0.0:1789760773.521300:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521312:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521387:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521396:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.521401:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521409:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521429:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.521436:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69931008->69935103] (req 69931008->69935103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.521528:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4833us (5042us total) trans 4294984381 rc 0/0 00000100:00100000:0.0:1789760773.521539:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17084 00000100:00100000:0.0:1789760773.521549:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711762568093 time 711776972580 state 0x2 ref 0 00000100:00100000:2.0:1789760773.526641:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.528267:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415168 00000100:00100000:1.0:1789760773.528281:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415168 00000100:00100000:1.0:1789760773.528343:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711762568093 time 711776972580 state 0x0 ref 1 00000100:00100000:1.0:1789760773.528359:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711777232996 time 711776972580 state 0x1 ref 1 00000100:00100000:1.0:1789760773.528499:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711777232996 time 711788788565 state 0x0 ref 1 00000100:00100000:1.0:1789760773.528513:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.528560:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69935104, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215a8 00010000:00010000:1.0:1789760773.528571:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.528587:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.528592:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.528598:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.528612:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.534015:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984382 is committed 00002000:00010000:1.0:1789760773.538819:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69935104 -> 69939200 00002000:00010000:1.0:1789760773.538830:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136616 -> 136624 00010000:00010000:1.0:1789760773.538844:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538857:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538865:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538873:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.538878:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538887:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538906:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.538919:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d1ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69935104->69939199] (req 69935104->69939199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.539106:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10590us (12469us total) trans 4294984382 rc 0/0 00000100:00100000:1.0:1789760773.539117:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17085 00000100:00100000:1.0:1789760773.539126:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711777232996 time 711788788565 state 0x2 ref 0 00000100:00100000:2.0:1789760773.542982:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.543048:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415296 00000100:00100000:3.0:1789760773.543063:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415296 00000100:00100000:3.0:1789760773.543133:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711777232996 time 711788788565 state 0x0 ref 1 00000100:00100000:3.0:1789760773.543149:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711789048981 time 711788788565 state 0x1 ref 1 00000100:00100000:3.0:1789760773.543185:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711789048981 time 711803477561 state 0x0 ref 1 00000100:00100000:3.0:1789760773.543199:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565415296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.543350:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69939200, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215b0 00010000:00010000:3.0:1789760773.543359:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.543380:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.543385:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.543391:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.543404:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.548255:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984383 is committed 00002000:00010000:1.0:1789760773.548752:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69939200 -> 69943296 00002000:00010000:1.0:1789760773.548758:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136624 -> 136632 00010000:00010000:1.0:1789760773.548778:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548791:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548862:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548872:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.548878:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548887:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548912:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.548921:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674d1f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69939200->69943295] (req 69939200->69943295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.549019:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565415296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5818us (6041us total) trans 4294984383 rc 0/0 00000100:00100000:1.0:1789760773.549030:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17086 00000100:00100000:1.0:1789760773.549040:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711789048981 time 711803477561 state 0x2 ref 0 00000100:00100000:2.0:1789760773.556451:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.560128:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415424 00000100:00100000:0.0:1789760773.560145:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415424 00000100:00100000:0.0:1789760773.560213:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711789048981 time 711803477561 state 0x0 ref 1 00000100:00100000:0.0:1789760773.560229:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711803737977 time 711803477561 state 0x1 ref 1 00000100:00100000:0.0:1789760773.560264:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711803737977 time 711820555521 state 0x0 ref 1 00000100:00100000:0.0:1789760773.560277:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.560325:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69943296, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215b8 00010000:00010000:0.0:1789760773.560334:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.560349:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.560354:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.560361:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.560376:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760773.567344:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984384 is committed 00002000:00010000:0.0:1789760773.571230:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69943296 -> 69947392 00002000:00010000:0.0:1789760773.571240:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136632 -> 136640 00010000:00010000:0.0:1789760773.571254:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571267:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571277:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571284:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.571289:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571297:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571317:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.571330:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d1fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69943296->69947391] (req 69943296->69947391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.571474:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11193us (15025us total) trans 4294984384 rc 0/0 00000100:00100000:0.0:1789760773.571486:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17087 00000100:00100000:0.0:1789760773.571495:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711803737977 time 711820555521 state 0x2 ref 0 00000100:00100000:2.0:1789760773.580577:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.580841:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415552 00000100:00100000:1.0:1789760773.580852:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415552 00000100:00100000:1.0:1789760773.580913:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711803737977 time 711820555521 state 0x0 ref 1 00000100:00100000:1.0:1789760773.580933:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711820815937 time 711820555521 state 0x1 ref 1 00000100:00100000:1.0:1789760773.580998:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711820815937 time 711841289298 state 0x0 ref 1 00000100:00100000:1.0:1789760773.581011:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.581059:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69947392, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215c0 00010000:00010000:1.0:1789760773.581069:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.581090:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.581100:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.581106:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.581120:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.589641:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984385 is committed 00002000:00010000:1.0:1789760773.589902:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69947392 -> 69951488 00002000:00010000:1.0:1789760773.589907:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136640 -> 136648 00010000:00010000:1.0:1789760773.589920:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589932:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589942:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589949:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.589954:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589962:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589985:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.589992:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d203 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69947392->69951487] (req 69947392->69951487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.590140:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9127us (9567us total) trans 4294984385 rc 0/0 00000100:00100000:1.0:1789760773.590151:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17088 00000100:00100000:1.0:1789760773.590162:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711820815937 time 711841289298 state 0x2 ref 0 00000100:00100000:2.0:1789760773.600451:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.605220:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415680 00000100:00100000:1.0:1789760773.605237:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415680 00000100:00100000:1.0:1789760773.605303:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711820815937 time 711841289298 state 0x0 ref 1 00000100:00100000:1.0:1789760773.605320:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711841549714 time 711841289298 state 0x1 ref 1 00000100:00100000:1.0:1789760773.605418:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711841549714 time 711865708820 state 0x0 ref 1 00000100:00100000:1.0:1789760773.605433:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.605481:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69951488, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215c8 00010000:00010000:1.0:1789760773.605491:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.605507:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.605512:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.605518:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.605531:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.611781:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984386 is committed 00002000:00010000:0.0:1789760773.611897:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69951488 -> 69955584 00002000:00010000:0.0:1789760773.611902:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136648 -> 136656 00010000:00010000:0.0:1789760773.611915:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611926:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611936:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611944:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.611949:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611958:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611981:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.611990:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d20a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69951488->69955583] (req 69951488->69955583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.612123:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565415680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6689us (11676us total) trans 4294984386 rc 0/0 00000100:00100000:0.0:1789760773.612134:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17089 00000100:00100000:0.0:1789760773.612143:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711841549714 time 711865708820 state 0x2 ref 0 00000100:00100000:2.0:1789760773.620066:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.620186:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415808 00000100:00100000:0.0:1789760773.620196:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415808 00000100:00100000:0.0:1789760773.620253:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711841549714 time 711865708820 state 0x0 ref 1 00000100:00100000:0.0:1789760773.620268:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711865969236 time 711865708820 state 0x1 ref 1 00000100:00100000:0.0:1789760773.620301:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711865969236 time 711880592953 state 0x0 ref 1 00000100:00100000:0.0:1789760773.620315:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565415808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.620364:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69955584, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215d0 00010000:00010000:0.0:1789760773.620373:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.620389:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.620393:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.620399:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.620412:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.628237:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984387 is committed 00002000:00010000:0.0:1789760773.628585:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69955584 -> 69959680 00002000:00010000:0.0:1789760773.628590:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136656 -> 136664 00010000:00010000:0.0:1789760773.628605:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.628619:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.628630:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.628638:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.628643:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.628652:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.629491:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.629507:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d211 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69955584->69959679] (req 69955584->69959679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.629603:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565415808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9286us (9615us total) trans 4294984387 rc 0/0 00000100:00100000:0.0:1789760773.629614:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17090 00000100:00100000:0.0:1789760773.629625:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711865969236 time 711880592953 state 0x2 ref 0 00000100:00100000:2.0:1789760773.634523:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.634607:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565415936 00000100:00100000:1.0:1789760773.634616:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565415936 00000100:00100000:1.0:1789760773.634684:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711865969236 time 711880592953 state 0x0 ref 1 00000100:00100000:1.0:1789760773.634701:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711880853369 time 711880592953 state 0x1 ref 1 00000100:00100000:1.0:1789760773.634758:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711880853369 time 711895050475 state 0x0 ref 1 00000100:00100000:1.0:1789760773.634784:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.634843:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69959680, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215d8 00010000:00010000:1.0:1789760773.634853:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.634869:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.634874:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.634880:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.634895:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.639077:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984388 is committed 00002000:00010000:1.0:1789760773.639904:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69959680 -> 69963776 00002000:00010000:1.0:1789760773.639911:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136664 -> 136672 00010000:00010000:1.0:1789760773.639924:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640219:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640232:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640240:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.640245:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640255:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640275:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.640283:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d218 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69959680->69963775] (req 69959680->69963775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.640382:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565415936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5595us (5864us total) trans 4294984388 rc 0/0 00000100:00100000:1.0:1789760773.640392:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17091 00000100:00100000:1.0:1789760773.640402:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711880853369 time 711895050475 state 0x2 ref 0 00000100:00100000:2.0:1789760773.644309:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.644401:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416064 00000100:00100000:0.0:1789760773.644410:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416064 00000100:00100000:0.0:1789760773.644464:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711880853369 time 711895050475 state 0x0 ref 1 00000100:00100000:0.0:1789760773.644480:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711895310891 time 711895050475 state 0x1 ref 1 00000100:00100000:0.0:1789760773.644509:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711895310891 time 711904801173 state 0x0 ref 1 00000100:00100000:0.0:1789760773.644521:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.644566:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69963776, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215e0 00010000:00010000:0.0:1789760773.644575:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.644592:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.644597:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.644603:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.644623:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.648619:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984389 is committed 00002000:00010000:0.0:1789760773.648724:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69963776 -> 69967872 00002000:00010000:0.0:1789760773.648729:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136672 -> 136680 00010000:00010000:0.0:1789760773.648743:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648756:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648779:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648787:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.648791:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648801:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648821:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.648830:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d21f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69963776->69967871] (req 69963776->69967871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.648916:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4393us (4612us total) trans 4294984389 rc 0/0 00000100:00100000:0.0:1789760773.648926:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17092 00000100:00100000:0.0:1789760773.648944:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711895310891 time 711904801173 state 0x2 ref 0 00000100:00100000:2.0:1789760773.657001:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.657453:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416192 00000100:00100000:0.0:1789760773.657464:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416192 00000100:00100000:0.0:1789760773.657523:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711895310891 time 711904801173 state 0x0 ref 1 00000100:00100000:0.0:1789760773.657538:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711905061589 time 711904801173 state 0x1 ref 1 00000100:00100000:0.0:1789760773.657609:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711905061589 time 711917900332 state 0x0 ref 1 00000100:00100000:0.0:1789760773.657622:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.657673:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69967872, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215e8 00010000:00010000:0.0:1789760773.657684:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.657747:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.657752:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.657760:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.657785:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.662228:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984390 is committed 00002000:00010000:0.0:1789760773.662399:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69967872 -> 69971968 00002000:00010000:0.0:1789760773.662403:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136680 -> 136688 00010000:00010000:0.0:1789760773.662416:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662427:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662436:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662444:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.662449:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662458:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662476:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.662484:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d226 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69967872->69971967] (req 69967872->69971967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.662606:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4982us (5612us total) trans 4294984390 rc 0/0 00000100:00100000:0.0:1789760773.662616:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17093 00000100:00100000:0.0:1789760773.662625:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711905061589 time 711917900332 state 0x2 ref 0 00000100:00100000:2.0:1789760773.666262:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.666429:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416320 00000100:00100000:1.0:1789760773.666676:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416320 00000100:00100000:1.0:1789760773.666857:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711905061589 time 711917900332 state 0x0 ref 1 00000100:00100000:1.0:1789760773.666871:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711918160748 time 711917900332 state 0x1 ref 1 00000100:00100000:1.0:1789760773.667056:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711918160748 time 711927346528 state 0x0 ref 1 00000100:00100000:1.0:1789760773.667070:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.667117:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69971968, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215f0 00010000:00010000:1.0:1789760773.667127:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.667142:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.667146:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.667152:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.667165:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.672223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984391 is committed 00002000:00010000:1.0:1789760773.672381:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69971968 -> 69976064 00002000:00010000:1.0:1789760773.672386:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136688 -> 136696 00010000:00010000:1.0:1789760773.672398:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672410:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672420:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672427:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.672432:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672440:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672458:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.672466:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d22d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69971968->69976063] (req 69971968->69976063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.672578:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5506us (6320us total) trans 4294984391 rc 0/0 00000100:00100000:1.0:1789760773.672588:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17094 00000100:00100000:1.0:1789760773.672598:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711918160748 time 711927346528 state 0x2 ref 0 00000100:00100000:2.0:1789760773.679331:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.679478:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416448 00000100:00100000:0.0:1789760773.679488:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416448 00000100:00100000:0.0:1789760773.679545:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711918160748 time 711927346528 state 0x0 ref 1 00000100:00100000:0.0:1789760773.679560:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711927606944 time 711927346528 state 0x1 ref 1 00000100:00100000:0.0:1789760773.679590:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711927606944 time 711939882186 state 0x0 ref 1 00000100:00100000:0.0:1789760773.679603:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.679661:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69976064, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x215f8 00010000:00010000:0.0:1789760773.679670:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.679685:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.679689:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.679696:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.680110:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.688298:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984392 is committed 00002000:00010000:3.0:1789760773.688548:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69976064 -> 69980160 00002000:00010000:3.0:1789760773.688554:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136696 -> 136704 00010000:00010000:3.0:1789760773.688566:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.688579:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.688588:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.688595:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.689174:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.689196:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.689216:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.689224:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d234 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69976064->69980159] (req 69976064->69980159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.689378:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9771us (10061us total) trans 4294984392 rc 0/0 00000100:00100000:3.0:1789760773.689389:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17095 00000100:00100000:3.0:1789760773.689398:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711927606944 time 711939882186 state 0x2 ref 0 00000100:00100000:2.0:1789760773.696817:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.697560:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416576 00000100:00100000:0.0:1789760773.697573:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416576 00000100:00100000:0.0:1789760773.697631:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711927606944 time 711939882186 state 0x0 ref 1 00000100:00100000:0.0:1789760773.697648:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711940142602 time 711939882186 state 0x1 ref 1 00000100:00100000:0.0:1789760773.697680:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711940142602 time 711957971939 state 0x0 ref 1 00000100:00100000:0.0:1789760773.697693:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565416576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.698062:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69980160, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21600 00010000:00010000:0.0:1789760773.698074:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.698097:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.698101:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.698218:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.698234:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.704610:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984393 is committed 00002000:00010000:0.0:1789760773.704844:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69980160 -> 69984256 00002000:00010000:0.0:1789760773.704850:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136704 -> 136712 00010000:00010000:0.0:1789760773.704866:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.704878:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.704895:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.704903:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.704910:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.704919:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.705006:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.705019:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d23b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69980160->69984255] (req 69980160->69984255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.705338:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565416576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7571us (8454us total) trans 4294984393 rc 0/0 00000100:00100000:0.0:1789760773.705353:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17096 00000100:00100000:0.0:1789760773.705362:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711940142602 time 711957971939 state 0x2 ref 0 00000100:00100000:2.0:1789760773.712854:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.713387:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416704 00000100:00100000:1.0:1789760773.713398:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416704 00000100:00100000:1.0:1789760773.713452:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711940142602 time 711957971939 state 0x0 ref 1 00000100:00100000:1.0:1789760773.713468:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711958232355 time 711957971939 state 0x1 ref 1 00000100:00100000:1.0:1789760773.713928:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711958232355 time 711974217853 state 0x0 ref 1 00000100:00100000:1.0:1789760773.713944:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.713990:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69984256, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21608 00010000:00010000:1.0:1789760773.713999:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.714015:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789760773.714019:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.714026:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.714041:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.717918:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984394 is committed 00002000:00010000:1.0:1789760773.718202:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69984256 -> 69988352 00002000:00010000:1.0:1789760773.718207:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136712 -> 136720 00010000:00010000:1.0:1789760773.718220:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718239:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718249:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718257:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.718326:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718336:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718356:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.718364:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d242 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69984256->69988351] (req 69984256->69988351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.718458:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4512us (5608us total) trans 4294984394 rc 0/0 00000100:00100000:1.0:1789760773.718469:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17097 00000100:00100000:1.0:1789760773.718909:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711958232355 time 711974217853 state 0x2 ref 0 00000100:00100000:2.0:1789760773.723464:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.723609:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416832 00000100:00100000:3.0:1789760773.723619:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416832 00000100:00100000:3.0:1789760773.723673:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711958232355 time 711974217853 state 0x0 ref 1 00000100:00100000:3.0:1789760773.723689:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711974478269 time 711974217853 state 0x1 ref 1 00000100:00100000:3.0:1789760773.723852:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711974478269 time 711984142512 state 0x0 ref 1 00000100:00100000:3.0:1789760773.723867:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.723917:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69988352, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21610 00010000:00010000:3.0:1789760773.723927:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.723942:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789760773.723946:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.723953:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.723967:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.729121:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984395 is committed 00002000:00010000:3.0:1789760773.729361:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69988352 -> 69992448 00002000:00010000:3.0:1789760773.729366:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136720 -> 136728 00010000:00010000:3.0:1789760773.729380:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729392:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729400:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729407:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.729412:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729426:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729445:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.729452:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d249 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69988352->69992447] (req 69988352->69992447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.729657:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565416832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5788us (6196us total) trans 4294984395 rc 0/0 00000100:00100000:3.0:1789760773.729667:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17098 00000100:00100000:3.0:1789760773.730832:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711974478269 time 711984142512 state 0x2 ref 0 00000100:00100000:2.0:1789760773.734408:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.734940:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565416960 00000100:00100000:0.0:1789760773.734950:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565416960 00000100:00100000:0.0:1789760773.735010:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711974478269 time 711984142512 state 0x0 ref 1 00000100:00100000:0.0:1789760773.735030:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711984402928 time 711984142512 state 0x1 ref 1 00000100:00100000:0.0:1789760773.735097:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711984402928 time 711995388261 state 0x0 ref 1 00000100:00100000:0.0:1789760773.735119:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.735167:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69992448, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21618 00010000:00010000:0.0:1789760773.735178:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.735194:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789760773.735198:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.735205:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.735220:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.742265:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984396 is committed 00002000:00010000:2.0:1789760773.742756:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69992448 -> 69996544 00002000:00010000:2.0:1789760773.742771:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136728 -> 136736 00010000:00010000:2.0:1789760773.742784:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742798:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742807:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742814:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.742818:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742827:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742846:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.742858:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674d250 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69992448->69996543] (req 69992448->69996543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.742940:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565416960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7828us (8540us total) trans 4294984396 rc 0/0 00000100:00100000:2.0:1789760773.742949:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17099 00000100:00100000:2.0:1789760773.742957:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711984402928 time 711995388261 state 0x2 ref 0 00000100:00100000:2.0:1789760773.750456:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.750556:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417088 00000100:00100000:1.0:1789760773.750566:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417088 00000100:00100000:1.0:1789760773.750619:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711984402928 time 711995388261 state 0x0 ref 1 00000100:00100000:1.0:1789760773.750635:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711995648677 time 711995388261 state 0x1 ref 1 00000100:00100000:1.0:1789760773.750665:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711995648677 time 712010956976 state 0x0 ref 1 00000100:00100000:1.0:1789760773.750679:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565417088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.750829:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69996544, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21620 00010000:00010000:1.0:1789760773.750839:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.750855:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.750859:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.750866:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.750880:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.755690:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984397 is committed 00002000:00010000:1.0:1789760773.755855:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69996544 -> 70000640 00002000:00010000:1.0:1789760773.755861:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136736 -> 136744 00010000:00010000:1.0:1789760773.755874:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755886:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755901:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755909:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.755914:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755923:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755943:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.755951:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d257 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69996544->70000639] (req 69996544->70000639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.756049:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565417088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5368us (5599us total) trans 4294984397 rc 0/0 00000100:00100000:1.0:1789760773.756060:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17100 00000100:00100000:1.0:1789760773.756069:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711995648677 time 712010956976 state 0x2 ref 0 00000100:00100000:0.0:1789760773.765060:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.765198:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417216 00000100:00100000:3.0:1789760773.765209:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417216 00000100:00100000:3.0:1789760773.765307:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 711995648677 time 712010956976 state 0x0 ref 1 00000100:00100000:3.0:1789760773.765323:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712011217392 time 712010956976 state 0x1 ref 1 00000100:00100000:3.0:1789760773.765355:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712011217392 time 712025646349 state 0x0 ref 1 00000100:00100000:3.0:1789760773.765367:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.765417:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70000640, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21628 00010000:00010000:3.0:1789760773.765426:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.765444:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760773.765448:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.765454:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.765468:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.772582:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984398 is committed 00002000:00010000:3.0:1789760773.773414:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70000640 -> 70004736 00002000:00010000:3.0:1789760773.773420:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136744 -> 136752 00010000:00010000:3.0:1789760773.773434:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773447:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773456:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773463:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.773468:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773476:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773501:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.773509:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d25e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70000640->70004735] (req 70000640->70004735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.773657:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8286us (8602us total) trans 4294984398 rc 0/0 00000100:00100000:3.0:1789760773.773667:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17101 00000100:00100000:3.0:1789760773.773677:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712011217392 time 712025646349 state 0x2 ref 0 00000100:00100000:2.0:1789760773.780626:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.780890:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417344 00000100:00100000:0.0:1789760773.780900:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417344 00000100:00100000:0.0:1789760773.780955:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712011217392 time 712025646349 state 0x0 ref 1 00000100:00100000:0.0:1789760773.780971:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712025906765 time 712025646349 state 0x1 ref 1 00000100:00100000:0.0:1789760773.781000:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712025906765 time 712041292093 state 0x0 ref 1 00000100:00100000:0.0:1789760773.781013:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.781060:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70004736, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21630 00010000:00010000:0.0:1789760773.781070:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.781256:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760773.781260:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.781268:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.781281:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.787019:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984399 is committed 00002000:00010000:1.0:1789760773.787428:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70004736 -> 70008832 00002000:00010000:1.0:1789760773.787434:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136752 -> 136760 00010000:00010000:1.0:1789760773.787449:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787469:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787478:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787486:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.787490:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787499:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787519:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.787528:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70004736->70008831] (req 70004736->70008831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.787656:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6640us (7034us total) trans 4294984399 rc 0/0 00000100:00100000:1.0:1789760773.787667:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17102 00000100:00100000:1.0:1789760773.787676:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712025906765 time 712041292093 state 0x2 ref 0 00000100:00100000:2.0:1789760773.795789:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.795934:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417472 00000100:00100000:3.0:1789760773.795942:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417472 00000100:00100000:3.0:1789760773.795992:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712025906765 time 712041292093 state 0x0 ref 1 00000100:00100000:3.0:1789760773.796007:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712041552509 time 712041292093 state 0x1 ref 1 00000100:00100000:3.0:1789760773.796077:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712041552509 time 712056368152 state 0x0 ref 1 00000100:00100000:3.0:1789760773.796098:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.796245:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70008832, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21638 00010000:00010000:3.0:1789760773.796255:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.796271:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760773.796275:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.796282:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.796295:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.800347:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984400 is committed 00002000:00010000:3.0:1789760773.800464:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70008832 -> 70012928 00002000:00010000:3.0:1789760773.800469:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136760 -> 136768 00010000:00010000:3.0:1789760773.800481:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800494:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800503:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800509:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.800513:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800521:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800539:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.800551:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d26c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70008832->70012927] (req 70008832->70012927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.800642:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4541us (4857us total) trans 4294984400 rc 0/0 00000100:00100000:3.0:1789760773.800654:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17103 00000100:00100000:3.0:1789760773.800664:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712041552509 time 712056368152 state 0x2 ref 0 00000100:00100000:1.0:1789760773.804335:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.804431:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417600 00000100:00100000:3.0:1789760773.804441:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417600 00000100:00100000:3.0:1789760773.804495:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712041552509 time 712056368152 state 0x0 ref 1 00000100:00100000:3.0:1789760773.804509:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712056628568 time 712056368152 state 0x1 ref 1 00000100:00100000:3.0:1789760773.804579:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712056628568 time 712064870871 state 0x0 ref 1 00000100:00100000:3.0:1789760773.804593:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.804641:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70012928, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21640 00010000:00010000:3.0:1789760773.804651:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.804667:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760773.804672:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.804678:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.804696:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.809297:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984401 is committed 00002000:00010000:0.0:1789760773.809503:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70012928 -> 70017024 00002000:00010000:0.0:1789760773.809509:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136768 -> 136776 00010000:00010000:0.0:1789760773.809523:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809537:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809546:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809561:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.809566:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809575:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809594:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.809602:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674d273 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70012928->70017023] (req 70012928->70017023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.810631:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6033us (6298us total) trans 4294984401 rc 0/0 00000100:00100000:0.0:1789760773.810642:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17104 00000100:00100000:0.0:1789760773.810652:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712056628568 time 712064870871 state 0x2 ref 0 00000100:00100000:2.0:1789760773.814005:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.814800:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417728 00000100:00100000:1.0:1789760773.814810:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417728 00000100:00100000:1.0:1789760773.814860:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712056628568 time 712064870871 state 0x0 ref 1 00000100:00100000:1.0:1789760773.814883:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712065131287 time 712064870871 state 0x1 ref 1 00000100:00100000:1.0:1789760773.814907:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712065131287 time 712075199143 state 0x0 ref 1 00000100:00100000:1.0:1789760773.814919:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.814963:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70017024, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21648 00010000:00010000:1.0:1789760773.814972:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.814987:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.814991:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.814997:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.815009:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.820348:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984402 is committed 00002000:00010000:1.0:1789760773.820605:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70017024 -> 70021120 00002000:00010000:1.0:1789760773.820610:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136776 -> 136784 00010000:00010000:1.0:1789760773.820622:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820635:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820645:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820652:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.820657:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820666:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820685:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.820693:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d27a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70017024->70021119] (req 70017024->70021119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.821017:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565417728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6096us (7016us total) trans 4294984402 rc 0/0 00000100:00100000:1.0:1789760773.821036:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17105 00000100:00100000:1.0:1789760773.821046:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712065131287 time 712075199143 state 0x2 ref 0 00000100:00100000:2.0:1789760773.826138:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.826341:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417856 00000100:00100000:3.0:1789760773.826350:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417856 00000100:00100000:3.0:1789760773.826402:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712065131287 time 712075199143 state 0x0 ref 1 00000100:00100000:3.0:1789760773.826416:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712075459559 time 712075199143 state 0x1 ref 1 00000100:00100000:3.0:1789760773.826494:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712075459559 time 712086772795 state 0x0 ref 1 00000100:00100000:3.0:1789760773.826509:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565417856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.826557:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70021120, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21650 00010000:00010000:3.0:1789760773.826566:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.826582:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760773.826587:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.826593:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.826607:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.831598:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984403 is committed 00002000:00010000:0.0:1789760773.831833:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70021120 -> 70025216 00002000:00010000:0.0:1789760773.831838:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136784 -> 136792 00010000:00010000:0.0:1789760773.831850:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.831867:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.831882:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.831890:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.831895:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.831904:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.832158:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.832169:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674d281 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70021120->70025215] (req 70021120->70025215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.832322:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565417856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5811us (6186us total) trans 4294984403 rc 0/0 00000100:00100000:0.0:1789760773.832332:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17106 00000100:00100000:0.0:1789760773.832341:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712075459559 time 712086772795 state 0x2 ref 0 00000100:00100000:2.0:1789760773.838813:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.839344:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565417984 00000100:00100000:1.0:1789760773.839354:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565417984 00000100:00100000:1.0:1789760773.839469:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712075459559 time 712086772795 state 0x0 ref 1 00000100:00100000:1.0:1789760773.839595:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712087033211 time 712086772795 state 0x1 ref 1 00000100:00100000:1.0:1789760773.840036:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712087033211 time 712100325678 state 0x0 ref 1 00000100:00100000:1.0:1789760773.840051:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.840096:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70025216, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21658 00010000:00010000:1.0:1789760773.840103:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.840123:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.840127:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.840133:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.840148:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.844436:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984404 is committed 00002000:00010000:1.0:1789760773.844622:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70025216 -> 70029312 00002000:00010000:1.0:1789760773.844628:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136792 -> 136800 00010000:00010000:1.0:1789760773.844641:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844653:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844661:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844674:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.844679:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844688:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844808:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.844818:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d288 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70025216->70029311] (req 70025216->70029311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.845746:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565417984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5651us (6894us total) trans 4294984404 rc 0/0 00000100:00100000:1.0:1789760773.845758:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17107 00000100:00100000:1.0:1789760773.845777:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712087033211 time 712100325678 state 0x2 ref 0 00000100:00100000:2.0:1789760773.849996:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.851387:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418112 00000100:00100000:1.0:1789760773.851400:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418112 00000100:00100000:1.0:1789760773.851457:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712087033211 time 712100325678 state 0x0 ref 1 00000100:00100000:1.0:1789760773.851473:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712100586094 time 712100325678 state 0x1 ref 1 00000100:00100000:1.0:1789760773.851603:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712100586094 time 712111893928 state 0x0 ref 1 00000100:00100000:1.0:1789760773.851621:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565418112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.851665:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70029312, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21660 00010000:00010000:1.0:1789760773.851674:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.851689:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.851694:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.851700:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.851734:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.858262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984405 is committed 00002000:00010000:1.0:1789760773.858463:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70029312 -> 70033408 00002000:00010000:1.0:1789760773.858468:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136800 -> 136808 00010000:00010000:1.0:1789760773.858482:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858506:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858515:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858522:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.858528:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858538:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858559:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.858566:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d28f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70029312->70033407] (req 70029312->70033407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.858662:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565418112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7040us (8672us total) trans 4294984405 rc 0/0 00000100:00100000:1.0:1789760773.858672:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17108 00000100:00100000:1.0:1789760773.858681:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712100586094 time 712111893928 state 0x2 ref 0 00000100:00100000:2.0:1789760773.865164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.865253:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418240 00000100:00100000:0.0:1789760773.865262:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418240 00000100:00100000:0.0:1789760773.865317:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712100586094 time 712111893928 state 0x0 ref 1 00000100:00100000:0.0:1789760773.865333:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712112154344 time 712111893928 state 0x1 ref 1 00000100:00100000:0.0:1789760773.865364:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712112154344 time 712125655745 state 0x0 ref 1 00000100:00100000:0.0:1789760773.865376:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.865418:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70033408, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21668 00010000:00010000:0.0:1789760773.865427:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.865442:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760773.865446:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.865451:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.865464:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.874630:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984406 is committed 00002000:00010000:0.0:1789760773.875651:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70033408 -> 70037504 00002000:00010000:0.0:1789760773.875661:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136808 -> 136816 00010000:00010000:0.0:1789760773.875675:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875689:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875748:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875771:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.875777:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875786:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875807:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.875814:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d296 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70033408->70037503] (req 70033408->70037503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.875970:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10590us (10809us total) trans 4294984406 rc 0/0 00000100:00100000:0.0:1789760773.875982:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17109 00000100:00100000:0.0:1789760773.875991:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712112154344 time 712125655745 state 0x2 ref 0 00000100:00100000:2.0:1789760773.884416:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.884476:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418368 00000100:00100000:1.0:1789760773.884486:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418368 00000100:00100000:1.0:1789760773.884541:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712112154344 time 712125655745 state 0x0 ref 1 00000100:00100000:1.0:1789760773.884557:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712125916161 time 712125655745 state 0x1 ref 1 00000100:00100000:1.0:1789760773.884588:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712125916161 time 712144880468 state 0x0 ref 1 00000100:00100000:1.0:1789760773.884601:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.884648:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70037504, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21670 00010000:00010000:1.0:1789760773.884658:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.884674:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.884679:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.884686:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.884701:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.891423:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984407 is committed 00002000:00010000:1.0:1789760773.893827:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70037504 -> 70041600 00002000:00010000:1.0:1789760773.893837:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136816 -> 136824 00010000:00010000:1.0:1789760773.893852:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893866:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893875:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893883:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.893888:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893898:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893920:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.893928:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d29d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70037504->70041599] (req 70037504->70041599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.894038:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9433us (9624us total) trans 4294984407 rc 0/0 00000100:00100000:1.0:1789760773.894049:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17110 00000100:00100000:1.0:1789760773.894059:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712125916161 time 712144880468 state 0x2 ref 0 00000100:00100000:2.0:1789760773.897796:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.897883:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418496 00000100:00100000:1.0:1789760773.897893:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418496 00000100:00100000:1.0:1789760773.897959:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712125916161 time 712144880468 state 0x0 ref 1 00000100:00100000:1.0:1789760773.897977:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712145140884 time 712144880468 state 0x1 ref 1 00000100:00100000:1.0:1789760773.898007:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712145140884 time 712158299575 state 0x0 ref 1 00000100:00100000:1.0:1789760773.898019:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.898074:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70041600, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21678 00010000:00010000:1.0:1789760773.898084:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.898100:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.898105:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.898117:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.898133:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.904874:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984408 is committed 00002000:00010000:1.0:1789760773.905005:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70041600 -> 70045696 00002000:00010000:1.0:1789760773.905010:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136824 -> 136832 00010000:00010000:1.0:1789760773.905024:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905039:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905048:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905057:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.905062:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905072:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905092:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.905115:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d2a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70041600->70045695] (req 70041600->70045695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.905219:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7188us (7420us total) trans 4294984408 rc 0/0 00000100:00100000:1.0:1789760773.905229:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17111 00000100:00100000:1.0:1789760773.905240:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712145140884 time 712158299575 state 0x2 ref 0 00000100:00100000:2.0:1789760773.909407:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.909507:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418624 00000100:00100000:0.0:1789760773.909518:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418624 00000100:00100000:0.0:1789760773.909579:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712145140884 time 712158299575 state 0x0 ref 1 00000100:00100000:0.0:1789760773.909595:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712158559991 time 712158299575 state 0x1 ref 1 00000100:00100000:2.0:1789760773.909855:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712158559991 time 712170144157 state 0x0 ref 1 00000100:00100000:2.0:1789760773.909871:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.909923:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70045696, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21680 00010000:00010000:2.0:1789760773.909932:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.909946:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760773.909951:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.909958:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.909973:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.915817:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984409 is committed 00002000:00010000:2.0:1789760773.919253:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70045696 -> 70049792 00002000:00010000:2.0:1789760773.919262:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136832 -> 136840 00010000:00010000:2.0:1789760773.919276:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919291:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919301:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919309:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.919314:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919394:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919423:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.919432:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d2ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70045696->70049791] (req 70045696->70049791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.919643:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565418624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9771us (10313us total) trans 4294984409 rc 0/0 00000100:00100000:2.0:1789760773.919655:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17112 00000100:00100000:2.0:1789760773.919664:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712158559991 time 712170144157 state 0x2 ref 0 00000100:00100000:2.0:1789760773.928433:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760773.928536:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418752 00000100:00100000:1.0:1789760773.928546:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418752 00000100:00100000:1.0:1789760773.928600:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712158559991 time 712170144157 state 0x0 ref 1 00000100:00100000:1.0:1789760773.928615:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712170404573 time 712170144157 state 0x1 ref 1 00000100:00100000:1.0:1789760773.928645:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712170404573 time 712188937022 state 0x0 ref 1 00000100:00100000:1.0:1789760773.928658:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565418752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760773.928747:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70049792, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21688 00010000:00010000:1.0:1789760773.928757:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.928782:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760773.928788:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.928795:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.928815:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.933438:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984410 is committed 00002000:00010000:1.0:1789760773.933843:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70049792 -> 70053888 00002000:00010000:1.0:1789760773.933848:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136840 -> 136848 00010000:00010000:1.0:1789760773.933861:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933872:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933881:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933890:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760773.933894:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933903:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933924:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.933932:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d2b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70049792->70053887] (req 70049792->70053887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.934077:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565418752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5417us (5649us total) trans 4294984410 rc 0/0 00000100:00100000:1.0:1789760773.934088:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17113 00000100:00100000:1.0:1789760773.934097:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712170404573 time 712188937022 state 0x2 ref 0 00000100:00100000:1.0:1789760773.937516:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.937613:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565418880 00000100:00100000:2.0:1789760773.937623:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565418880 00000100:00100000:2.0:1789760773.937671:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712170404573 time 712188937022 state 0x0 ref 1 00000100:00100000:2.0:1789760773.937686:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712189197438 time 712188937022 state 0x1 ref 1 00000100:00100000:2.0:1789760773.938117:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712189197438 time 712198396798 state 0x0 ref 1 00000100:00100000:2.0:1789760773.938133:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565418880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.938183:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70053888, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0x21690 00010000:00010000:2.0:1789760773.938193:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.938209:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760773.938213:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.938219:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.938233:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760773.944487:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984411 is committed 00002000:00010000:2.0:1789760773.944619:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70053888 -> 70057984 00002000:00010000:2.0:1789760773.944624:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760773 -> 1789760774 00002000:00010000:2.0:1789760773.944626:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760773 -> 1789760774 00002000:00010000:2.0:1789760773.944629:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136848 -> 136856 00010000:00010000:2.0:1789760773.944842:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947428:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947438:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947445:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760773.947449:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947467:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947489:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.947498:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d2b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70053888->70057983] (req 70053888->70057983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.947605:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565418880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9471us (10094us total) trans 4294984411 rc 0/0 00000100:00100000:2.0:1789760773.947618:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17114 00000100:00100000:2.0:1789760773.947629:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712189197438 time 712198396798 state 0x2 ref 0 00000100:00100000:2.0:1789760773.956879:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760773.957061:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419008 00000100:00100000:3.0:1789760773.957070:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419008 00000100:00100000:3.0:1789760773.957125:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712189197438 time 712198396798 state 0x0 ref 1 00000100:00100000:3.0:1789760773.957139:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712198657214 time 712198396798 state 0x1 ref 1 00000100:00100000:3.0:1789760773.957175:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712198657214 time 712217466714 state 0x0 ref 1 00000100:00100000:3.0:1789760773.957187:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760773.957511:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70057984, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21698 00010000:00010000:3.0:1789760773.957521:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.957537:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760773.957541:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.957547:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.957561:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.962471:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984412 is committed 00002000:00010000:3.0:1789760773.964860:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70057984 -> 70062080 00002000:00010000:3.0:1789760773.964869:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136856 -> 136864 00010000:00010000:3.0:1789760773.964883:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964896:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964906:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964914:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760773.964919:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964929:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964950:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.964958:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70057984->70062079] (req 70057984->70062079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.965196:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8002us (8318us total) trans 4294984412 rc 0/0 00000100:00100000:3.0:1789760773.965206:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17115 00000100:00100000:3.0:1789760773.965215:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712198657214 time 712217466714 state 0x2 ref 0 00000100:00100000:1.0:1789760773.969643:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760773.970090:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419136 00000100:00100000:0.0:1789760773.970101:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419136 00000100:00100000:0.0:1789760773.970157:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712198657214 time 712217466714 state 0x0 ref 1 00000100:00100000:0.0:1789760773.970172:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712217727130 time 712217466714 state 0x1 ref 1 00000100:00100000:0.0:1789760773.970866:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712217727130 time 712231153409 state 0x0 ref 1 00000100:00100000:0.0:1789760773.970885:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565419136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760773.970937:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70062080, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216a0 00010000:00010000:0.0:1789760773.970947:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.970961:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760773.970965:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760773.970971:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.970984:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760773.978775:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984413 is committed 00002000:00010000:0.0:1789760773.980295:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70062080 -> 70066176 00002000:00010000:0.0:1789760773.980305:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136864 -> 136872 00010000:00010000:0.0:1789760773.980318:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980337:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980345:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980352:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760773.980357:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980366:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980385:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.980393:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70062080->70066175] (req 70062080->70066175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.980494:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565419136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9609us (10856us total) trans 4294984413 rc 0/0 00000100:00100000:0.0:1789760773.980506:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17116 00000100:00100000:0.0:1789760773.980515:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712217727130 time 712231153409 state 0x2 ref 0 00000100:00100000:1.0:1789760773.991420:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760773.991844:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419264 00000100:00100000:2.0:1789760773.991855:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419264 00000100:00100000:2.0:1789760773.991913:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712217727130 time 712231153409 state 0x0 ref 1 00000100:00100000:2.0:1789760773.991928:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712231413825 time 712231153409 state 0x1 ref 1 00000100:00100000:2.0:1789760773.991965:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712231413825 time 712252256724 state 0x0 ref 1 00000100:00100000:2.0:1789760773.991977:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760773.992027:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70066176, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216a8 00010000:00010000:2.0:1789760773.992037:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.992052:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760773.992056:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760773.992062:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.992076:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.000175:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984414 is committed 00002000:00010000:2.0:1789760774.000892:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70066176 -> 70070272 00002000:00010000:2.0:1789760774.000897:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136872 -> 136880 00010000:00010000:2.0:1789760774.000910:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000923:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000932:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000940:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.000945:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000959:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000978:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.000986:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d2ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70066176->70070271] (req 70066176->70070271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.001090:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9110us (9675us total) trans 4294984414 rc 0/0 00000100:00100000:2.0:1789760774.001100:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17117 00000100:00100000:2.0:1789760774.001109:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712231413825 time 712252256724 state 0x2 ref 0 00000100:00100000:2.0:1789760774.009336:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.009454:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419392 00000100:00100000:3.0:1789760774.009463:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419392 00000100:00100000:3.0:1789760774.009532:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712231413825 time 712252256724 state 0x0 ref 1 00000100:00100000:3.0:1789760774.009548:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712252517140 time 712252256724 state 0x1 ref 1 00000100:00100000:3.0:1789760774.009585:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712252517140 time 712269876359 state 0x0 ref 1 00000100:00100000:3.0:1789760774.009599:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.009648:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70070272, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216b0 00010000:00010000:3.0:1789760774.009656:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.009672:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.009677:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.009683:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.009696:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760774.010271:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760774.016956:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984415 is committed 00002000:00010000:3.0:1789760774.017083:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70070272 -> 70074368 00002000:00010000:3.0:1789760774.017088:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136880 -> 136888 00010000:00010000:3.0:1789760774.017102:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017114:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017123:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017131:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.017136:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017145:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017164:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.017172:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70070272->70074367] (req 70070272->70074367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.017266:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7667us (7934us total) trans 4294984415 rc 0/0 00000100:00100000:3.0:1789760774.017276:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17118 00000100:00100000:3.0:1789760774.017287:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712252517140 time 712269876359 state 0x2 ref 0 00000100:00100000:1.0:1789760774.022328:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.022512:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419520 00000100:00100000:0.0:1789760774.022521:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419520 00000100:00100000:0.0:1789760774.022575:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712252517140 time 712269876359 state 0x0 ref 1 00000100:00100000:0.0:1789760774.022589:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712270136775 time 712269876359 state 0x1 ref 1 00000100:00100000:0.0:1789760774.022653:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712270136775 time 712282944336 state 0x0 ref 1 00000100:00100000:0.0:1789760774.022666:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.022730:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70074368, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216b8 00010000:00010000:0.0:1789760774.022740:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.022754:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.022768:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.022775:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.022788:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.028254:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984416 is committed 00002000:00010000:0.0:1789760774.028487:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70074368 -> 70078464 00002000:00010000:0.0:1789760774.028492:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136888 -> 136896 00010000:00010000:0.0:1789760774.028505:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028524:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028534:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028542:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.028547:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028556:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028575:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.028583:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70074368->70078463] (req 70074368->70078463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.028678:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6009us (6364us total) trans 4294984416 rc 0/0 00000100:00100000:0.0:1789760774.028690:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17119 00000100:00100000:0.0:1789760774.028699:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712270136775 time 712282944336 state 0x2 ref 0 00000100:00100000:1.0:1789760774.035664:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.035927:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419648 00000100:00100000:2.0:1789760774.035938:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419648 00000100:00100000:2.0:1789760774.036193:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712270136775 time 712282944336 state 0x0 ref 1 00000100:00100000:2.0:1789760774.036209:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712283204752 time 712282944336 state 0x1 ref 1 00000100:00100000:2.0:1789760774.036236:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712283204752 time 712296528152 state 0x0 ref 1 00000100:00100000:2.0:1789760774.036248:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565419648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.036295:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70078464, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216c0 00010000:00010000:2.0:1789760774.036304:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.036319:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.036323:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.036330:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.036345:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.041461:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984417 is committed 00002000:00010000:2.0:1789760774.041582:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70078464 -> 70082560 00002000:00010000:2.0:1789760774.041587:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136896 -> 136904 00010000:00010000:2.0:1789760774.041601:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041614:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041623:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041631:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.041637:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041650:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041670:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.041678:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d2e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70078464->70082559] (req 70078464->70082559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.042233:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565419648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5981us (6574us total) trans 4294984417 rc 0/0 00000100:00100000:2.0:1789760774.042244:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17120 00000100:00100000:2.0:1789760774.042254:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712283204752 time 712296528152 state 0x2 ref 0 00000100:00100000:2.0:1789760774.050454:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.050797:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419776 00000100:00100000:3.0:1789760774.050808:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419776 00000100:00100000:3.0:1789760774.050864:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712283204752 time 712296528152 state 0x0 ref 1 00000100:00100000:3.0:1789760774.050880:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712296788568 time 712296528152 state 0x1 ref 1 00000100:00100000:3.0:1789760774.050916:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712296788568 time 712311207913 state 0x0 ref 1 00000100:00100000:3.0:1789760774.050928:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565419776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.051102:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70082560, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216c8 00010000:00010000:3.0:1789760774.051120:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.051136:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.051140:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.051146:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.051160:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.060306:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984418 is committed 00002000:00010000:3.0:1789760774.060430:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70082560 -> 70086656 00002000:00010000:3.0:1789760774.060435:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136904 -> 136912 00010000:00010000:3.0:1789760774.060448:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060464:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060474:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060480:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.060485:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060492:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060510:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.060517:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70082560->70086655] (req 70082560->70086655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.060607:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565419776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9677us (10157us total) trans 4294984418 rc 0/0 00000100:00100000:3.0:1789760774.060617:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17121 00000100:00100000:3.0:1789760774.060626:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712296788568 time 712311207913 state 0x2 ref 0 00000100:00100000:1.0:1789760774.067943:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.068141:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565419904 00000100:00100000:0.0:1789760774.068150:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565419904 00000100:00100000:0.0:1789760774.068203:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712296788568 time 712311207913 state 0x0 ref 1 00000100:00100000:0.0:1789760774.068219:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712311468329 time 712311207913 state 0x1 ref 1 00000100:00100000:0.0:1789760774.068248:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712311468329 time 712328540238 state 0x0 ref 1 00000100:00100000:0.0:1789760774.068261:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.068311:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70086656, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216d0 00010000:00010000:0.0:1789760774.068320:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.068335:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.068338:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.068344:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.068358:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.074396:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984419 is committed 00002000:00010000:0.0:1789760774.074502:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70086656 -> 70090752 00002000:00010000:0.0:1789760774.074507:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136912 -> 136920 00010000:00010000:0.0:1789760774.074520:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074533:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074542:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074550:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.074554:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074562:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074582:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.074589:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d2f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70086656->70090751] (req 70086656->70090751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.074742:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565419904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6480us (6804us total) trans 4294984419 rc 0/0 00000100:00100000:0.0:1789760774.074753:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17122 00000100:00100000:0.0:1789760774.074777:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712311468329 time 712328540238 state 0x2 ref 0 00000100:00100000:1.0:1789760774.085340:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.085563:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420032 00000100:00100000:2.0:1789760774.085572:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420032 00000100:00100000:2.0:1789760774.085619:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712311468329 time 712328540238 state 0x0 ref 1 00000100:00100000:2.0:1789760774.085633:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712328800654 time 712328540238 state 0x1 ref 1 00000100:00100000:2.0:1789760774.085770:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712328800654 time 712346052035 state 0x0 ref 1 00000100:00100000:2.0:1789760774.085782:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.085825:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70090752, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216d8 00010000:00010000:2.0:1789760774.085833:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.085848:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.085851:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.085857:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.085871:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.095657:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984420 is committed 00002000:00010000:1.0:1789760774.096195:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70090752 -> 70094848 00002000:00010000:1.0:1789760774.096202:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136920 -> 136928 00010000:00010000:1.0:1789760774.096216:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096227:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096234:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096239:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.096242:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096249:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096265:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.096269:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d2f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70090752->70094847] (req 70090752->70094847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.096360:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10575us (11024us total) trans 4294984420 rc 0/0 00000100:00100000:1.0:1789760774.096371:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17123 00000100:00100000:1.0:1789760774.096380:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712328800654 time 712346052035 state 0x2 ref 0 00000100:00100000:2.0:1789760774.098521:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.098888:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420160 00000100:00100000:3.0:1789760774.098899:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420160 00000100:00100000:3.0:1789760774.098954:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712328800654 time 712346052035 state 0x0 ref 1 00000100:00100000:3.0:1789760774.098970:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712346312451 time 712346052035 state 0x1 ref 1 00000100:00100000:3.0:1789760774.098999:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712346312451 time 712359291145 state 0x0 ref 1 00000100:00100000:3.0:1789760774.099013:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565420160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.099064:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70094848, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216e0 00010000:00010000:3.0:1789760774.099074:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.099089:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.099094:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.099101:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.099277:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.105428:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984421 is committed 00002000:00010000:3.0:1789760774.105543:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70094848 -> 70098944 00002000:00010000:3.0:1789760774.105550:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136928 -> 136936 00010000:00010000:3.0:1789760774.105563:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105576:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105590:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105598:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.105602:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105610:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105629:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.105637:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d2ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70094848->70098943] (req 70094848->70098943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.105839:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565420160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6823us (7320us total) trans 4294984421 rc 0/0 00000100:00100000:3.0:1789760774.105850:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17124 00000100:00100000:3.0:1789760774.105859:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712346312451 time 712359291145 state 0x2 ref 0 00000100:00100000:2.0:1789760774.117560:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.117673:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420288 00000100:00100000:0.0:1789760774.117682:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420288 00000100:00100000:0.0:1789760774.117932:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712346312451 time 712359291145 state 0x0 ref 1 00000100:00100000:0.0:1789760774.117947:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712359551561 time 712359291145 state 0x1 ref 1 00000100:00100000:0.0:1789760774.117976:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712359551561 time 712378268390 state 0x0 ref 1 00000100:00100000:0.0:1789760774.117988:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.118029:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70098944, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216e8 00010000:00010000:0.0:1789760774.118038:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.118053:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.118057:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.118063:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.118077:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.123544:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984422 is committed 00002000:00010000:0.0:1789760774.123642:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70098944 -> 70103040 00002000:00010000:0.0:1789760774.123646:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136936 -> 136944 00010000:00010000:0.0:1789760774.123658:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123668:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123674:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123683:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.123687:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123693:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123726:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.123733:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d306 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70098944->70103039] (req 70098944->70103039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.123845:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5854us (6291us total) trans 4294984422 rc 0/0 00000100:00100000:0.0:1789760774.123856:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17125 00000100:00100000:0.0:1789760774.123866:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712359551561 time 712378268390 state 0x2 ref 0 00000100:00100000:2.0:1789760774.136404:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.136501:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420416 00000100:00100000:1.0:1789760774.136510:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420416 00000100:00100000:1.0:1789760774.136560:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712359551561 time 712378268390 state 0x0 ref 1 00000100:00100000:1.0:1789760774.136574:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712378528806 time 712378268390 state 0x1 ref 1 00000100:00100000:1.0:1789760774.136608:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712378528806 time 712396900608 state 0x0 ref 1 00000100:00100000:1.0:1789760774.136620:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565420416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.136664:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70103040, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216f0 00010000:00010000:1.0:1789760774.136673:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.136688:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.136693:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.136700:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.137322:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.144961:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984423 is committed 00002000:00010000:1.0:1789760774.145106:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70103040 -> 70107136 00002000:00010000:1.0:1789760774.145112:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136944 -> 136952 00010000:00010000:1.0:1789760774.145125:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145354:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145363:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145370:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.145376:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145384:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145409:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.145417:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d30d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70103040->70107135] (req 70103040->70107135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.145511:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565420416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8889us (9113us total) trans 4294984423 rc 0/0 00000100:00100000:1.0:1789760774.145521:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17126 00000100:00100000:1.0:1789760774.145530:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712378528806 time 712396900608 state 0x2 ref 0 00000100:00100000:2.0:1789760774.150688:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.151014:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420544 00000100:00100000:3.0:1789760774.151030:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420544 00000100:00100000:3.0:1789760774.151090:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712378528806 time 712396900608 state 0x0 ref 1 00000100:00100000:3.0:1789760774.151106:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712397161024 time 712396900608 state 0x1 ref 1 00000100:00100000:3.0:1789760774.151145:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712397161024 time 712411436527 state 0x0 ref 1 00000100:00100000:3.0:1789760774.151158:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.151208:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70107136, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x216f8 00010000:00010000:3.0:1789760774.151217:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.151232:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.151235:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.151241:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.151255:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.158220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984424 is committed 00002000:00010000:3.0:1789760774.158361:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70107136 -> 70111232 00002000:00010000:3.0:1789760774.158367:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136952 -> 136960 00010000:00010000:3.0:1789760774.158380:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158393:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158401:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158413:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.158418:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158428:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158449:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.158456:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d314 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70107136->70111231] (req 70107136->70111231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.158549:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7389us (7868us total) trans 4294984424 rc 0/0 00000100:00100000:3.0:1789760774.158560:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17127 00000100:00100000:3.0:1789760774.158570:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712397161024 time 712411436527 state 0x2 ref 0 00000100:00100000:2.0:1789760774.161612:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.161866:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420672 00000100:00100000:0.0:1789760774.161876:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420672 00000100:00100000:0.0:1789760774.161940:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712397161024 time 712411436527 state 0x0 ref 1 00000100:00100000:0.0:1789760774.161956:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712411696943 time 712411436527 state 0x1 ref 1 00000100:00100000:0.0:1789760774.162199:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712411696943 time 712422488999 state 0x0 ref 1 00000100:00100000:0.0:1789760774.162218:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.162273:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70111232, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21700 00010000:00010000:0.0:1789760774.162282:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.162297:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.162301:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.162308:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.162322:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.170751:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984425 is committed 00002000:00010000:0.0:1789760774.170907:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70111232 -> 70115328 00002000:00010000:0.0:1789760774.170912:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136960 -> 136968 00010000:00010000:0.0:1789760774.170925:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170938:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170947:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170954:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.170959:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170969:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170988:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.170995:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d31b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70111232->70115327] (req 70111232->70115327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.171110:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565420672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8884us (9496us total) trans 4294984425 rc 0/0 00000100:00100000:0.0:1789760774.171122:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17128 00000100:00100000:0.0:1789760774.171133:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712411696943 time 712422488999 state 0x2 ref 0 00000100:00100000:3.0:1789760774.177210:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.177521:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420800 00000100:00100000:1.0:1789760774.177531:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420800 00000100:00100000:1.0:1789760774.177586:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712411696943 time 712422488999 state 0x0 ref 1 00000100:00100000:1.0:1789760774.177600:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712422749415 time 712422488999 state 0x1 ref 1 00000100:00100000:1.0:1789760774.177622:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712422749415 time 712437915449 state 0x0 ref 1 00000100:00100000:1.0:1789760774.177633:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565420800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.177676:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70115328, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21708 00010000:00010000:1.0:1789760774.177686:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.177737:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.177743:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.177749:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.177772:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.184213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984426 is committed 00002000:00010000:0.0:1789760774.184367:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70115328 -> 70119424 00002000:00010000:0.0:1789760774.184372:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136968 -> 136976 00010000:00010000:0.0:1789760774.184386:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184401:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184422:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184436:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.184441:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184450:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184471:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.184480:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d322 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70115328->70119423] (req 70115328->70119423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.184577:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565420800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6940us (7371us total) trans 4294984426 rc 0/0 00000100:00100000:0.0:1789760774.184588:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17129 00000100:00100000:0.0:1789760774.184598:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712422749415 time 712437915449 state 0x2 ref 0 00000100:00100000:2.0:1789760774.190671:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.190824:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565420928 00000100:00100000:3.0:1789760774.190833:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565420928 00000100:00100000:3.0:1789760774.190892:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712422749415 time 712437915449 state 0x0 ref 1 00000100:00100000:3.0:1789760774.190907:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712438175865 time 712437915449 state 0x1 ref 1 00000100:00100000:3.0:1789760774.190939:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712438175865 time 712451231154 state 0x0 ref 1 00000100:00100000:3.0:1789760774.190953:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565420928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.191001:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70119424, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21710 00010000:00010000:3.0:1789760774.191012:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.191029:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.191034:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.191040:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.191054:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.195700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984427 is committed 00002000:00010000:3.0:1789760774.196076:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70119424 -> 70123520 00002000:00010000:3.0:1789760774.196085:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136976 -> 136984 00010000:00010000:3.0:1789760774.196099:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196112:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196120:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196127:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.196133:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196214:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196234:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.196242:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d329 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70119424->70123519] (req 70119424->70123519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.196414:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565420928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5460us (5749us total) trans 4294984427 rc 0/0 00000100:00100000:3.0:1789760774.196424:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17130 00000100:00100000:3.0:1789760774.196432:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712438175865 time 712451231154 state 0x2 ref 0 00000100:00100000:2.0:1789760774.206956:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.207033:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421056 00000100:00100000:0.0:1789760774.207044:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421056 00000100:00100000:0.0:1789760774.207098:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712438175865 time 712451231154 state 0x0 ref 1 00000100:00100000:0.0:1789760774.207125:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712451491570 time 712451231154 state 0x1 ref 1 00000100:00100000:0.0:1789760774.207168:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712451491570 time 712467460276 state 0x0 ref 1 00000100:00100000:0.0:1789760774.207185:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.207236:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70123520, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21718 00010000:00010000:0.0:1789760774.207246:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.207262:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.207267:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.207274:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.207288:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.214024:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984428 is committed 00002000:00010000:0.0:1789760774.214372:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70123520 -> 70127616 00002000:00010000:0.0:1789760774.214377:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136984 -> 136992 00010000:00010000:0.0:1789760774.214391:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214403:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214482:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214492:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.214497:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214506:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214527:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.214535:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d330 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70123520->70127615] (req 70123520->70127615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.214670:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7483us (7719us total) trans 4294984428 rc 0/0 00000100:00100000:0.0:1789760774.214680:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17131 00000100:00100000:0.0:1789760774.214689:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712451491570 time 712467460276 state 0x2 ref 0 00000100:00100000:1.0:1789760774.219238:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.219320:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421184 00000100:00100000:0.0:1789760774.219330:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421184 00000100:00100000:0.0:1789760774.219386:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712451491570 time 712467460276 state 0x0 ref 1 00000100:00100000:0.0:1789760774.219400:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712467720692 time 712467460276 state 0x1 ref 1 00000100:00100000:0.0:1789760774.219437:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712467720692 time 712479729115 state 0x0 ref 1 00000100:00100000:0.0:1789760774.219450:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565421184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.219498:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70127616, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21720 00010000:00010000:0.0:1789760774.219508:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.219523:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.219527:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.219534:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.219547:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760774.227361:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984429 is committed 00002000:00010000:0.0:1789760774.227804:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70127616 -> 70131712 00002000:00010000:0.0:1789760774.227810:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 136992 -> 137000 00010000:00010000:0.0:1789760774.227821:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227833:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227841:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227847:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.227852:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227859:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227956:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.227965:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d337 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70127616->70131711] (req 70127616->70131711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.228061:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565421184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8609us (8828us total) trans 4294984429 rc 0/0 00000100:00100000:0.0:1789760774.228071:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17132 00000100:00100000:0.0:1789760774.228081:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712467720692 time 712479729115 state 0x2 ref 0 00000100:00100000:2.0:1789760774.234264:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.234364:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421312 00000100:00100000:3.0:1789760774.234374:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421312 00000100:00100000:3.0:1789760774.234566:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712467720692 time 712479729115 state 0x0 ref 1 00000100:00100000:3.0:1789760774.234584:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712479989531 time 712479729115 state 0x1 ref 1 00000100:00100000:3.0:1789760774.234663:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712479989531 time 712494953602 state 0x0 ref 1 00000100:00100000:3.0:1789760774.234678:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.234770:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70131712, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21728 00010000:00010000:3.0:1789760774.234780:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.234796:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.234801:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.234807:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.234821:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.240009:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984430 is committed 00002000:00010000:3.0:1789760774.240250:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70131712 -> 70135808 00002000:00010000:3.0:1789760774.240255:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137000 -> 137008 00010000:00010000:3.0:1789760774.240267:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240278:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240286:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240293:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.240298:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240312:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240387:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.240395:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d33e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70131712->70135807] (req 70131712->70135807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.240495:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5816us (6236us total) trans 4294984430 rc 0/0 00000100:00100000:3.0:1789760774.240505:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17133 00000100:00100000:3.0:1789760774.240514:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712479989531 time 712494953602 state 0x2 ref 0 00000100:00100000:2.0:1789760774.244115:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.244251:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421440 00000100:00100000:0.0:1789760774.244262:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421440 00000100:00100000:0.0:1789760774.244315:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712479989531 time 712494953602 state 0x0 ref 1 00000100:00100000:0.0:1789760774.244330:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712495214018 time 712494953602 state 0x1 ref 1 00000100:00100000:0.0:1789760774.244361:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712495214018 time 712504653038 state 0x0 ref 1 00000100:00100000:0.0:1789760774.244375:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.244428:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70135808, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21730 00010000:00010000:0.0:1789760774.244438:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.244458:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.244462:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.244469:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.244484:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.251290:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984431 is committed 00002000:00010000:2.0:1789760774.251592:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70135808 -> 70139904 00002000:00010000:2.0:1789760774.251597:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137008 -> 137016 00010000:00010000:2.0:1789760774.251610:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251622:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251631:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251638:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.251643:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251652:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251671:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.251679:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674d345 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70135808->70139903] (req 70135808->70139903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.252240:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7860us (8139us total) trans 4294984431 rc 0/0 00000100:00100000:2.0:1789760774.252253:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17134 00000100:00100000:2.0:1789760774.252262:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712495214018 time 712504653038 state 0x2 ref 0 00000100:00100000:1.0:1789760774.257148:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.257306:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421568 00000100:00100000:0.0:1789760774.257316:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421568 00000100:00100000:0.0:1789760774.257374:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712495214018 time 712504653038 state 0x0 ref 1 00000100:00100000:0.0:1789760774.257389:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712504913454 time 712504653038 state 0x1 ref 1 00000100:00100000:0.0:1789760774.257455:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712504913454 time 712517747359 state 0x0 ref 1 00000100:00100000:0.0:1789760774.257469:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.257529:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70139904, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21738 00010000:00010000:0.0:1789760774.257539:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.257555:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.257559:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.257566:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.257580:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.262004:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984432 is committed 00002000:00010000:2.0:1789760774.262108:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70139904 -> 70144000 00002000:00010000:2.0:1789760774.262114:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137016 -> 137024 00010000:00010000:2.0:1789760774.262131:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262243:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262253:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262258:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.262261:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262267:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262282:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.262287:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d34c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70139904->70143999] (req 70139904->70143999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.262429:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4957us (5286us total) trans 4294984432 rc 0/0 00000100:00100000:2.0:1789760774.262452:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17135 00000100:00100000:2.0:1789760774.262462:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712504913454 time 712517747359 state 0x2 ref 0 00000100:00100000:1.0:1789760774.266163:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.266248:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421696 00000100:00100000:3.0:1789760774.266257:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421696 00000100:00100000:3.0:1789760774.266307:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712504913454 time 712517747359 state 0x0 ref 1 00000100:00100000:3.0:1789760774.266321:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712518007775 time 712517747359 state 0x1 ref 1 00000100:00100000:3.0:1789760774.266352:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712518007775 time 712526643815 state 0x0 ref 1 00000100:00100000:3.0:1789760774.266365:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.266411:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70144000, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21740 00010000:00010000:3.0:1789760774.266419:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.266436:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1789760774.266440:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.266446:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.266461:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.274836:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984433 is committed 00002000:00010000:0.0:1789760774.274959:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70144000 -> 70148096 00002000:00010000:0.0:1789760774.274964:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137024 -> 137032 00010000:00010000:0.0:1789760774.274977:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.274990:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.274999:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.275006:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.275011:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.275021:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.275040:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.275047:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674d353 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70144000->70148095] (req 70144000->70148095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.275174:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565421696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8807us (9015us total) trans 4294984433 rc 0/0 00000100:00100000:0.0:1789760774.275185:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17136 00000100:00100000:0.0:1789760774.275194:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712518007775 time 712526643815 state 0x2 ref 0 00000100:00100000:1.0:1789760774.280678:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.280929:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421824 00000100:00100000:2.0:1789760774.280939:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421824 00000100:00100000:2.0:1789760774.280993:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712518007775 time 712526643815 state 0x0 ref 1 00000100:00100000:2.0:1789760774.281006:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712526904231 time 712526643815 state 0x1 ref 1 00000100:00100000:2.0:1789760774.281037:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712526904231 time 712541329337 state 0x0 ref 1 00000100:00100000:2.0:1789760774.281049:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.281094:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70148096, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21748 00010000:00010000:2.0:1789760774.281104:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.281119:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.281123:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.281129:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.281216:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.286599:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984434 is committed 00002000:00010000:2.0:1789760774.286753:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70148096 -> 70152192 00002000:00010000:2.0:1789760774.286767:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137032 -> 137040 00010000:00010000:2.0:1789760774.286780:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286793:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286802:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286809:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.286814:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286823:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286841:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.286849:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d35a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70148096->70152191] (req 70148096->70152191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.287123:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6071us (6447us total) trans 4294984434 rc 0/0 00000100:00100000:2.0:1789760774.287144:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17137 00000100:00100000:2.0:1789760774.287155:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712526904231 time 712541329337 state 0x2 ref 0 00000100:00100000:1.0:1789760774.293104:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.293202:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565421952 00000100:00100000:2.0:1789760774.293211:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565421952 00000100:00100000:2.0:1789760774.293274:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712526904231 time 712541329337 state 0x0 ref 1 00000100:00100000:2.0:1789760774.293288:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712541589753 time 712541329337 state 0x1 ref 1 00000100:00100000:2.0:1789760774.293319:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712541589753 time 712553610536 state 0x0 ref 1 00000100:00100000:2.0:1789760774.293331:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.293378:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70152192, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21750 00010000:00010000:2.0:1789760774.293387:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.293402:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.293406:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.293425:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.293440:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.300592:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984435 is committed 00002000:00010000:0.0:1789760774.302136:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70152192 -> 70156288 00002000:00010000:0.0:1789760774.302145:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137040 -> 137048 00010000:00010000:0.0:1789760774.302160:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302174:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302184:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302193:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.302198:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302208:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302226:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.302235:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d361 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70152192->70156287] (req 70152192->70156287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.302339:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565421952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9005us (9240us total) trans 4294984435 rc 0/0 00000100:00100000:0.0:1789760774.302350:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17138 00000100:00100000:0.0:1789760774.302361:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712541589753 time 712553610536 state 0x2 ref 0 00000100:00100000:1.0:1789760774.309190:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.311459:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422080 00000100:00100000:0.0:1789760774.311475:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422080 00000100:00100000:0.0:1789760774.311536:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712541589753 time 712553610536 state 0x0 ref 1 00000100:00100000:0.0:1789760774.311552:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712553870952 time 712553610536 state 0x1 ref 1 00000100:00100000:0.0:1789760774.311586:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712553870952 time 712571878301 state 0x0 ref 1 00000100:00100000:0.0:1789760774.311600:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565422080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.311659:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70156288, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21758 00010000:00010000:0.0:1789760774.311669:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.311685:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.311690:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.311696:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.311753:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.319129:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984436 is committed 00002000:00010000:0.0:1789760774.319237:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70156288 -> 70160384 00002000:00010000:0.0:1789760774.319243:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137048 -> 137056 00010000:00010000:0.0:1789760774.319257:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319270:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319279:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319286:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.319291:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319300:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319320:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.319328:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70156288->70160383] (req 70156288->70160383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.319425:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565422080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7823us (10240us total) trans 4294984436 rc 0/0 00000100:00100000:0.0:1789760774.319445:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17139 00000100:00100000:0.0:1789760774.319455:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712553870952 time 712571878301 state 0x2 ref 0 00000100:00100000:1.0:1789760774.330371:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.330487:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422208 00000100:00100000:2.0:1789760774.330499:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422208 00000100:00100000:2.0:1789760774.330551:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712553870952 time 712571878301 state 0x0 ref 1 00000100:00100000:2.0:1789760774.330565:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712572138717 time 712571878301 state 0x1 ref 1 00000100:00100000:2.0:1789760774.331225:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712572138717 time 712591513559 state 0x0 ref 1 00000100:00100000:2.0:1789760774.331240:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565422208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.331288:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70160384, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21760 00010000:00010000:2.0:1789760774.331297:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.331313:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.331318:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.331324:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.331338:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.339638:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984437 is committed 00002000:00010000:2.0:1789760774.339990:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70160384 -> 70164480 00002000:00010000:2.0:1789760774.339995:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137056 -> 137064 00010000:00010000:2.0:1789760774.340317:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340332:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340342:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340350:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.340354:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340363:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340387:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.340395:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d36f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70160384->70164479] (req 70160384->70164479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.340494:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565422208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9251us (10128us total) trans 4294984437 rc 0/0 00000100:00100000:2.0:1789760774.340505:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17140 00000100:00100000:2.0:1789760774.340515:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712572138717 time 712591513559 state 0x2 ref 0 00000100:00100000:1.0:1789760774.347191:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1789760774.347850:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760774.348036:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422336 00000100:00100000:0.0:1789760774.348045:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422336 00000100:00100000:0.0:1789760774.348435:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712572138717 time 712591513559 state 0x0 ref 1 00000100:00100000:0.0:1789760774.348453:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712591773975 time 712591513559 state 0x1 ref 1 00000100:00100000:0.0:1789760774.348519:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712591773975 time 712608810477 state 0x0 ref 1 00000100:00100000:0.0:1789760774.348533:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565422336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.348578:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70164480, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21768 00010000:00010000:0.0:1789760774.348588:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.348602:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.348607:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.348612:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.348625:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.354815:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984438 is committed 00002000:00010000:0.0:1789760774.354930:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70164480 -> 70168576 00002000:00010000:0.0:1789760774.354936:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137064 -> 137072 00010000:00010000:0.0:1789760774.354948:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.354961:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.354971:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.354980:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.354985:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.354994:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.355013:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.355022:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d376 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70164480->70168575] (req 70164480->70168575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.355118:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565422336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6584us (7933us total) trans 4294984438 rc 0/0 00000100:00100000:0.0:1789760774.355129:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17141 00000100:00100000:0.0:1789760774.355138:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712591773975 time 712608810477 state 0x2 ref 0 00000100:00100000:1.0:1789760774.365829:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.365935:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422464 00000100:00100000:0.0:1789760774.365945:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422464 00000100:00100000:0.0:1789760774.365999:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712591773975 time 712608810477 state 0x0 ref 1 00000100:00100000:0.0:1789760774.366013:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712609070893 time 712608810477 state 0x1 ref 1 00000100:00100000:0.0:1789760774.366078:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712609070893 time 712626370034 state 0x0 ref 1 00000100:00100000:0.0:1789760774.366090:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565422464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.366137:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70168576, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21770 00010000:00010000:0.0:1789760774.366146:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.366162:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.366167:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.366174:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.366188:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.373633:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984439 is committed 00002000:00010000:0.0:1789760774.373785:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70168576 -> 70172672 00002000:00010000:0.0:1789760774.373792:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137072 -> 137080 00010000:00010000:0.0:1789760774.373810:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373823:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373832:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373840:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.373844:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373852:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373872:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.373879:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d37d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70168576->70172671] (req 70168576->70172671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.373973:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565422464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7879us (8147us total) trans 4294984439 rc 0/0 00000100:00100000:0.0:1789760774.373983:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17142 00000100:00100000:0.0:1789760774.373992:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712609070893 time 712626370034 state 0x2 ref 0 00000100:00100000:1.0:1789760774.383537:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.383658:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422592 00000100:00100000:2.0:1789760774.383668:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422592 00000100:00100000:2.0:1789760774.383818:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712609070893 time 712626370034 state 0x0 ref 1 00000100:00100000:2.0:1789760774.383836:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712626630450 time 712626370034 state 0x1 ref 1 00000100:00100000:2.0:1789760774.383865:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712626630450 time 712644156806 state 0x0 ref 1 00000100:00100000:2.0:1789760774.383878:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565422592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.383922:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70172672, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21778 00010000:00010000:2.0:1789760774.383932:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.383947:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.383952:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.383958:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.383973:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.394754:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984440 is committed 00002000:00010000:2.0:1789760774.394920:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70172672 -> 70176768 00002000:00010000:2.0:1789760774.394925:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137080 -> 137088 00010000:00010000:2.0:1789760774.394939:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.394951:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.394961:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.394969:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.394974:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.394984:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.395005:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.395013:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70172672->70176767] (req 70172672->70176767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.395115:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565422592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11227us (11574us total) trans 4294984440 rc 0/0 00000100:00100000:2.0:1789760774.395127:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17143 00000100:00100000:2.0:1789760774.395139:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712626630450 time 712644156806 state 0x2 ref 0 00000100:00100000:1.0:1789760774.404784:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.404868:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422720 00000100:00100000:0.0:1789760774.404878:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422720 00000100:00100000:0.0:1789760774.404933:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712626630450 time 712644156806 state 0x0 ref 1 00000100:00100000:0.0:1789760774.404947:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712644417222 time 712644156806 state 0x1 ref 1 00000100:00100000:0.0:1789760774.404978:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712644417222 time 712665270330 state 0x0 ref 1 00000100:00100000:0.0:1789760774.404991:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565422720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.405039:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70176768, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21780 00010000:00010000:0.0:1789760774.405049:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.405066:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.405070:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.405076:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.405090:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.411461:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984441 is committed 00002000:00010000:0.0:1789760774.411653:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70176768 -> 70180864 00002000:00010000:0.0:1789760774.411659:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137088 -> 137096 00010000:00010000:0.0:1789760774.411671:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.411690:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.412012:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.412021:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.412026:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.412037:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.412057:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.412066:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d38b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70176768->70180863] (req 70176768->70180863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.412195:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565422720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7201us (7415us total) trans 4294984441 rc 0/0 00000100:00100000:0.0:1789760774.412206:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17144 00000100:00100000:0.0:1789760774.412216:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712644417222 time 712665270330 state 0x2 ref 0 00000100:00100000:1.0:1789760774.417860:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.417948:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422848 00000100:00100000:0.0:1789760774.417959:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422848 00000100:00100000:0.0:1789760774.418009:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712644417222 time 712665270330 state 0x0 ref 1 00000100:00100000:0.0:1789760774.418023:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712665530746 time 712665270330 state 0x1 ref 1 00000100:00100000:0.0:1789760774.418053:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712665530746 time 712678345589 state 0x0 ref 1 00000100:00100000:0.0:1789760774.418065:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565422848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.418121:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70180864, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21788 00010000:00010000:0.0:1789760774.418130:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.418144:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.418150:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.418157:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.418171:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.422893:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984442 is committed 00002000:00010000:0.0:1789760774.423080:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70180864 -> 70184960 00002000:00010000:0.0:1789760774.423086:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137096 -> 137104 00010000:00010000:0.0:1789760774.423155:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423168:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423183:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423190:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.423196:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423205:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423223:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.423231:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d392 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70180864->70184959] (req 70180864->70184959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.423370:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565422848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5302us (5513us total) trans 4294984442 rc 0/0 00000100:00100000:0.0:1789760774.423380:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17145 00000100:00100000:0.0:1789760774.423389:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712665530746 time 712678345589 state 0x2 ref 0 00000100:00100000:1.0:1789760774.427100:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.427189:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565422976 00000100:00100000:2.0:1789760774.427200:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565422976 00000100:00100000:2.0:1789760774.427253:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712665530746 time 712678345589 state 0x0 ref 1 00000100:00100000:2.0:1789760774.427268:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712678606005 time 712678345589 state 0x1 ref 1 00000100:00100000:2.0:1789760774.427304:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712678606005 time 712687595560 state 0x0 ref 1 00000100:00100000:2.0:1789760774.427316:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565422976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.427359:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70184960, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21790 00010000:00010000:2.0:1789760774.427369:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.427384:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.427390:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.427395:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.427410:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.437453:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984443 is committed 00002000:00010000:0.0:1789760774.437622:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70184960 -> 70189056 00002000:00010000:0.0:1789760774.437628:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137104 -> 137112 00010000:00010000:0.0:1789760774.437642:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437662:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437671:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437679:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.437684:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437694:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437754:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.437772:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674d399 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70184960->70189055] (req 70184960->70189055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.437984:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565422976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10664us (10888us total) trans 4294984443 rc 0/0 00000100:00100000:0.0:1789760774.437996:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17146 00000100:00100000:0.0:1789760774.438005:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712678606005 time 712687595560 state 0x2 ref 0 00000100:00100000:0.0:1789760774.448974:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.449186:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423104 00000100:00100000:2.0:1789760774.449197:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423104 00000100:00100000:2.0:1789760774.449254:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712678606005 time 712687595560 state 0x0 ref 1 00000100:00100000:2.0:1789760774.449269:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712687855976 time 712687595560 state 0x1 ref 1 00000100:00100000:2.0:1789760774.449305:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712687855976 time 712709598088 state 0x0 ref 1 00000100:00100000:2.0:1789760774.449318:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.449370:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70189056, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21798 00010000:00010000:2.0:1789760774.449380:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.449396:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.449400:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.449407:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.449421:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.456929:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984444 is committed 00002000:00010000:2.0:1789760774.457530:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70189056 -> 70193152 00002000:00010000:2.0:1789760774.457536:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137112 -> 137120 00010000:00010000:2.0:1789760774.457549:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457561:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457571:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457579:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.457585:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457599:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457971:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.457982:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d3a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70189056->70193151] (req 70189056->70193151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.458204:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8882us (9234us total) trans 4294984444 rc 0/0 00000100:00100000:2.0:1789760774.458216:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17147 00000100:00100000:2.0:1789760774.458225:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712687855976 time 712709598088 state 0x2 ref 0 00000100:00100000:1.0:1789760774.467230:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.467376:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423232 00000100:00100000:0.0:1789760774.467386:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423232 00000100:00100000:0.0:1789760774.467440:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712687855976 time 712709598088 state 0x0 ref 1 00000100:00100000:0.0:1789760774.467455:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712709858504 time 712709598088 state 0x1 ref 1 00000100:00100000:0.0:1789760774.467486:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712709858504 time 712727777966 state 0x0 ref 1 00000100:00100000:0.0:1789760774.467499:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.467554:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70193152, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217a0 00010000:00010000:0.0:1789760774.467565:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.467582:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.467587:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.467594:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.467608:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.472469:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984445 is committed 00002000:00010000:0.0:1789760774.475571:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70193152 -> 70197248 00002000:00010000:0.0:1789760774.475582:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137120 -> 137128 00010000:00010000:0.0:1789760774.475596:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475615:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475624:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475631:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.475636:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475646:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475667:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.475675:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70193152->70197247] (req 70193152->70197247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.477014:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9510us (9787us total) trans 4294984445 rc 0/0 00000100:00100000:0.0:1789760774.477028:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17148 00000100:00100000:0.0:1789760774.477038:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712709858504 time 712727777966 state 0x2 ref 0 00000100:00100000:1.0:1789760774.484575:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.484670:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423360 00000100:00100000:0.0:1789760774.484680:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423360 00000100:00100000:0.0:1789760774.484769:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712709858504 time 712727777966 state 0x0 ref 1 00000100:00100000:0.0:1789760774.484784:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712728038382 time 712727777966 state 0x1 ref 1 00000100:00100000:0.0:1789760774.484807:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712728038382 time 712745098864 state 0x0 ref 1 00000100:00100000:0.0:1789760774.484820:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.484866:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70197248, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217a8 00010000:00010000:0.0:1789760774.484876:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.484890:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.484894:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.484900:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.484913:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.489411:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984446 is committed 00002000:00010000:0.0:1789760774.489536:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70197248 -> 70201344 00002000:00010000:0.0:1789760774.489541:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137128 -> 137136 00010000:00010000:0.0:1789760774.489554:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489567:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489581:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489589:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.489594:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489604:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489626:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.489635:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70197248->70201343] (req 70197248->70201343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.492982:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8149us (8401us total) trans 4294984446 rc 0/0 00000100:00100000:1.0:1789760774.493003:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17149 00000100:00100000:1.0:1789760774.493013:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712728038382 time 712745098864 state 0x2 ref 0 00000100:00100000:3.0:1789760774.507338:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.507526:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423488 00000100:00100000:2.0:1789760774.507539:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423488 00000100:00100000:2.0:1789760774.507596:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712728038382 time 712745098864 state 0x0 ref 1 00000100:00100000:2.0:1789760774.507613:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712745359280 time 712745098864 state 0x1 ref 1 00000100:00100000:2.0:1789760774.507695:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712745359280 time 712767986513 state 0x0 ref 1 00000100:00100000:2.0:1789760774.507742:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.507801:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70201344, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217b0 00010000:00010000:2.0:1789760774.507811:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.507828:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.507833:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.507849:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.507864:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.514843:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984447 is committed 00002000:00010000:1.0:1789760774.520867:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70201344 -> 70205440 00002000:00010000:1.0:1789760774.520879:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137136 -> 137144 00010000:00010000:1.0:1789760774.520972:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.520986:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.520997:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.521005:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.521010:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.521020:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.521042:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.521050:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d3b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70201344->70205439] (req 70201344->70205439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.522868:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15151us (15528us total) trans 4294984447 rc 0/0 00000100:00100000:1.0:1789760774.522892:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17150 00000100:00100000:1.0:1789760774.522902:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712745359280 time 712767986513 state 0x2 ref 0 00000100:00100000:2.0:1789760774.535200:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.535354:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423616 00000100:00100000:0.0:1789760774.535364:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423616 00000100:00100000:0.0:1789760774.535420:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712745359280 time 712767986513 state 0x0 ref 1 00000100:00100000:0.0:1789760774.535436:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712768246929 time 712767986513 state 0x1 ref 1 00000100:00100000:0.0:1789760774.535470:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712768246929 time 712795762484 state 0x0 ref 1 00000100:00100000:0.0:1789760774.535483:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.535533:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70205440, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217b8 00010000:00010000:0.0:1789760774.535543:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.535558:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1789760774.535563:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.535570:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.535584:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.540671:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984448 is committed 00002000:00010000:1.0:1789760774.540811:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70205440 -> 70209536 00002000:00010000:1.0:1789760774.540816:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137144 -> 137152 00010000:00010000:1.0:1789760774.540829:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540842:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540850:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540858:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.540862:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540870:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540890:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.540903:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d3bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70205440->70209535] (req 70205440->70209535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.541007:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5521us (5811us total) trans 4294984448 rc 0/0 00000100:00100000:1.0:1789760774.541018:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17151 00000100:00100000:1.0:1789760774.541027:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712768246929 time 712795762484 state 0x2 ref 0 00000100:00100000:2.0:1789760774.547423:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.547508:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423744 00000100:00100000:1.0:1789760774.547518:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423744 00000100:00100000:1.0:1789760774.547571:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712768246929 time 712795762484 state 0x0 ref 1 00000100:00100000:1.0:1789760774.547587:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712796022900 time 712795762484 state 0x1 ref 1 00000100:00100000:1.0:1789760774.547622:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712796022900 time 712807913458 state 0x0 ref 1 00000100:00100000:1.0:1789760774.547635:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.547681:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70209536, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217c0 00010000:00010000:1.0:1789760774.547690:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.547734:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.547739:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.547747:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.547778:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.556611:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984449 is committed 00002000:00010000:1.0:1789760774.557273:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70209536 -> 70213632 00002000:00010000:1.0:1789760774.557280:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137152 -> 137160 00010000:00010000:1.0:1789760774.557293:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557306:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557316:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557323:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.557327:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557337:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557356:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.557364:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70209536->70213631] (req 70209536->70213631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.557467:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565423744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9829us (10048us total) trans 4294984449 rc 0/0 00000100:00100000:1.0:1789760774.557478:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17152 00000100:00100000:1.0:1789760774.557488:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712796022900 time 712807913458 state 0x2 ref 0 00000100:00100000:3.0:1789760774.562172:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.562436:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565423872 00000100:00100000:1.0:1789760774.562446:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565423872 00000100:00100000:1.0:1789760774.562503:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712796022900 time 712807913458 state 0x0 ref 1 00000100:00100000:1.0:1789760774.562519:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712808173874 time 712807913458 state 0x1 ref 1 00000100:00100000:1.0:1789760774.562546:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712808173874 time 712822838211 state 0x0 ref 1 00000100:00100000:1.0:1789760774.562559:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.562603:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70213632, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217c8 00010000:00010000:1.0:1789760774.562613:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.562629:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.562634:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.562641:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.562654:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.570229:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984450 is committed 00002000:00010000:1.0:1789760774.570361:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70213632 -> 70217728 00002000:00010000:1.0:1789760774.570366:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137160 -> 137168 00010000:00010000:1.0:1789760774.570379:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570392:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570402:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570409:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.570414:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570423:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570450:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.570457:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70213632->70217727] (req 70213632->70217727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.570616:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565423872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8053us (8447us total) trans 4294984450 rc 0/0 00000100:00100000:1.0:1789760774.570627:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17153 00000100:00100000:1.0:1789760774.570642:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712808173874 time 712822838211 state 0x2 ref 0 00000100:00100000:2.0:1789760774.575396:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.575937:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424000 00000100:00100000:1.0:1789760774.575948:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424000 00000100:00100000:1.0:1789760774.575998:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712808173874 time 712822838211 state 0x0 ref 1 00000100:00100000:1.0:1789760774.576012:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712823098627 time 712822838211 state 0x1 ref 1 00000100:00100000:1.0:1789760774.576079:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712823098627 time 712836370450 state 0x0 ref 1 00000100:00100000:1.0:1789760774.576091:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.576133:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70217728, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217d0 00010000:00010000:1.0:1789760774.576142:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.576157:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.576162:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.576167:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.576180:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760774.585828:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984451 is committed 00002000:00010000:1.0:1789760774.586054:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70217728 -> 70221824 00002000:00010000:1.0:1789760774.586059:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137168 -> 137176 00010000:00010000:1.0:1789760774.586074:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586086:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586096:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586115:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.586119:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586128:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586147:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.586155:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70217728->70221823] (req 70217728->70221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.586253:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10159us (10862us total) trans 4294984451 rc 0/0 00000100:00100000:1.0:1789760774.586262:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17154 00000100:00100000:1.0:1789760774.586271:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712823098627 time 712836370450 state 0x2 ref 0 00000100:00100000:3.0:1789760774.595850:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.596205:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424128 00000100:00100000:1.0:1789760774.596215:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424128 00000100:00100000:1.0:1789760774.596267:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712823098627 time 712836370450 state 0x0 ref 1 00000100:00100000:1.0:1789760774.596281:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712836630866 time 712836370450 state 0x1 ref 1 00000100:00100000:1.0:1789760774.596346:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712836630866 time 712856637592 state 0x0 ref 1 00000100:00100000:1.0:1789760774.596358:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.596401:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70221824, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217d8 00010000:00010000:1.0:1789760774.596410:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.596424:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.596428:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.596434:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.596447:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760774.602345:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984452 is committed 00002000:00010000:1.0:1789760774.603135:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70221824 -> 70225920 00002000:00010000:1.0:1789760774.603142:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137176 -> 137184 00010000:00010000:1.0:1789760774.603154:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603174:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603184:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603190:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.603195:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603204:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603224:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.603234:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70221824->70225919] (req 70221824->70225919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.603331:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6971us (7485us total) trans 4294984452 rc 0/0 00000100:00100000:1.0:1789760774.603342:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17155 00000100:00100000:1.0:1789760774.603351:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712836630866 time 712856637592 state 0x2 ref 0 00000100:00100000:3.0:1789760774.606901:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.606992:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424256 00000100:00100000:1.0:1789760774.607003:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424256 00000100:00100000:1.0:1789760774.607055:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712836630866 time 712856637592 state 0x0 ref 1 00000100:00100000:1.0:1789760774.607070:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712856898008 time 712856637592 state 0x1 ref 1 00000100:00100000:1.0:1789760774.607099:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712856898008 time 712867391235 state 0x0 ref 1 00000100:00100000:1.0:1789760774.607120:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.607166:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70225920, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217e0 00010000:00010000:1.0:1789760774.607175:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.607191:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.607195:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.607201:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.607215:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.612302:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984453 is committed 00002000:00010000:1.0:1789760774.612424:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70225920 -> 70230016 00002000:00010000:1.0:1789760774.612430:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137184 -> 137192 00010000:00010000:1.0:1789760774.612442:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612454:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612468:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612475:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.612480:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612488:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612507:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.612514:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70225920->70230015] (req 70225920->70230015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.613749:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6622us (6848us total) trans 4294984453 rc 0/0 00000100:00100000:1.0:1789760774.613770:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17156 00000100:00100000:1.0:1789760774.613780:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712856898008 time 712867391235 state 0x2 ref 0 00000100:00100000:2.0:1789760774.617997:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.618284:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424384 00000100:00100000:1.0:1789760774.618294:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424384 00000100:00100000:1.0:1789760774.618349:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712856898008 time 712867391235 state 0x0 ref 1 00000100:00100000:1.0:1789760774.618364:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712867651651 time 712867391235 state 0x1 ref 1 00000100:00100000:1.0:1789760774.618500:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712867651651 time 712878791595 state 0x0 ref 1 00000100:00100000:1.0:1789760774.618514:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.618560:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70230016, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217e8 00010000:00010000:1.0:1789760774.618569:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.618584:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.618588:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.618594:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.618607:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760774.624261:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984454 is committed 00002000:00010000:1.0:1789760774.624369:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70230016 -> 70234112 00002000:00010000:1.0:1789760774.624372:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137192 -> 137200 00010000:00010000:1.0:1789760774.624385:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624393:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624399:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624458:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.624463:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624470:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624485:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.624490:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70230016->70234111] (req 70230016->70234111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.624564:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6049us (6572us total) trans 4294984454 rc 0/0 00000100:00100000:1.0:1789760774.624573:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17157 00000100:00100000:1.0:1789760774.624583:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712867651651 time 712878791595 state 0x2 ref 0 00000100:00100000:3.0:1789760774.630525:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.630679:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424512 00000100:00100000:1.0:1789760774.630689:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424512 00000100:00100000:1.0:1789760774.630788:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712867651651 time 712878791595 state 0x0 ref 1 00000100:00100000:1.0:1789760774.630803:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712879052011 time 712878791595 state 0x1 ref 1 00000100:00100000:1.0:1789760774.630824:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712879052011 time 712891116494 state 0x0 ref 1 00000100:00100000:1.0:1789760774.630840:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.630900:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70234112, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217f0 00010000:00010000:1.0:1789760774.630910:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.630926:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.630931:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.630937:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.630951:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.638226:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984455 is committed 00002000:00010000:1.0:1789760774.638405:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70234112 -> 70238208 00002000:00010000:1.0:1789760774.638472:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137200 -> 137208 00010000:00010000:1.0:1789760774.638487:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638500:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638510:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638517:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.638523:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638532:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638550:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.638558:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70234112->70238207] (req 70234112->70238207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.638648:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7806us (8128us total) trans 4294984455 rc 0/0 00000100:00100000:1.0:1789760774.638658:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17158 00000100:00100000:1.0:1789760774.638667:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712879052011 time 712891116494 state 0x2 ref 0 00000100:00100000:3.0:1789760774.645516:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.645607:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424640 00000100:00100000:1.0:1789760774.645617:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424640 00000100:00100000:1.0:1789760774.645668:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712879052011 time 712891116494 state 0x0 ref 1 00000100:00100000:1.0:1789760774.645684:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712891376910 time 712891116494 state 0x1 ref 1 00000100:00100000:1.0:1789760774.645749:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712891376910 time 712906040771 state 0x0 ref 1 00000100:00100000:1.0:1789760774.645771:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.645821:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70238208, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x217f8 00010000:00010000:1.0:1789760774.645832:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.645847:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.645852:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.645859:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.645872:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.651031:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984456 is committed 00002000:00010000:1.0:1789760774.651148:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70238208 -> 70242304 00002000:00010000:1.0:1789760774.651153:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137208 -> 137216 00010000:00010000:1.0:1789760774.651167:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651182:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651192:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651200:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.651205:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651213:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651232:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.651240:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d3f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70238208->70242303] (req 70238208->70242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.651333:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5559us (5821us total) trans 4294984456 rc 0/0 00000100:00100000:1.0:1789760774.651343:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17159 00000100:00100000:1.0:1789760774.651352:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712891376910 time 712906040771 state 0x2 ref 0 00000100:00100000:2.0:1789760774.655989:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.656821:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424768 00000100:00100000:1.0:1789760774.656835:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424768 00000100:00100000:1.0:1789760774.656895:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712891376910 time 712906040771 state 0x0 ref 1 00000100:00100000:1.0:1789760774.656911:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712906301187 time 712906040771 state 0x1 ref 1 00000100:00100000:1.0:1789760774.656946:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712906301187 time 712917237476 state 0x0 ref 1 00000100:00100000:1.0:1789760774.656959:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.657008:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70242304, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21800 00010000:00010000:1.0:1789760774.657018:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.657035:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.657039:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.657046:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.657060:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.666147:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984457 is committed 00002000:00010000:1.0:1789760774.666297:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70242304 -> 70246400 00002000:00010000:1.0:1789760774.666302:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137216 -> 137224 00010000:00010000:1.0:1789760774.666315:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666327:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666336:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666343:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.666347:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666356:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666374:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.666386:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d3fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70242304->70246399] (req 70242304->70246399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.666499:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565424768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9535us (10512us total) trans 4294984457 rc 0/0 00000100:00100000:1.0:1789760774.666511:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17160 00000100:00100000:1.0:1789760774.666521:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712906301187 time 712917237476 state 0x2 ref 0 00000100:00100000:3.0:1789760774.671470:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.674356:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565424896 00000100:00100000:1.0:1789760774.674381:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565424896 00000100:00100000:1.0:1789760774.674487:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712906301187 time 712917237476 state 0x0 ref 1 00000100:00100000:1.0:1789760774.674507:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712917497892 time 712917237476 state 0x1 ref 1 00000100:00100000:1.0:1789760774.674547:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712917497892 time 712934838287 state 0x0 ref 1 00000100:00100000:1.0:1789760774.674564:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.674634:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70246400, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21808 00010000:00010000:1.0:1789760774.674646:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.674668:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.674674:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.674683:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.674744:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.679837:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984458 is committed 00002000:00010000:2.0:1789760774.686083:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70246400 -> 70250496 00002000:00010000:2.0:1789760774.686094:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137224 -> 137232 00010000:00010000:2.0:1789760774.686177:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686191:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686206:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686215:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.686221:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686230:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686253:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.686263:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d402 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70246400->70250495] (req 70246400->70250495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.686377:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565424896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11811us (14917us total) trans 4294984458 rc 0/0 00000100:00100000:2.0:1789760774.686388:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17161 00000100:00100000:2.0:1789760774.686399:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712917497892 time 712934838287 state 0x2 ref 0 00000100:00100000:3.0:1789760774.693540:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.693773:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425024 00000100:00100000:1.0:1789760774.693783:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425024 00000100:00100000:1.0:1789760774.693838:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712917497892 time 712934838287 state 0x0 ref 1 00000100:00100000:1.0:1789760774.693854:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712935098703 time 712934838287 state 0x1 ref 1 00000100:00100000:1.0:1789760774.693950:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712935098703 time 712954241239 state 0x0 ref 1 00000100:00100000:1.0:1789760774.693964:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.694008:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70250496, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21810 00010000:00010000:1.0:1789760774.694017:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.694033:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1789760774.694036:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.694042:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.694057:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.701976:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984459 is committed 00002000:00010000:2.0:1789760774.702246:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70250496 -> 70254592 00002000:00010000:2.0:1789760774.702252:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137232 -> 137240 00010000:00010000:2.0:1789760774.702264:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702282:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702292:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702300:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.702305:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702314:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702334:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.702341:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d409 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70250496->70254591] (req 70250496->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.702494:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8527us (9080us total) trans 4294984459 rc 0/0 00000100:00100000:2.0:1789760774.702506:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17162 00000100:00100000:2.0:1789760774.702515:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712935098703 time 712954241239 state 0x2 ref 0 00000100:00100000:1.0:1789760774.710353:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.710900:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425152 00000100:00100000:2.0:1789760774.710911:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425152 00000100:00100000:2.0:1789760774.710964:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712935098703 time 712954241239 state 0x0 ref 1 00000100:00100000:2.0:1789760774.710980:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712954501655 time 712954241239 state 0x1 ref 1 00000100:00100000:2.0:1789760774.711282:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712954501655 time 712971572758 state 0x0 ref 1 00000100:00100000:2.0:1789760774.711297:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.711345:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70254592, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21818 00010000:00010000:2.0:1789760774.711355:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.711369:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1789760774.711374:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.711381:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.712039:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.721248:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984460 is committed 00002000:00010000:1.0:1789760774.721408:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70254592 -> 70258688 00002000:00010000:1.0:1789760774.721414:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137240 -> 137248 00010000:00010000:1.0:1789760774.721427:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721440:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721450:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721458:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.721463:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721472:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721491:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.721499:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d410 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->70258687] (req 70254592->70258687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.721778:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10478us (11428us total) trans 4294984460 rc 0/0 00000100:00100000:1.0:1789760774.721796:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17163 00000100:00100000:1.0:1789760774.721806:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712954501655 time 712971572758 state 0x2 ref 0 00000100:00100000:2.0:1789760774.738949:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.741035:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425280 00000100:00100000:0.0:1789760774.741051:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425280 00000100:00100000:0.0:1789760774.741120:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712954501655 time 712971572758 state 0x0 ref 1 00000100:00100000:0.0:1789760774.741137:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712971833174 time 712971572758 state 0x1 ref 1 00000100:00100000:0.0:1789760774.741167:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712971833174 time 713001458815 state 0x0 ref 1 00000100:00100000:0.0:1789760774.741183:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.741235:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70258688, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21820 00010000:00010000:0.0:1789760774.741245:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.741260:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1789760774.741265:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.741272:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.741288:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.749557:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984461 is committed 00002000:00010000:2.0:1789760774.749774:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70258688 -> 70262784 00002000:00010000:2.0:1789760774.749781:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137248 -> 137256 00010000:00010000:2.0:1789760774.749795:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749809:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749819:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749827:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.749832:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749842:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749864:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.749873:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674d417 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70258688->70262783] (req 70258688->70262783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.749969:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565425280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8784us (11027us total) trans 4294984461 rc 0/0 00000100:00100000:2.0:1789760774.749980:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17164 00000100:00100000:2.0:1789760774.749990:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712971833174 time 713001458815 state 0x2 ref 0 00000100:00100000:3.0:1789760774.760013:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.760233:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425408 00000100:00100000:2.0:1789760774.760244:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425408 00000100:00100000:2.0:1789760774.760300:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 712971833174 time 713001458815 state 0x0 ref 1 00000100:00100000:2.0:1789760774.760315:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713001719231 time 713001458815 state 0x1 ref 1 00000100:00100000:2.0:1789760774.760347:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713001719231 time 713020639471 state 0x0 ref 1 00000100:00100000:2.0:1789760774.760359:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565425408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.760403:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70262784, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21828 00010000:00010000:2.0:1789760774.760412:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.760427:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760774.760431:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.760437:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.760453:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.774941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984462 is committed 00002000:00010000:1.0:1789760774.783291:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70262784 -> 70266880 00002000:00010000:1.0:1789760774.783302:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137256 -> 137264 00010000:00010000:1.0:1789760774.783315:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783328:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783337:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783345:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.783350:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783358:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783377:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.783384:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d41e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70262784->70266879] (req 70262784->70266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.783487:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565425408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 23125us (23479us total) trans 4294984462 rc 0/0 00000100:00100000:1.0:1789760774.783500:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17165 00000100:00100000:1.0:1789760774.783509:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713001719231 time 713020639471 state 0x2 ref 0 00000100:00100000:1.0:1789760774.791939:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.792182:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425536 00000100:00100000:2.0:1789760774.792192:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425536 00000100:00100000:2.0:1789760774.792252:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713001719231 time 713020639471 state 0x0 ref 1 00000100:00100000:2.0:1789760774.792266:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713020899887 time 713020639471 state 0x1 ref 1 00000100:00100000:2.0:1789760774.792303:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713020899887 time 713052594464 state 0x0 ref 1 00000100:00100000:2.0:1789760774.792315:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.792362:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70266880, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21830 00010000:00010000:2.0:1789760774.792372:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.792388:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760774.792392:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.792399:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.792414:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.798345:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984463 is committed 00002000:00010000:2.0:1789760774.798462:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70266880 -> 70270976 00002000:00010000:2.0:1789760774.798468:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137264 -> 137272 00010000:00010000:2.0:1789760774.798481:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798493:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798502:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798510:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.798515:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798530:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798550:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.798558:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d425 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70266880->70270975] (req 70266880->70270975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.798917:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6598us (6981us total) trans 4294984463 rc 0/0 00000100:00100000:2.0:1789760774.798932:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17166 00000100:00100000:2.0:1789760774.798943:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713020899887 time 713052594464 state 0x2 ref 0 00000100:00100000:2.0:1789760774.807581:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.807767:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425664 00000100:00100000:0.0:1789760774.807776:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425664 00000100:00100000:0.0:1789760774.807832:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713020899887 time 713052594464 state 0x0 ref 1 00000100:00100000:0.0:1789760774.807847:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713052854880 time 713052594464 state 0x1 ref 1 00000100:00100000:0.0:1789760774.807878:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713052854880 time 713068170104 state 0x0 ref 1 00000100:00100000:0.0:1789760774.807892:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.807938:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70270976, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21838 00010000:00010000:0.0:1789760774.807947:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.807964:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1789760774.807969:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.807976:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.807991:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.814932:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984464 is committed 00002000:00010000:0.0:1789760774.816389:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70270976 -> 70275072 00002000:00010000:0.0:1789760774.816399:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137272 -> 137280 00010000:00010000:0.0:1789760774.816417:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816433:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816443:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816451:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760774.816457:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816468:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816497:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.816507:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d42c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70270976->70275071] (req 70270976->70275071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.816643:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8747us (9065us total) trans 4294984464 rc 0/0 00000100:00100000:0.0:1789760774.816654:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17167 00000100:00100000:0.0:1789760774.816664:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713052854880 time 713068170104 state 0x2 ref 0 00000100:00100000:3.0:1789760774.825245:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.825424:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425792 00000100:00100000:1.0:1789760774.825434:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425792 00000100:00100000:1.0:1789760774.825485:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713052854880 time 713068170104 state 0x0 ref 1 00000100:00100000:1.0:1789760774.825499:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713068430520 time 713068170104 state 0x1 ref 1 00000100:00100000:1.0:1789760774.825529:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713068430520 time 713085821256 state 0x0 ref 1 00000100:00100000:1.0:1789760774.825542:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.825588:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70275072, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21840 00010000:00010000:1.0:1789760774.825598:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.825614:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.825619:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.825625:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.825641:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.831359:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984465 is committed 00002000:00010000:1.0:1789760774.831489:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70275072 -> 70279168 00002000:00010000:1.0:1789760774.831495:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137280 -> 137288 00010000:00010000:1.0:1789760774.831510:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831523:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831531:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831539:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.831544:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831555:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831575:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.831582:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674d433 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70275072->70279167] (req 70275072->70279167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.831676:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6132us (6436us total) trans 4294984465 rc 0/0 00000100:00100000:1.0:1789760774.831688:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17168 00000100:00100000:1.0:1789760774.831697:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713068430520 time 713085821256 state 0x2 ref 0 00000100:00100000:1.0:1789760774.838368:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.838431:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565425920 00000100:00100000:2.0:1789760774.838440:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565425920 00000100:00100000:2.0:1789760774.838496:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713068430520 time 713085821256 state 0x0 ref 1 00000100:00100000:2.0:1789760774.838512:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713086081672 time 713085821256 state 0x1 ref 1 00000100:00100000:2.0:1789760774.838542:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713086081672 time 713098834261 state 0x0 ref 1 00000100:00100000:2.0:1789760774.838556:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.838604:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70279168, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21848 00010000:00010000:2.0:1789760774.838613:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.838628:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760774.838632:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.838651:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.838665:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.843512:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984466 is committed 00002000:00010000:2.0:1789760774.843644:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70279168 -> 70283264 00002000:00010000:2.0:1789760774.843649:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137288 -> 137296 00010000:00010000:2.0:1789760774.843662:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843676:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843685:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843693:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.843698:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843733:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843765:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.843774:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70279168->70283263] (req 70279168->70283263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.843916:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565425920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5360us (5552us total) trans 4294984466 rc 0/0 00000100:00100000:2.0:1789760774.843924:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17169 00000100:00100000:2.0:1789760774.843931:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713086081672 time 713098834261 state 0x2 ref 0 00000100:00100000:2.0:1789760774.849083:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760774.849255:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426048 00000100:00100000:0.0:1789760774.849265:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426048 00000100:00100000:0.0:1789760774.849320:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713086081672 time 713098834261 state 0x0 ref 1 00000100:00100000:0.0:1789760774.849335:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713099094677 time 713098834261 state 0x1 ref 1 00000100:00100000:0.0:1789760774.849367:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713099094677 time 713109659056 state 0x0 ref 1 00000100:00100000:0.0:1789760774.849381:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760774.849441:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70283264, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21850 00010000:00010000:0.0:1789760774.849450:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.849472:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1789760774.849477:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760774.849483:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.849498:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.860322:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984467 is committed 00002000:00010000:2.0:1789760774.860567:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70283264 -> 70287360 00002000:00010000:2.0:1789760774.860573:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137296 -> 137304 00010000:00010000:2.0:1789760774.860586:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860599:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860609:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860622:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.860627:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860636:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860772:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.860789:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674d441 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70283264->70287359] (req 70283264->70287359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.860881:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11499us (11803us total) trans 4294984467 rc 0/0 00000100:00100000:2.0:1789760774.860895:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17170 00000100:00100000:2.0:1789760774.860905:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713099094677 time 713109659056 state 0x2 ref 0 00000100:00100000:3.0:1789760774.865662:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.865803:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426176 00000100:00100000:1.0:1789760774.865812:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426176 00000100:00100000:1.0:1789760774.865872:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713099094677 time 713109659056 state 0x0 ref 1 00000100:00100000:1.0:1789760774.865887:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713109919472 time 713109659056 state 0x1 ref 1 00000100:00100000:1.0:1789760774.865915:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713109919472 time 713126207354 state 0x0 ref 1 00000100:00100000:1.0:1789760774.865925:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.865969:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70287360, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21858 00010000:00010000:1.0:1789760774.865978:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.865992:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.865996:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.866002:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.866017:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760774.870657:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984468 is committed 00002000:00010000:1.0:1789760774.870969:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70287360 -> 70291456 00002000:00010000:1.0:1789760774.870974:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137304 -> 137312 00010000:00010000:1.0:1789760774.870987:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871001:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871010:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871017:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.871022:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871031:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871050:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.871058:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d448 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70287360->70291455] (req 70287360->70291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.871197:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5267us (5539us total) trans 4294984468 rc 0/0 00000100:00100000:1.0:1789760774.871208:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17171 00000100:00100000:1.0:1789760774.871222:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713109919472 time 713126207354 state 0x2 ref 0 00000100:00100000:1.0:1789760774.876164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.876243:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426304 00000100:00100000:2.0:1789760774.876254:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426304 00000100:00100000:2.0:1789760774.876306:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713109919472 time 713126207354 state 0x0 ref 1 00000100:00100000:2.0:1789760774.876320:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713126467770 time 713126207354 state 0x1 ref 1 00000100:00100000:2.0:1789760774.876353:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713126467770 time 713136645250 state 0x0 ref 1 00000100:00100000:2.0:1789760774.876367:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565426304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.876412:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70291456, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21860 00010000:00010000:2.0:1789760774.876421:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.876437:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760774.876441:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.876446:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.876459:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.883873:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984469 is committed 00002000:00010000:2.0:1789760774.888175:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70291456 -> 70295552 00002000:00010000:2.0:1789760774.888205:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137312 -> 137320 00010000:00010000:2.0:1789760774.888221:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888235:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888244:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888251:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.888257:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888266:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888287:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.888295:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d44f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70291456->70295551] (req 70291456->70295551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.888577:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565426304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12025us (12234us total) trans 4294984469 rc 0/0 00000100:00100000:2.0:1789760774.888589:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17172 00000100:00100000:2.0:1789760774.888599:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713126467770 time 713136645250 state 0x2 ref 0 00000100:00100000:2.0:1789760774.893685:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.894271:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426432 00000100:00100000:1.0:1789760774.894281:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426432 00000100:00100000:1.0:1789760774.894338:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713126467770 time 713136645250 state 0x0 ref 1 00000100:00100000:1.0:1789760774.894356:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713136905666 time 713136645250 state 0x1 ref 1 00000100:00100000:1.0:1789760774.894387:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713136905666 time 713154678776 state 0x0 ref 1 00000100:00100000:1.0:1789760774.894400:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.894459:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70295552, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21868 00010000:00010000:1.0:1789760774.894468:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.894483:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.894488:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.894494:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.894518:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760774.902957:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984470 is committed 00002000:00010000:1.0:1789760774.903134:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70295552 -> 70299648 00002000:00010000:1.0:1789760774.903139:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137320 -> 137328 00010000:00010000:1.0:1789760774.903153:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903171:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903179:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903186:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760774.903191:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903199:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903218:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.903227:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d456 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70295552->70299647] (req 70295552->70299647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.903415:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9012us (9739us total) trans 4294984470 rc 0/0 00000100:00100000:1.0:1789760774.903425:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17173 00000100:00100000:1.0:1789760774.903434:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713136905666 time 713154678776 state 0x2 ref 0 00000100:00100000:3.0:1789760774.912319:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.912465:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426560 00000100:00100000:1.0:1789760774.912475:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426560 00000100:00100000:1.0:1789760774.912535:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713136905666 time 713154678776 state 0x0 ref 1 00000100:00100000:1.0:1789760774.912551:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713154939192 time 713154678776 state 0x1 ref 1 00000100:00100000:1.0:1789760774.912644:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713154939192 time 713172926075 state 0x0 ref 1 00000100:00100000:1.0:1789760774.912659:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.912767:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70299648, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21870 00010000:00010000:1.0:1789760774.912777:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.912793:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.912798:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.912804:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.912818:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.924105:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580065408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924176:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760774.924229:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580065152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760774.924237:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580065920:0@lo:400:kworker.0 00000100:00100000:1.0:1789760774.924276:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760774.924282:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760774.924304:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580065664:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924318:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789760774.924327:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580065280:0@lo:400:kworker.0 00000100:00100000:1.0:1789760774.924334:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760774.924362:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760774.924367:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760774.924372:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3457:1876699580065536:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924400:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580065792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760774.924417:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760774.924435:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789760774.924477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984471 is committed 00000100:00100000:0.0:1789760774.924478:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065920 00000100:00100000:0.0:1789760774.924487:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065920 00000100:00100000:0.0:1789760774.924550:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065664 00000100:00100000:0.0:1789760774.924553:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065664 00000100:00100000:0.0:1789760774.924582:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760774.924590:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580065920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924644:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580065920:12345-0@lo:400:kworker.0 Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.924654:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760774.924672:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789760774.924679:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580065664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924737:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580065664:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.924743:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789760774.924782:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065280 00000100:00100000:0.0:1789760774.924786:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065280 00000100:00100000:0.0:1789760774.924813:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789760774.924820:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580065280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.924863:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580065280:12345-0@lo:400:kworker.0 Request processed in 43us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.924870:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789760774.924898:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065408 00000100:00100000:0.0:1789760774.924901:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065408 00000100:00100000:0.0:1789760774.924925:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065536 00000100:00100000:0.0:1789760774.924928:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065536 00000100:00100000:0.0:1789760774.924947:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065792 00000100:00100000:0.0:1789760774.924950:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065792 00000100:00100000:0.0:1789760774.924965:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789760774.924972:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580065408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925015:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580065408:12345-0@lo:400:kworker.0 Request processed in 43us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.925021:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789760774.925033:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789760774.925040:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1876699580065536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925069:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1876699580065536:12345-0@lo:400:kworker.0 Request processed in 30us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.925075:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789760774.925086:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789760774.925093:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580065792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925120:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580065792:12345-0@lo:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.925126:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00080000:0.0:1789760774.925145:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760774.925150:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760774.925152:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789760774.925446:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70299648 -> 70303744 00000100:00100000:0.0:1789760774.925451:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3457:1876699580065536:0@lo:400:kworker.0 00002000:00010000:1.0:1789760774.925452:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137328 -> 137336 00010000:00010000:1.0:1789760774.925468:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.925470:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580065664:0@lo:400:kworker.0 00010000:00010000:1.0:1789760774.925485:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.925495:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.925504:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00000100:00100000:0.0:1789760774.925505:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580065280:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925518:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580065792:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925527:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580065408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760774.925537:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580065920:0@lo:400:kworker.0 00010000:00010000:1.0:1789760774.925629:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.925642:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.925662:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.925671:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d45d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70299648->70303743] (req 70299648->70303743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.925888:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565426560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13118us (13465us total) trans 4294984471 rc 0/0 00000100:00100000:1.0:1789760774.925901:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17174 00000100:00100000:1.0:1789760774.925911:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713154939192 time 713172926075 state 0x2 ref 0 00000100:00100000:3.0:1789760774.926263:0:13530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580065152 00000100:00100000:3.0:1789760774.926269:0:13530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580065152 00000100:00100000:3.0:1789760774.926310:0:13530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789760774.926320:0:13530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580065152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760774.926343:0:13530:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760774.926398:0:13530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580065152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760774.926404:0:13530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789760774.928427:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.928666:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426688 00000100:00100000:3.0:1789760774.928683:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426688 00000100:00100000:3.0:1789760774.928885:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713154939192 time 713172926075 state 0x0 ref 1 00000100:00100000:3.0:1789760774.928903:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713173186491 time 713172926075 state 0x1 ref 1 00000100:00100000:3.0:1789760774.928938:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713173186491 time 713189228902 state 0x0 ref 1 00000100:00100000:3.0:1789760774.928956:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565426688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.929014:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70303744, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0x21878 00010000:00010000:3.0:1789760774.929104:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.929125:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760774.929130:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.929369:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.929390:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.929573:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580065152:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789760774.936419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984472 is committed 00002000:00010000:3.0:1789760774.936536:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70303744 -> 70307840 00002000:00010000:3.0:1789760774.936541:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760774 -> 1789760775 00002000:00010000:3.0:1789760774.936544:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760774 -> 1789760775 00002000:00010000:3.0:1789760774.936546:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137336 -> 137344 00010000:00010000:3.0:1789760774.936560:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936572:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936581:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936589:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.936593:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936602:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936621:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.936630:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d464 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70303744->70307839] (req 70303744->70307839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.936826:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565426688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7870us (8399us total) trans 4294984472 rc 0/0 00000100:00100000:3.0:1789760774.936841:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17175 00000100:00100000:3.0:1789760774.936852:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713173186491 time 713189228902 state 0x2 ref 0 00000100:00100000:2.0:1789760774.940527:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.940793:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426816 00000100:00100000:1.0:1789760774.940803:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426816 00000100:00100000:1.0:1789760774.940855:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713173186491 time 713189228902 state 0x0 ref 1 00000100:00100000:1.0:1789760774.940869:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713189489318 time 713189228902 state 0x1 ref 1 00000100:00100000:1.0:1789760774.940900:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713189489318 time 713201192439 state 0x0 ref 1 00000100:00100000:1.0:1789760774.940911:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565426816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.940957:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70307840, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21880 00010000:00010000:1.0:1789760774.940966:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.940980:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.940985:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.940991:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.941003:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.949508:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984473 is committed 00002000:00010000:2.0:1789760774.950234:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70307840 -> 70311936 00002000:00010000:2.0:1789760774.950240:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137344 -> 137352 00010000:00010000:2.0:1789760774.950253:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.950267:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.950282:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.950291:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.950296:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.950306:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.952238:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.952259:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674d46b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70307840->70311935] (req 70307840->70311935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.952495:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565426816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11582us (11986us total) trans 4294984473 rc 0/0 00000100:00100000:2.0:1789760774.952507:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17176 00000100:00100000:2.0:1789760774.952517:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713189489318 time 713201192439 state 0x2 ref 0 00000100:00100000:0.0:1789760774.963246:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760774.963429:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565426944 00000100:00100000:1.0:1789760774.963439:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565426944 00000100:00100000:1.0:1789760774.963496:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713189489318 time 713201192439 state 0x0 ref 1 00000100:00100000:1.0:1789760774.963511:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713201452855 time 713201192439 state 0x1 ref 1 00000100:00100000:1.0:1789760774.963545:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713201452855 time 713223837543 state 0x0 ref 1 00000100:00100000:1.0:1789760774.963557:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565426944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760774.963605:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70311936, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21888 00010000:00010000:1.0:1789760774.963613:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.963628:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760774.963631:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760774.963637:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.963650:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.974206:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984474 is committed 00002000:00010000:2.0:1789760774.974414:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70311936 -> 70316032 00002000:00010000:2.0:1789760774.974420:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137352 -> 137360 00010000:00010000:2.0:1789760774.974433:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974451:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974461:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974468:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760774.974473:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974481:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974501:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.974509:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674d472 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70311936->70316031] (req 70311936->70316031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.974609:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565426944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11050us (11367us total) trans 4294984474 rc 0/0 00000100:00100000:2.0:1789760774.974619:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17177 00000100:00100000:2.0:1789760774.974629:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713201452855 time 713223837543 state 0x2 ref 0 00000100:00100000:1.0:1789760774.979783:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760774.979881:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427072 00000100:00100000:3.0:1789760774.979891:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427072 00000100:00100000:3.0:1789760774.979958:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713201452855 time 713223837543 state 0x0 ref 1 00000100:00100000:3.0:1789760774.979973:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713224097959 time 713223837543 state 0x1 ref 1 00000100:00100000:3.0:1789760774.979995:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713224097959 time 713240287683 state 0x0 ref 1 00000100:00100000:3.0:1789760774.980007:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760774.980066:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70316032, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21890 00010000:00010000:3.0:1789760774.980076:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.980093:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760774.980097:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.980112:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.980126:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.989038:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984475 is committed 00002000:00010000:3.0:1789760774.990440:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70316032 -> 70320128 00002000:00010000:3.0:1789760774.990449:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137360 -> 137368 00010000:00010000:3.0:1789760774.990462:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990475:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990485:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990492:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760774.990497:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990506:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990526:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.990533:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70316032->70320127] (req 70316032->70320127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760774.990697:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10687us (10918us total) trans 4294984475 rc 0/0 00000100:00100000:3.0:1789760774.990762:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17178 00000100:00100000:3.0:1789760774.990772:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713224097959 time 713240287683 state 0x2 ref 0 00000100:00100000:3.0:1789760774.996400:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760774.996481:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427200 00000100:00100000:2.0:1789760774.996492:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427200 00000100:00100000:2.0:1789760774.996547:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713224097959 time 713240287683 state 0x0 ref 1 00000100:00100000:2.0:1789760774.996562:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713240548099 time 713240287683 state 0x1 ref 1 00000100:00100000:2.0:1789760774.996588:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713240548099 time 713256880509 state 0x0 ref 1 00000100:00100000:2.0:1789760774.996601:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565427200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760774.996650:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70320128, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21898 00010000:00010000:2.0:1789760774.996660:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.996675:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760774.996680:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.996686:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.996701:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.007240:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984476 is committed 00002000:00010000:2.0:1789760775.007373:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70320128 -> 70324224 00002000:00010000:2.0:1789760775.007378:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137368 -> 137376 00010000:00010000:2.0:1789760775.007391:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007403:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007416:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007424:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.007429:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007437:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007456:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.007464:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d480 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70320128->70324223] (req 70320128->70324223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.007560:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565427200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10957us (11165us total) trans 4294984476 rc 0/0 00000100:00100000:2.0:1789760775.007571:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17179 00000100:00100000:2.0:1789760775.007580:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713240548099 time 713256880509 state 0x2 ref 0 00000100:00100000:0.0:1789760775.011463:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.011549:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427328 00000100:00100000:2.0:1789760775.011558:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427328 00000100:00100000:2.0:1789760775.011610:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713240548099 time 713256880509 state 0x0 ref 1 00000100:00100000:2.0:1789760775.011626:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713257140925 time 713256880509 state 0x1 ref 1 00000100:00100000:2.0:1789760775.011650:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713257140925 time 713271942611 state 0x0 ref 1 00000100:00100000:2.0:1789760775.011662:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.011760:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70324224, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218a0 00010000:00010000:2.0:1789760775.011773:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.011788:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.011792:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.011799:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.011813:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.018148:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984477 is committed 00002000:00010000:2.0:1789760775.018362:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70324224 -> 70328320 00002000:00010000:2.0:1789760775.018368:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137376 -> 137384 00010000:00010000:2.0:1789760775.018382:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018595:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018608:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018622:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.018627:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018638:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018660:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.018668:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70324224->70328319] (req 70324224->70328319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.019051:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7385us (7592us total) trans 4294984477 rc 0/0 00000100:00100000:2.0:1789760775.019062:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17180 00000100:00100000:2.0:1789760775.019073:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713257140925 time 713271942611 state 0x2 ref 0 00000100:00100000:1.0:1789760775.037688:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.038570:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427456 00000100:00100000:3.0:1789760775.038580:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427456 00000100:00100000:3.0:1789760775.038641:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713257140925 time 713271942611 state 0x0 ref 1 00000100:00100000:3.0:1789760775.038657:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713272203027 time 713271942611 state 0x1 ref 1 00000100:00100000:3.0:1789760775.038699:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713272203027 time 713298990687 state 0x0 ref 1 00000100:00100000:3.0:1789760775.038736:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.038794:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70328320, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218a8 00010000:00010000:3.0:1789760775.038804:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.038819:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.038824:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.038830:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.038844:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.046810:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984478 is committed 00002000:00010000:3.0:1789760775.047000:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70328320 -> 70332416 00002000:00010000:3.0:1789760775.047005:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137384 -> 137392 00010000:00010000:3.0:1789760775.047019:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047036:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047045:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047053:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.047058:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047067:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047086:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.047151:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d48e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70328320->70332415] (req 70328320->70332415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.047289:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8551us (9606us total) trans 4294984478 rc 0/0 00000100:00100000:3.0:1789760775.047300:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17181 00000100:00100000:3.0:1789760775.047310:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713272203027 time 713298990687 state 0x2 ref 0 00000100:00100000:3.0:1789760775.052421:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.052646:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427584 00000100:00100000:2.0:1789760775.052655:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427584 00000100:00100000:2.0:1789760775.054096:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713272203027 time 713298990687 state 0x0 ref 1 00000100:00100000:2.0:1789760775.054114:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713299251103 time 713298990687 state 0x1 ref 1 00000100:00100000:2.0:1789760775.054145:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713299251103 time 713314437076 state 0x0 ref 1 00000100:00100000:2.0:1789760775.054235:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565427584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.054285:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70332416, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218b0 00010000:00010000:2.0:1789760775.054294:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.054380:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.054386:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.054393:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.054408:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.066281:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984479 is committed 00002000:00010000:2.0:1789760775.066519:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70332416 -> 70336512 00002000:00010000:2.0:1789760775.066524:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137392 -> 137400 00010000:00010000:2.0:1789760775.066537:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066555:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066564:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066572:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.066578:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066587:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066611:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.066619:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70332416->70336511] (req 70332416->70336511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.066744:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565427584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12547us (14293us total) trans 4294984479 rc 0/0 00000100:00100000:2.0:1789760775.066764:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17182 00000100:00100000:2.0:1789760775.066774:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713299251103 time 713314437076 state 0x2 ref 0 00000100:00100000:0.0:1789760775.071538:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.072497:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427712 00000100:00100000:2.0:1789760775.072510:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427712 00000100:00100000:2.0:1789760775.072575:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713299251103 time 713314437076 state 0x0 ref 1 00000100:00100000:2.0:1789760775.072591:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713314697492 time 713314437076 state 0x1 ref 1 00000100:00100000:2.0:1789760775.072629:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713314697492 time 713332919999 state 0x0 ref 1 00000100:00100000:2.0:1789760775.072641:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.072845:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70336512, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218b8 00010000:00010000:2.0:1789760775.072867:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.072884:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.072888:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.072895:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.072910:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.080262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984480 is committed 00002000:00010000:2.0:1789760775.080543:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70336512 -> 70340608 00002000:00010000:2.0:1789760775.080548:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137400 -> 137408 00010000:00010000:2.0:1789760775.080560:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080572:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080582:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080589:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.080593:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080601:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080620:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.080628:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d49c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70336512->70340607] (req 70336512->70340607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.080818:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8175us (9286us total) trans 4294984480 rc 0/0 00000100:00100000:2.0:1789760775.080829:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17183 00000100:00100000:2.0:1789760775.080838:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713314697492 time 713332919999 state 0x2 ref 0 00000100:00100000:0.0:1789760775.085921:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.086194:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427840 00000100:00100000:3.0:1789760775.086203:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427840 00000100:00100000:3.0:1789760775.086258:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713314697492 time 713332919999 state 0x0 ref 1 00000100:00100000:3.0:1789760775.086273:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713333180415 time 713332919999 state 0x1 ref 1 00000100:00100000:3.0:1789760775.086340:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713333180415 time 713346631635 state 0x0 ref 1 00000100:00100000:3.0:1789760775.086355:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.086399:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70340608, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218c0 00010000:00010000:3.0:1789760775.086408:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.086425:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.086430:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.086437:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.086451:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.093344:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984481 is committed 00002000:00010000:3.0:1789760775.093589:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70340608 -> 70344704 00002000:00010000:3.0:1789760775.093594:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137408 -> 137416 00010000:00010000:3.0:1789760775.093607:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093621:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093631:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093638:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.093644:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093801:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093822:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.093831:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70340608->70344703] (req 70340608->70344703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.093927:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565427840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7571us (8010us total) trans 4294984481 rc 0/0 00000100:00100000:3.0:1789760775.093937:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17184 00000100:00100000:3.0:1789760775.093948:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713333180415 time 713346631635 state 0x2 ref 0 00000100:00100000:3.0:1789760775.097902:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.097976:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565427968 00000100:00100000:2.0:1789760775.097986:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565427968 00000100:00100000:2.0:1789760775.098041:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713333180415 time 713346631635 state 0x0 ref 1 00000100:00100000:2.0:1789760775.098057:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713346892051 time 713346631635 state 0x1 ref 1 00000100:00100000:2.0:1789760775.098113:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713346892051 time 713358406059 state 0x0 ref 1 00000100:00100000:2.0:1789760775.098123:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565427968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.098169:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70344704, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218c8 00010000:00010000:2.0:1789760775.098179:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.098196:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.098201:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.098208:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.098223:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.103504:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984482 is committed 00002000:00010000:2.0:1789760775.103826:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70344704 -> 70348800 00002000:00010000:2.0:1789760775.103831:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137416 -> 137424 00010000:00010000:2.0:1789760775.103843:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103855:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103863:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103870:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.103874:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103883:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103903:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.103917:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70344704->70348799] (req 70344704->70348799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.104020:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565427968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5893us (6123us total) trans 4294984482 rc 0/0 00000100:00100000:2.0:1789760775.104030:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17185 00000100:00100000:2.0:1789760775.104041:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713346892051 time 713358406059 state 0x2 ref 0 00000100:00100000:1.0:1789760775.108930:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.109413:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428096 00000100:00100000:2.0:1789760775.109422:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428096 00000100:00100000:2.0:1789760775.109472:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713346892051 time 713358406059 state 0x0 ref 1 00000100:00100000:2.0:1789760775.109487:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713358666475 time 713358406059 state 0x1 ref 1 00000100:00100000:2.0:1789760775.109565:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713358666475 time 713369855416 state 0x0 ref 1 00000100:00100000:2.0:1789760775.109578:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.109621:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70348800, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218d0 00010000:00010000:2.0:1789760775.109631:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.109645:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.109649:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.109656:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.109674:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.118294:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984483 is committed 00002000:00010000:2.0:1789760775.118471:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70348800 -> 70352896 00002000:00010000:2.0:1789760775.118476:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137424 -> 137432 00010000:00010000:2.0:1789760775.118490:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118502:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118511:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118518:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.118523:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118532:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118551:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.118558:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70348800->70352895] (req 70348800->70352895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.118747:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9126us (9782us total) trans 4294984483 rc 0/0 00000100:00100000:2.0:1789760775.118768:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17186 00000100:00100000:2.0:1789760775.118778:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713358666475 time 713369855416 state 0x2 ref 0 00000100:00100000:0.0:1789760775.128489:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.128953:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428224 00000100:00100000:3.0:1789760775.128963:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428224 00000100:00100000:3.0:1789760775.129033:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713358666475 time 713369855416 state 0x0 ref 1 00000100:00100000:3.0:1789760775.129053:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713370115832 time 713369855416 state 0x1 ref 1 00000100:00100000:3.0:1789760775.129089:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713370115832 time 713389381355 state 0x0 ref 1 00000100:00100000:3.0:1789760775.129113:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565428224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.129162:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70352896, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218d8 00010000:00010000:3.0:1789760775.129172:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.129191:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.129196:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.129203:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.129218:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.136607:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984484 is committed 00002000:00010000:3.0:1789760775.136798:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70352896 -> 70356992 00002000:00010000:3.0:1789760775.136804:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137432 -> 137440 00010000:00010000:3.0:1789760775.136817:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136829:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136837:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136844:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.136849:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136858:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136877:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.136885:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70352896->70356991] (req 70352896->70356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.137436:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565428224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8321us (8951us total) trans 4294984484 rc 0/0 00000100:00100000:3.0:1789760775.137446:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17187 00000100:00100000:3.0:1789760775.137455:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713370115832 time 713389381355 state 0x2 ref 0 00000100:00100000:3.0:1789760775.142663:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.142797:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428352 00000100:00100000:2.0:1789760775.142806:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428352 00000100:00100000:2.0:1789760775.143107:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713370115832 time 713389381355 state 0x0 ref 1 00000100:00100000:2.0:1789760775.143122:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713389641771 time 713389381355 state 0x1 ref 1 00000100:00100000:2.0:1789760775.143217:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713389641771 time 713403508151 state 0x0 ref 1 00000100:00100000:2.0:1789760775.143230:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.143278:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70356992, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218e0 00010000:00010000:2.0:1789760775.143287:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.143303:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.143307:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.143314:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.143328:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.149349:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984485 is committed 00002000:00010000:2.0:1789760775.152943:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70356992 -> 70361088 00002000:00010000:2.0:1789760775.152953:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137440 -> 137448 00010000:00010000:2.0:1789760775.152967:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.152977:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.152983:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.152987:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.152991:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.152997:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.153011:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.153015:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70356992->70361087] (req 70356992->70361087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.153095:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9864us (10438us total) trans 4294984485 rc 0/0 00000100:00100000:2.0:1789760775.153103:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17188 00000100:00100000:2.0:1789760775.153110:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713389641771 time 713403508151 state 0x2 ref 0 00000100:00100000:1.0:1789760775.157110:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.157385:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428480 00000100:00100000:2.0:1789760775.157395:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428480 00000100:00100000:2.0:1789760775.157734:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713389641771 time 713403508151 state 0x0 ref 1 00000100:00100000:2.0:1789760775.157761:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713403768567 time 713403508151 state 0x1 ref 1 00000100:00100000:2.0:1789760775.157793:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713403768567 time 713418084736 state 0x0 ref 1 00000100:00100000:2.0:1789760775.157806:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565428480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.157857:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70361088, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218e8 00010000:00010000:2.0:1789760775.157867:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.157882:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.157887:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.157893:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.157907:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.162611:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984486 is committed 00002000:00010000:2.0:1789760775.162815:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70361088 -> 70365184 00002000:00010000:2.0:1789760775.162821:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137448 -> 137456 00010000:00010000:2.0:1789760775.162834:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162848:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162858:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162865:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.162870:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162879:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162897:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.162904:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70361088->70365183] (req 70361088->70365183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.163104:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565428480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5289us (5990us total) trans 4294984486 rc 0/0 00000100:00100000:2.0:1789760775.163116:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17189 00000100:00100000:2.0:1789760775.163127:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713403768567 time 713418084736 state 0x2 ref 0 00000100:00100000:0.0:1789760775.167075:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.167204:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428608 00000100:00100000:3.0:1789760775.167213:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428608 00000100:00100000:3.0:1789760775.167275:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713403768567 time 713418084736 state 0x0 ref 1 00000100:00100000:3.0:1789760775.167289:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713418345152 time 713418084736 state 0x1 ref 1 00000100:00100000:3.0:1789760775.167320:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713418345152 time 713427612193 state 0x0 ref 1 00000100:00100000:3.0:1789760775.167332:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565428608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.167379:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70365184, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218f0 00010000:00010000:3.0:1789760775.167388:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.167483:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.167489:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.167495:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.167509:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.173444:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984487 is committed 00002000:00010000:2.0:1789760775.173613:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70365184 -> 70369280 00002000:00010000:2.0:1789760775.173618:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137456 -> 137464 00010000:00010000:2.0:1789760775.173630:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173642:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173651:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173659:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.173663:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173672:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173700:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.173833:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d4cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70365184->70369279] (req 70365184->70369279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.173919:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565428608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6586us (6851us total) trans 4294984487 rc 0/0 00000100:00100000:2.0:1789760775.173934:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17190 00000100:00100000:2.0:1789760775.173943:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713418345152 time 713427612193 state 0x2 ref 0 00000100:00100000:2.0:1789760775.181165:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.181358:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428736 00000100:00100000:1.0:1789760775.181368:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428736 00000100:00100000:1.0:1789760775.181432:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713418345152 time 713427612193 state 0x0 ref 1 00000100:00100000:1.0:1789760775.181446:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713427872609 time 713427612193 state 0x1 ref 1 00000100:00100000:1.0:1789760775.181527:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713427872609 time 713441818383 state 0x0 ref 1 00000100:00100000:1.0:1789760775.181540:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565428736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.181587:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70369280, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x218f8 00010000:00010000:1.0:1789760775.181596:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.181611:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.181615:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.181620:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.181634:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.185992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984488 is committed 00002000:00010000:1.0:1789760775.187064:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70369280 -> 70373376 00002000:00010000:1.0:1789760775.187073:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137464 -> 137472 00010000:00010000:1.0:1789760775.187086:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187159:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187170:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187178:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.187183:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187193:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187213:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.187221:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674d4d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70369280->70373375] (req 70369280->70373375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.187318:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565428736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5776us (6157us total) trans 4294984488 rc 0/0 00000100:00100000:1.0:1789760775.187329:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17191 00000100:00100000:1.0:1789760775.187339:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713427872609 time 713441818383 state 0x2 ref 0 00000100:00100000:1.0:1789760775.206550:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.206745:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428864 00000100:00100000:2.0:1789760775.206764:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428864 00000100:00100000:2.0:1789760775.206828:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713427872609 time 713441818383 state 0x0 ref 1 00000100:00100000:2.0:1789760775.207357:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713442078799 time 713441818383 state 0x1 ref 1 00000100:00100000:2.0:1789760775.207393:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713442078799 time 713467684120 state 0x0 ref 1 00000100:00100000:2.0:1789760775.207407:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.207457:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70373376, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21900 00010000:00010000:2.0:1789760775.207466:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.207494:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.207499:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.207515:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.207530:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.217079:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984489 is committed 00002000:00010000:2.0:1789760775.217465:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70373376 -> 70377472 00002000:00010000:2.0:1789760775.217471:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137472 -> 137480 00010000:00010000:2.0:1789760775.217484:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217496:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217504:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217512:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.217517:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217526:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217546:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.217553:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d4db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70373376->70377471] (req 70373376->70377471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.217650:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565428864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10242us (11104us total) trans 4294984489 rc 0/0 00000100:00100000:2.0:1789760775.217662:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17192 00000100:00100000:2.0:1789760775.217672:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713442078799 time 713467684120 state 0x2 ref 0 00000100:00100000:0.0:1789760775.222306:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.222484:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565428992 00000100:00100000:2.0:1789760775.222494:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565428992 00000100:00100000:2.0:1789760775.222547:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713442078799 time 713467684120 state 0x0 ref 1 00000100:00100000:2.0:1789760775.222563:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713467944536 time 713467684120 state 0x1 ref 1 00000100:00100000:2.0:1789760775.222589:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713467944536 time 713482881431 state 0x0 ref 1 00000100:00100000:2.0:1789760775.222600:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565428992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.222647:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70377472, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21908 00010000:00010000:2.0:1789760775.222656:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.222672:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.222677:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.222683:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.222697:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.227192:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984490 is committed 00002000:00010000:2.0:1789760775.227306:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70377472 -> 70381568 00002000:00010000:2.0:1789760775.227311:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137480 -> 137488 00010000:00010000:2.0:1789760775.227336:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227350:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227360:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227367:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.227371:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227381:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227400:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.227407:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70377472->70381567] (req 70377472->70381567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.227508:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565428992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4904us (5205us total) trans 4294984490 rc 0/0 00000100:00100000:2.0:1789760775.227519:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17193 00000100:00100000:2.0:1789760775.227528:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713467944536 time 713482881431 state 0x2 ref 0 00000100:00100000:0.0:1789760775.233601:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.233866:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429120 00000100:00100000:1.0:1789760775.233876:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429120 00000100:00100000:1.0:1789760775.233935:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713467944536 time 713482881431 state 0x0 ref 1 00000100:00100000:1.0:1789760775.233951:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713483141847 time 713482881431 state 0x1 ref 1 00000100:00100000:1.0:1789760775.233972:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713483141847 time 713494264458 state 0x0 ref 1 00000100:00100000:1.0:1789760775.233984:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.234039:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70381568, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21910 00010000:00010000:1.0:1789760775.234049:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.234064:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.234070:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.234076:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.234090:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.242942:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984491 is committed 00002000:00010000:3.0:1789760775.243139:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70381568 -> 70385664 00002000:00010000:3.0:1789760775.243144:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137488 -> 137496 00010000:00010000:3.0:1789760775.243157:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243170:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243180:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243188:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.243193:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243204:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243235:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.243244:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d4e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70381568->70385663] (req 70381568->70385663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.243628:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9639us (10031us total) trans 4294984491 rc 0/0 00000100:00100000:3.0:1789760775.243639:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17194 00000100:00100000:3.0:1789760775.243648:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713483141847 time 713494264458 state 0x2 ref 0 00000100:00100000:1.0:1789760775.248879:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.248974:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429248 00000100:00100000:2.0:1789760775.248983:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429248 00000100:00100000:2.0:1789760775.249035:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713483141847 time 713494264458 state 0x0 ref 1 00000100:00100000:2.0:1789760775.249050:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713494524874 time 713494264458 state 0x1 ref 1 00000100:00100000:2.0:1789760775.249081:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713494524874 time 713509373522 state 0x0 ref 1 00000100:00100000:2.0:1789760775.249094:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.249140:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70385664, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21918 00010000:00010000:2.0:1789760775.249149:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.249164:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.249168:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.249175:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.249189:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.252992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984492 is committed 00002000:00010000:2.0:1789760775.253326:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70385664 -> 70389760 00002000:00010000:2.0:1789760775.253331:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137496 -> 137504 00010000:00010000:2.0:1789760775.253344:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253363:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253372:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253380:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.253386:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253395:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253414:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.253422:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70385664->70389759] (req 70385664->70389759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.253510:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4413us (4635us total) trans 4294984492 rc 0/0 00000100:00100000:2.0:1789760775.253521:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17195 00000100:00100000:2.0:1789760775.253531:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713494524874 time 713509373522 state 0x2 ref 0 00000100:00100000:0.0:1789760775.260573:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.260942:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429376 00000100:00100000:2.0:1789760775.260953:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429376 00000100:00100000:2.0:1789760775.261011:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713494524874 time 713509373522 state 0x0 ref 1 00000100:00100000:2.0:1789760775.261026:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713509633938 time 713509373522 state 0x1 ref 1 00000100:00100000:2.0:1789760775.261047:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713509633938 time 713521339837 state 0x0 ref 1 00000100:00100000:2.0:1789760775.261058:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.261115:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70389760, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21920 00010000:00010000:2.0:1789760775.261124:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.261139:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.261144:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.261151:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.261167:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.265973:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984493 is committed 00002000:00010000:2.0:1789760775.266089:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70389760 -> 70393856 00002000:00010000:2.0:1789760775.266150:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137504 -> 137512 00010000:00010000:2.0:1789760775.266165:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266178:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266193:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266201:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.266206:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266216:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266235:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.266244:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d4f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70389760->70393855] (req 70389760->70393855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.266372:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5309us (5803us total) trans 4294984493 rc 0/0 00000100:00100000:2.0:1789760775.266383:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17196 00000100:00100000:2.0:1789760775.266392:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713509633938 time 713521339837 state 0x2 ref 0 00000100:00100000:0.0:1789760775.270954:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.271029:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429504 00000100:00100000:3.0:1789760775.271039:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429504 00000100:00100000:3.0:1789760775.271092:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713509633938 time 713521339837 state 0x0 ref 1 00000100:00100000:3.0:1789760775.271113:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713521600253 time 713521339837 state 0x1 ref 1 00000100:00100000:3.0:1789760775.271145:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713521600253 time 713531436569 state 0x0 ref 1 00000100:00100000:3.0:1789760775.271157:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.271206:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70393856, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21928 00010000:00010000:3.0:1789760775.271217:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.271232:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.271236:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.271243:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.271258:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.274529:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984494 is committed 00002000:00010000:3.0:1789760775.275872:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70393856 -> 70397952 00002000:00010000:3.0:1789760775.275883:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137512 -> 137520 00010000:00010000:3.0:1789760775.275899:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275912:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275920:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275927:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.275932:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275941:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275974:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.275982:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d4fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70393856->70397951] (req 70393856->70397951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.276150:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4990us (5202us total) trans 4294984494 rc 0/0 00000100:00100000:3.0:1789760775.276161:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17197 00000100:00100000:3.0:1789760775.276171:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713521600253 time 713531436569 state 0x2 ref 0 00000100:00100000:1.0:1789760775.280080:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.280238:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429632 00000100:00100000:2.0:1789760775.280248:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429632 00000100:00100000:2.0:1789760775.280299:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713521600253 time 713531436569 state 0x0 ref 1 00000100:00100000:2.0:1789760775.280314:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713531696985 time 713531436569 state 0x1 ref 1 00000100:00100000:2.0:1789760775.280383:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713531696985 time 713540673637 state 0x0 ref 1 00000100:00100000:2.0:1789760775.280396:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.280441:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70397952, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21930 00010000:00010000:2.0:1789760775.280449:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.280464:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.280468:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.280475:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.280489:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.286377:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984495 is committed 00002000:00010000:1.0:1789760775.286484:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70397952 -> 70402048 00002000:00010000:1.0:1789760775.286490:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137520 -> 137528 00010000:00010000:1.0:1789760775.286503:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286517:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286527:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286534:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.286539:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286549:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286569:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.286583:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d505 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70397952->70402047] (req 70397952->70402047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.286679:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565429632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6280us (6602us total) trans 4294984495 rc 0/0 00000100:00100000:1.0:1789760775.286698:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17198 00000100:00100000:1.0:1789760775.286724:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713531696985 time 713540673637 state 0x2 ref 0 00000100:00100000:0.0:1789760775.290517:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.290621:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429760 00000100:00100000:2.0:1789760775.290631:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429760 00000100:00100000:2.0:1789760775.290687:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713531696985 time 713540673637 state 0x0 ref 1 00000100:00100000:2.0:1789760775.290828:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713540934053 time 713540673637 state 0x1 ref 1 00000100:00100000:2.0:1789760775.290895:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713540934053 time 713551185621 state 0x0 ref 1 00000100:00100000:2.0:1789760775.290909:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.290960:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70402048, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21938 00010000:00010000:2.0:1789760775.290969:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.290985:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.290990:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.290996:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.291010:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.295812:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984496 is committed 00002000:00010000:2.0:1789760775.295996:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70402048 -> 70406144 00002000:00010000:2.0:1789760775.296002:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137528 -> 137536 00010000:00010000:2.0:1789760775.296015:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296028:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296037:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296045:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.296050:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296065:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296084:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.296092:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d50c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70402048->70406143] (req 70402048->70406143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.296278:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5366us (5764us total) trans 4294984496 rc 0/0 00000100:00100000:2.0:1789760775.296289:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17199 00000100:00100000:2.0:1789760775.296297:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713540934053 time 713551185621 state 0x2 ref 0 00000100:00100000:0.0:1789760775.300027:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.300189:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565429888 00000100:00100000:3.0:1789760775.300199:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565429888 00000100:00100000:3.0:1789760775.300257:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713540934053 time 713551185621 state 0x0 ref 1 00000100:00100000:3.0:1789760775.300274:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713551446037 time 713551185621 state 0x1 ref 1 00000100:00100000:3.0:1789760775.300336:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713551446037 time 713560627291 state 0x0 ref 1 00000100:00100000:3.0:1789760775.300349:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.300398:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70406144, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21940 00010000:00010000:3.0:1789760775.300408:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.300424:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.300429:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.300436:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.300451:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.304034:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984497 is committed 00002000:00010000:0.0:1789760775.312672:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70406144 -> 70410240 00002000:00010000:0.0:1789760775.312683:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137536 -> 137544 00010000:00010000:0.0:1789760775.312850:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312865:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312873:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312880:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.312885:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312893:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312914:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.312922:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d513 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70406144->70410239] (req 70406144->70410239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.313062:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565429888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12710us (13044us total) trans 4294984497 rc 0/0 00000100:00100000:0.0:1789760775.313074:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17200 00000100:00100000:0.0:1789760775.313084:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713551446037 time 713560627291 state 0x2 ref 0 00000100:00100000:1.0:1789760775.320976:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.321739:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430016 00000100:00100000:2.0:1789760775.321759:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430016 00000100:00100000:2.0:1789760775.321815:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713551446037 time 713560627291 state 0x0 ref 1 00000100:00100000:2.0:1789760775.321830:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713560887707 time 713560627291 state 0x1 ref 1 00000100:00100000:2.0:1789760775.321861:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713560887707 time 713582153535 state 0x0 ref 1 00000100:00100000:2.0:1789760775.321874:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.321917:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70410240, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21948 00010000:00010000:2.0:1789760775.321927:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.321943:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.321948:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.321954:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.321968:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.326616:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984498 is committed 00002000:00010000:2.0:1789760775.326794:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70410240 -> 70414336 00002000:00010000:2.0:1789760775.326799:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137544 -> 137552 00010000:00010000:2.0:1789760775.326815:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326828:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326837:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326845:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.326849:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326857:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326882:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.326889:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d51a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70410240->70414335] (req 70410240->70414335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.327026:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5149us (6054us total) trans 4294984498 rc 0/0 00000100:00100000:2.0:1789760775.327036:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17201 00000100:00100000:2.0:1789760775.327046:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713560887707 time 713582153535 state 0x2 ref 0 00000100:00100000:2.0:1789760775.332221:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.332407:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430144 00000100:00100000:0.0:1789760775.332416:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430144 00000100:00100000:0.0:1789760775.332474:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713560887707 time 713582153535 state 0x0 ref 1 00000100:00100000:0.0:1789760775.332489:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713582413951 time 713582153535 state 0x1 ref 1 00000100:00100000:0.0:1789760775.332524:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713582413951 time 713592815302 state 0x0 ref 1 00000100:00100000:0.0:1789760775.332536:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.332584:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70414336, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21950 00010000:00010000:0.0:1789760775.332594:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.332611:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1789760775.332616:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.332623:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.332637:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.336896:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984499 is committed 00002000:00010000:0.0:1789760775.337027:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70414336 -> 70418432 00002000:00010000:0.0:1789760775.337032:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137552 -> 137560 00010000:00010000:0.0:1789760775.337044:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337056:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337065:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337072:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.337077:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337085:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337160:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.337175:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d521 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70414336->70418431] (req 70414336->70418431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.337329:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4790us (5113us total) trans 4294984499 rc 0/0 00000100:00100000:0.0:1789760775.337340:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17202 00000100:00100000:0.0:1789760775.337349:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713582413951 time 713592815302 state 0x2 ref 0 00000100:00100000:0.0:1789760775.341457:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.341558:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430272 00000100:00100000:1.0:1789760775.341569:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430272 00000100:00100000:1.0:1789760775.341625:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713582413951 time 713592815302 state 0x0 ref 1 00000100:00100000:1.0:1789760775.341641:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713593075718 time 713592815302 state 0x1 ref 1 00000100:00100000:1.0:1789760775.341735:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713593075718 time 713602026360 state 0x0 ref 1 00000100:00100000:1.0:1789760775.341747:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.341812:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70418432, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21958 00010000:00010000:1.0:1789760775.341822:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.341846:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.341851:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.341859:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.341873:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.347288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984500 is committed 00002000:00010000:1.0:1789760775.347407:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70418432 -> 70422528 00002000:00010000:1.0:1789760775.347412:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137560 -> 137568 00010000:00010000:1.0:1789760775.347426:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347438:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347447:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347455:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.347460:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347469:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347494:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.347502:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d528 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70418432->70422527] (req 70418432->70422527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.347626:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5876us (6173us total) trans 4294984500 rc 0/0 00000100:00100000:1.0:1789760775.347637:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17203 00000100:00100000:1.0:1789760775.347648:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713593075718 time 713602026360 state 0x2 ref 0 00000100:00100000:1.0:1789760775.351056:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.351169:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430400 00000100:00100000:2.0:1789760775.351178:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430400 00000100:00100000:2.0:1789760775.351293:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713593075718 time 713602026360 state 0x0 ref 1 00000100:00100000:2.0:1789760775.351308:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713602286776 time 713602026360 state 0x1 ref 1 00000100:00100000:2.0:1789760775.351366:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713602286776 time 713611657719 state 0x0 ref 1 00000100:00100000:2.0:1789760775.351380:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.351427:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70422528, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21960 00010000:00010000:2.0:1789760775.351435:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.351455:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.351460:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.351466:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.351479:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.361595:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984501 is committed 00002000:00010000:2.0:1789760775.362113:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70422528 -> 70426624 00002000:00010000:2.0:1789760775.362119:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137568 -> 137576 00010000:00010000:2.0:1789760775.362133:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362147:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362156:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362164:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.362169:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362178:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362202:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.362210:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d52f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70422528->70426623] (req 70422528->70426623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.362402:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11020us (11351us total) trans 4294984501 rc 0/0 00000100:00100000:2.0:1789760775.362413:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17204 00000100:00100000:2.0:1789760775.362422:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713602286776 time 713611657719 state 0x2 ref 0 00000100:00100000:2.0:1789760775.367217:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.367314:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430528 00000100:00100000:0.0:1789760775.367324:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430528 00000100:00100000:0.0:1789760775.367383:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713602286776 time 713611657719 state 0x0 ref 1 00000100:00100000:0.0:1789760775.367399:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713611918135 time 713611657719 state 0x1 ref 1 00000100:00100000:0.0:1789760775.367432:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713611918135 time 713627723934 state 0x0 ref 1 00000100:00100000:0.0:1789760775.367445:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.367495:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70426624, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21968 00010000:00010000:0.0:1789760775.367505:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.367520:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1789760775.367524:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.367531:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.367544:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.372128:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760775.377367:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984502 is committed 00002000:00010000:1.0:1789760775.377968:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70426624 -> 70430720 00002000:00010000:1.0:1789760775.377973:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137576 -> 137584 00010000:00010000:1.0:1789760775.377987:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.377998:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.378007:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.378013:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.378018:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.378025:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.378045:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.378051:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d536 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70426624->70430719] (req 70426624->70430719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.378154:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10707us (10942us total) trans 4294984502 rc 0/0 00000100:00100000:1.0:1789760775.378164:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17205 00000100:00100000:1.0:1789760775.378173:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713611918135 time 713627723934 state 0x2 ref 0 00000100:00100000:0.0:1789760775.381517:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.381603:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430656 00000100:00100000:1.0:1789760775.381613:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430656 00000100:00100000:1.0:1789760775.381662:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713611918135 time 713627723934 state 0x0 ref 1 00000100:00100000:1.0:1789760775.381676:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713627984350 time 713627723934 state 0x1 ref 1 00000100:00100000:1.0:1789760775.381747:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713627984350 time 713642039023 state 0x0 ref 1 00000100:00100000:1.0:1789760775.381770:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.381926:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70430720, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21970 00010000:00010000:1.0:1789760775.381936:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.381951:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.381955:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.381961:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.381975:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.387971:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984503 is committed 00002000:00010000:1.0:1789760775.388391:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70430720 -> 70434816 00002000:00010000:1.0:1789760775.388397:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137584 -> 137592 00010000:00010000:1.0:1789760775.388411:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388424:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388433:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388441:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.388446:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388455:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388477:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.388484:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d53d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70430720->70434815] (req 70430720->70434815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.388575:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6803us (7061us total) trans 4294984503 rc 0/0 00000100:00100000:1.0:1789760775.388586:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17206 00000100:00100000:1.0:1789760775.388597:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713627984350 time 713642039023 state 0x2 ref 0 00000100:00100000:1.0:1789760775.393159:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.393287:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430784 00000100:00100000:2.0:1789760775.393297:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430784 00000100:00100000:2.0:1789760775.393350:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713627984350 time 713642039023 state 0x0 ref 1 00000100:00100000:2.0:1789760775.393365:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713642299439 time 713642039023 state 0x1 ref 1 00000100:00100000:2.0:1789760775.393395:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713642299439 time 713653687283 state 0x0 ref 1 00000100:00100000:2.0:1789760775.393407:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.393451:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70434816, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21978 00010000:00010000:2.0:1789760775.393461:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.393478:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.393482:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.393488:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.393503:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.398425:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984504 is committed 00002000:00010000:2.0:1789760775.398539:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70434816 -> 70438912 00002000:00010000:2.0:1789760775.398545:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137592 -> 137600 00010000:00010000:2.0:1789760775.398557:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398569:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398578:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398585:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.398590:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398599:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398623:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.398631:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d544 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70434816->70438911] (req 70434816->70438911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.398824:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565430784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5414us (5668us total) trans 4294984504 rc 0/0 00000100:00100000:2.0:1789760775.398834:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17207 00000100:00100000:2.0:1789760775.398844:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713642299439 time 713653687283 state 0x2 ref 0 00000100:00100000:2.0:1789760775.404766:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.405024:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565430912 00000100:00100000:1.0:1789760775.405034:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565430912 00000100:00100000:1.0:1789760775.405089:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713642299439 time 713653687283 state 0x0 ref 1 00000100:00100000:1.0:1789760775.405105:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713653947699 time 713653687283 state 0x1 ref 1 00000100:00100000:1.0:1789760775.405190:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713653947699 time 713665480902 state 0x0 ref 1 00000100:00100000:1.0:1789760775.405203:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.405265:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70438912, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21980 00010000:00010000:1.0:1789760775.405275:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.405300:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.405306:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.405313:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.405330:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.413676:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984505 is committed 00002000:00010000:1.0:1789760775.417746:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70438912 -> 70443008 00002000:00010000:1.0:1789760775.417767:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137600 -> 137608 00010000:00010000:1.0:1789760775.417788:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.417801:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.417809:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.417816:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.417821:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.417963:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.417992:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.418000:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d54b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70438912->70443007] (req 70438912->70443007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.418162:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565430912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12957us (13410us total) trans 4294984505 rc 0/0 00000100:00100000:1.0:1789760775.418173:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17208 00000100:00100000:1.0:1789760775.418183:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713653947699 time 713665480902 state 0x2 ref 0 00000100:00100000:0.0:1789760775.423502:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.423592:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431040 00000100:00100000:1.0:1789760775.423601:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431040 00000100:00100000:1.0:1789760775.423655:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713653947699 time 713665480902 state 0x0 ref 1 00000100:00100000:1.0:1789760775.423670:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713665741318 time 713665480902 state 0x1 ref 1 00000100:00100000:1.0:1789760775.423736:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713665741318 time 713683997527 state 0x0 ref 1 00000100:00100000:1.0:1789760775.423758:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565431040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.423963:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70443008, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21988 00010000:00010000:1.0:1789760775.423973:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.423988:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.423993:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.423999:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.424011:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.430968:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984506 is committed 00002000:00010000:1.0:1789760775.437516:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70443008 -> 70447104 00002000:00010000:1.0:1789760775.437527:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137608 -> 137616 00010000:00010000:1.0:1789760775.437539:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437552:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437561:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437569:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.437573:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437582:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437601:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.437614:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d552 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70443008->70447103] (req 70443008->70447103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.437740:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565431040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13988us (14242us total) trans 4294984506 rc 0/0 00000100:00100000:1.0:1789760775.437761:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17209 00000100:00100000:1.0:1789760775.437778:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713665741318 time 713683997527 state 0x2 ref 0 00000100:00100000:3.0:1789760775.442517:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.442654:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431168 00000100:00100000:2.0:1789760775.442663:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431168 00000100:00100000:2.0:1789760775.442742:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713665741318 time 713683997527 state 0x0 ref 1 00000100:00100000:2.0:1789760775.442767:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713684257943 time 713683997527 state 0x1 ref 1 00000100:00100000:2.0:1789760775.442800:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713684257943 time 713703092691 state 0x0 ref 1 00000100:00100000:2.0:1789760775.442813:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.442860:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70447104, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21990 00010000:00010000:2.0:1789760775.442871:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.442887:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.442891:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.442897:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.442911:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.449039:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984507 is committed 00002000:00010000:2.0:1789760775.449149:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70447104 -> 70451200 00002000:00010000:2.0:1789760775.449154:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137616 -> 137624 00010000:00010000:2.0:1789760775.449166:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449178:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449186:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449192:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.449197:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449205:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449229:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.449237:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d559 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70447104->70451199] (req 70447104->70451199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.449323:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6508us (6812us total) trans 4294984507 rc 0/0 00000100:00100000:2.0:1789760775.449333:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17210 00000100:00100000:2.0:1789760775.449343:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713684257943 time 713703092691 state 0x2 ref 0 00000100:00100000:3.0:1789760775.453658:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.453765:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431296 00000100:00100000:1.0:1789760775.453775:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431296 00000100:00100000:1.0:1789760775.453839:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713684257943 time 713703092691 state 0x0 ref 1 00000100:00100000:1.0:1789760775.453854:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713703353107 time 713703092691 state 0x1 ref 1 00000100:00100000:1.0:1789760775.453882:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713703353107 time 713714174349 state 0x0 ref 1 00000100:00100000:1.0:1789760775.453895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565431296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.453940:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70451200, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21998 00010000:00010000:1.0:1789760775.453950:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.453965:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.453969:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.453975:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.453995:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.459200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984508 is committed 00002000:00010000:1.0:1789760775.459514:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70451200 -> 70455296 00002000:00010000:1.0:1789760775.459520:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137624 -> 137632 00010000:00010000:1.0:1789760775.459533:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459613:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459625:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459632:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.459638:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459647:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459668:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.459676:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d560 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70451200->70455295] (req 70451200->70455295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.460199:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565431296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6300us (6544us total) trans 4294984508 rc 0/0 00000100:00100000:1.0:1789760775.460210:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17211 00000100:00100000:1.0:1789760775.460221:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713703353107 time 713714174349 state 0x2 ref 0 00000100:00100000:0.0:1789760775.464099:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.464233:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431424 00000100:00100000:1.0:1789760775.464242:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431424 00000100:00100000:1.0:1789760775.464295:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713703353107 time 713714174349 state 0x0 ref 1 00000100:00100000:1.0:1789760775.464310:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713714434765 time 713714174349 state 0x1 ref 1 00000100:00100000:1.0:1789760775.464341:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713714434765 time 713724633432 state 0x0 ref 1 00000100:00100000:1.0:1789760775.464354:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.464401:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70455296, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219a0 00010000:00010000:1.0:1789760775.464410:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.464426:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.464430:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.464436:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.464461:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.468520:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984509 is committed 00002000:00010000:1.0:1789760775.468668:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70455296 -> 70459392 00002000:00010000:1.0:1789760775.468673:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137632 -> 137640 00010000:00010000:1.0:1789760775.468684:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468696:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468784:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468793:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.468797:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468806:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468826:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.468834:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d567 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70455296->70459391] (req 70455296->70459391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.468993:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4636us (4897us total) trans 4294984509 rc 0/0 00000100:00100000:0.0:1789760775.469003:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17212 00000100:00100000:0.0:1789760775.469012:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713714434765 time 713724633432 state 0x2 ref 0 00000100:00100000:3.0:1789760775.472809:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.472891:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431552 00000100:00100000:2.0:1789760775.472900:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431552 00000100:00100000:2.0:1789760775.472955:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713714434765 time 713724633432 state 0x0 ref 1 00000100:00100000:2.0:1789760775.472970:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713724893848 time 713724633432 state 0x1 ref 1 00000100:00100000:2.0:1789760775.473000:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713724893848 time 713733292175 state 0x0 ref 1 00000100:00100000:2.0:1789760775.473012:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.473059:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70459392, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219a8 00010000:00010000:2.0:1789760775.473069:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.473084:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.473089:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.473095:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.473109:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.479207:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984510 is committed 00002000:00010000:2.0:1789760775.479353:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70459392 -> 70463488 00002000:00010000:2.0:1789760775.479358:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137640 -> 137648 00010000:00010000:2.0:1789760775.479371:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479383:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479391:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479398:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.479403:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479412:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479431:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.479443:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d56e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70459392->70463487] (req 70459392->70463487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.479537:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565431552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6523us (6733us total) trans 4294984510 rc 0/0 00000100:00100000:2.0:1789760775.479547:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17213 00000100:00100000:2.0:1789760775.479556:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713724893848 time 713733292175 state 0x2 ref 0 00000100:00100000:3.0:1789760775.484504:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.484625:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431680 00000100:00100000:1.0:1789760775.484635:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431680 00000100:00100000:1.0:1789760775.484689:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713724893848 time 713733292175 state 0x0 ref 1 00000100:00100000:1.0:1789760775.484732:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713733552591 time 713733292175 state 0x1 ref 1 00000100:00100000:1.0:1789760775.484766:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713733552591 time 713745058066 state 0x0 ref 1 00000100:00100000:1.0:1789760775.484778:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.484832:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70463488, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219b0 00010000:00010000:1.0:1789760775.484842:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.485024:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.485029:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.485037:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.485053:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.493552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984511 is committed 00002000:00010000:1.0:1789760775.493655:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70463488 -> 70467584 00002000:00010000:1.0:1789760775.493661:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137648 -> 137656 00010000:00010000:1.0:1789760775.493674:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493687:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493719:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493729:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.493734:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493744:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493775:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.493783:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d575 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70463488->70467583] (req 70463488->70467583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.493983:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9201us (9483us total) trans 4294984511 rc 0/0 00000100:00100000:1.0:1789760775.493995:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17214 00000100:00100000:1.0:1789760775.494004:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713733552591 time 713745058066 state 0x2 ref 0 00000100:00100000:0.0:1789760775.502692:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.503593:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431808 00000100:00100000:0.0:1789760775.503605:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431808 00000100:00100000:0.0:1789760775.503663:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713733552591 time 713745058066 state 0x0 ref 1 00000100:00100000:0.0:1789760775.503679:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713745318482 time 713745058066 state 0x1 ref 1 00000100:00100000:3.0:1789760775.503882:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713745318482 time 713764170871 state 0x0 ref 1 00000100:00100000:3.0:1789760775.503901:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.503954:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70467584, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219b8 00010000:00010000:3.0:1789760775.503965:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.503981:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.503986:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.503993:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.504009:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.509174:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984512 is committed 00002000:00010000:3.0:1789760775.509529:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70467584 -> 70471680 00002000:00010000:3.0:1789760775.509535:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137656 -> 137664 00010000:00010000:3.0:1789760775.509549:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509563:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509571:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509579:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.509584:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509592:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509611:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.509619:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d57c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70467584->70471679] (req 70467584->70471679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.509850:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5951us (7164us total) trans 4294984512 rc 0/0 00000100:00100000:3.0:1789760775.509861:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17215 00000100:00100000:3.0:1789760775.509871:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713745318482 time 713764170871 state 0x2 ref 0 00000100:00100000:3.0:1789760775.520828:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.520950:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565431936 00000100:00100000:2.0:1789760775.520961:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565431936 00000100:00100000:2.0:1789760775.521016:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713745318482 time 713764170871 state 0x0 ref 1 00000100:00100000:2.0:1789760775.521032:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713764431287 time 713764170871 state 0x1 ref 1 00000100:00100000:2.0:1789760775.521062:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713764431287 time 713781354386 state 0x0 ref 1 00000100:00100000:2.0:1789760775.521075:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.521119:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70471680, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219c0 00010000:00010000:2.0:1789760775.521128:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.521142:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.521146:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.521153:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.521172:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.525144:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984513 is committed 00002000:00010000:2.0:1789760775.529482:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70471680 -> 70475776 00002000:00010000:2.0:1789760775.529491:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137664 -> 137672 00010000:00010000:2.0:1789760775.529510:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529523:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529532:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529540:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.529545:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529554:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529574:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.529582:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d583 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70471680->70475775] (req 70471680->70475775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.529678:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565431936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8601us (8854us total) trans 4294984513 rc 0/0 00000100:00100000:2.0:1789760775.529689:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17216 00000100:00100000:2.0:1789760775.529700:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713764431287 time 713781354386 state 0x2 ref 0 00000100:00100000:2.0:1789760775.539222:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.539905:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432064 00000100:00100000:1.0:1789760775.539915:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432064 00000100:00100000:1.0:1789760775.540029:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713764431287 time 713781354386 state 0x0 ref 1 00000100:00100000:1.0:1789760775.540046:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713781614802 time 713781354386 state 0x1 ref 1 00000100:00100000:1.0:1789760775.540119:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713781614802 time 713800410663 state 0x0 ref 1 00000100:00100000:1.0:1789760775.540133:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565432064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.540186:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70475776, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219c8 00010000:00010000:1.0:1789760775.540195:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.540212:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.540216:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.540222:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.540235:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.549341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984514 is committed 00002000:00010000:1.0:1789760775.549529:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70475776 -> 70479872 00002000:00010000:1.0:1789760775.549534:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137672 -> 137680 00010000:00010000:1.0:1789760775.549547:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549561:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549570:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549582:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.549587:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549596:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549615:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.549634:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d58a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70475776->70479871] (req 70475776->70479871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.549953:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565432064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9818us (10735us total) trans 4294984514 rc 0/0 00000100:00100000:1.0:1789760775.549965:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17217 00000100:00100000:1.0:1789760775.549973:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713781614802 time 713800410663 state 0x2 ref 0 00000100:00100000:0.0:1789760775.557267:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.557384:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432192 00000100:00100000:3.0:1789760775.557394:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432192 00000100:00100000:3.0:1789760775.557447:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713781614802 time 713800410663 state 0x0 ref 1 00000100:00100000:3.0:1789760775.557461:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713800671079 time 713800410663 state 0x1 ref 1 00000100:00100000:3.0:1789760775.557489:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713800671079 time 713817781335 state 0x0 ref 1 00000100:00100000:3.0:1789760775.557499:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.557540:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70479872, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219d0 00010000:00010000:3.0:1789760775.557550:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.557565:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.557569:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.557575:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.557588:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.564743:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984515 is committed 00002000:00010000:3.0:1789760775.564934:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70479872 -> 70483968 00002000:00010000:3.0:1789760775.564995:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137680 -> 137688 00010000:00010000:3.0:1789760775.565009:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565026:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565033:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565039:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.565044:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565056:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565075:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.565083:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d591 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70479872->70483967] (req 70479872->70483967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.565170:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7667us (7906us total) trans 4294984515 rc 0/0 00000100:00100000:3.0:1789760775.565181:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17218 00000100:00100000:3.0:1789760775.565190:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713800671079 time 713817781335 state 0x2 ref 0 00000100:00100000:2.0:1789760775.576920:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.577934:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432320 00000100:00100000:1.0:1789760775.577947:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432320 00000100:00100000:1.0:1789760775.578002:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713800671079 time 713817781335 state 0x0 ref 1 00000100:00100000:1.0:1789760775.578017:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713818041751 time 713817781335 state 0x1 ref 1 00000100:00100000:1.0:1789760775.578048:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713818041751 time 713838340514 state 0x0 ref 1 00000100:00100000:1.0:1789760775.578063:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.578110:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70483968, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219d8 00010000:00010000:1.0:1789760775.578119:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.578135:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.578140:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.578146:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.578160:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.582391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984516 is committed 00002000:00010000:1.0:1789760775.583020:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70483968 -> 70488064 00002000:00010000:1.0:1789760775.583026:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137688 -> 137696 00010000:00010000:1.0:1789760775.583040:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583055:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583065:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583073:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.583080:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583091:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583188:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.583196:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d598 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70483968->70488063] (req 70483968->70488063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.583347:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5280us (6430us total) trans 4294984516 rc 0/0 00000100:00100000:1.0:1789760775.583357:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17219 00000100:00100000:1.0:1789760775.583366:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713818041751 time 713838340514 state 0x2 ref 0 00000100:00100000:2.0:1789760775.586950:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.587088:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432448 00000100:00100000:1.0:1789760775.587152:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432448 00000100:00100000:1.0:1789760775.587206:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713818041751 time 713838340514 state 0x0 ref 1 00000100:00100000:1.0:1789760775.587221:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713838600930 time 713838340514 state 0x1 ref 1 00000100:00100000:1.0:1789760775.587280:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713838600930 time 713847572491 state 0x0 ref 1 00000100:00100000:1.0:1789760775.587293:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.587335:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70488064, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219e0 00010000:00010000:1.0:1789760775.587345:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.587360:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.587365:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.587371:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.587384:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.595319:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984517 is committed 00002000:00010000:1.0:1789760775.595517:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70488064 -> 70492160 00002000:00010000:1.0:1789760775.595523:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137696 -> 137704 00010000:00010000:1.0:1789760775.595536:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595547:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595555:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595562:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.595567:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595574:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595592:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.595600:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d59f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70488064->70492159] (req 70488064->70492159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.595695:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8400us (8750us total) trans 4294984517 rc 0/0 00000100:00100000:1.0:1789760775.595738:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17220 00000100:00100000:1.0:1789760775.595759:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713838600930 time 713847572491 state 0x2 ref 0 00000100:00100000:0.0:1789760775.600844:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.601110:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432576 00000100:00100000:3.0:1789760775.601120:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432576 00000100:00100000:3.0:1789760775.601177:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713838600930 time 713847572491 state 0x0 ref 1 00000100:00100000:3.0:1789760775.601193:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713847832907 time 713847572491 state 0x1 ref 1 00000100:00100000:3.0:1789760775.601261:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713847832907 time 713861552651 state 0x0 ref 1 00000100:00100000:3.0:1789760775.601275:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.601319:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70492160, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219e8 00010000:00010000:3.0:1789760775.601328:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.601349:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.601355:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.601362:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.601377:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.607072:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984518 is committed 00002000:00010000:3.0:1789760775.608458:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70492160 -> 70496256 00002000:00010000:3.0:1789760775.608466:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137704 -> 137712 00010000:00010000:3.0:1789760775.608480:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608494:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608509:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608517:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.608522:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608531:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608550:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.608558:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70492160->70496255] (req 70492160->70496255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.610341:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9058us (9631us total) trans 4294984518 rc 0/0 00000100:00100000:3.0:1789760775.610356:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17221 00000100:00100000:3.0:1789760775.610366:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713847832907 time 713861552651 state 0x2 ref 0 00000100:00100000:2.0:1789760775.614551:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.614660:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432704 00000100:00100000:1.0:1789760775.614668:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432704 00000100:00100000:1.0:1789760775.614855:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713847832907 time 713861552651 state 0x0 ref 1 00000100:00100000:1.0:1789760775.614871:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713861813067 time 713861552651 state 0x1 ref 1 00000100:00100000:1.0:1789760775.614945:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713861813067 time 713875227459 state 0x0 ref 1 00000100:00100000:1.0:1789760775.614959:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.615012:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70496256, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219f0 00010000:00010000:1.0:1789760775.615022:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.615037:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.615042:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.615048:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.615062:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.619816:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984519 is committed 00002000:00010000:1.0:1789760775.621720:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70496256 -> 70500352 00002000:00010000:1.0:1789760775.621730:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137712 -> 137720 00010000:00010000:1.0:1789760775.621744:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621765:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621888:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621896:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.621900:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621909:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621928:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.621941:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70496256->70500351] (req 70496256->70500351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.622043:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565432704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7082us (7496us total) trans 4294984519 rc 0/0 00000100:00100000:1.0:1789760775.622055:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17222 00000100:00100000:1.0:1789760775.622064:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713861813067 time 713875227459 state 0x2 ref 0 00000100:00100000:2.0:1789760775.627394:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.627846:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432832 00000100:00100000:1.0:1789760775.627855:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432832 00000100:00100000:1.0:1789760775.627907:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713861813067 time 713875227459 state 0x0 ref 1 00000100:00100000:1.0:1789760775.627921:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713875487875 time 713875227459 state 0x1 ref 1 00000100:00100000:1.0:1789760775.628018:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713875487875 time 713888308640 state 0x0 ref 1 00000100:00100000:1.0:1789760775.628032:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.628082:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70500352, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x219f8 00010000:00010000:1.0:1789760775.628090:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.628176:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789760775.628180:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.628187:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.628207:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.634931:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984520 is committed 00002000:00010000:2.0:1789760775.635154:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70500352 -> 70504448 00002000:00010000:2.0:1789760775.635159:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137720 -> 137728 00010000:00010000:2.0:1789760775.635173:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635185:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635194:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635202:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.635207:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635220:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635239:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.635248:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d5b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70500352->70504447] (req 70500352->70504447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.635385:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565432832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7349us (7995us total) trans 4294984520 rc 0/0 00000100:00100000:2.0:1789760775.635395:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17223 00000100:00100000:2.0:1789760775.635404:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713875487875 time 713888308640 state 0x2 ref 0 00000100:00100000:0.0:1789760775.643274:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760775.643388:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565432960 00000100:00100000:3.0:1789760775.643400:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565432960 00000100:00100000:3.0:1789760775.643458:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713875487875 time 713888308640 state 0x0 ref 1 00000100:00100000:3.0:1789760775.643474:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713888569056 time 713888308640 state 0x1 ref 1 00000100:00100000:3.0:1789760775.643539:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713888569056 time 713903829996 state 0x0 ref 1 00000100:00100000:3.0:1789760775.643554:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565432960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760775.643604:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70504448, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a00 00010000:00010000:3.0:1789760775.643614:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.643630:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789760775.643635:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.643641:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.643654:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.648213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984521 is committed 00002000:00010000:2.0:1789760775.649312:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70504448 -> 70508544 00002000:00010000:2.0:1789760775.649320:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137728 -> 137736 00010000:00010000:2.0:1789760775.649334:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649346:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649356:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649369:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.649374:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649383:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649525:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.649535:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d5bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70504448->70508543] (req 70504448->70508543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.649633:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565432960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6079us (6366us total) trans 4294984521 rc 0/0 00000100:00100000:2.0:1789760775.649644:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17224 00000100:00100000:2.0:1789760775.649653:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713888569056 time 713903829996 state 0x2 ref 0 00000100:00100000:1.0:1789760775.653910:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.654060:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433088 00000100:00100000:2.0:1789760775.654071:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433088 00000100:00100000:2.0:1789760775.654185:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713888569056 time 713903829996 state 0x0 ref 1 00000100:00100000:2.0:1789760775.654201:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713904090412 time 713903829996 state 0x1 ref 1 00000100:00100000:2.0:1789760775.654267:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713904090412 time 713914557774 state 0x0 ref 1 00000100:00100000:2.0:1789760775.654285:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.654334:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70508544, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a08 00010000:00010000:2.0:1789760775.654342:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.654357:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.654361:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.654367:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.654381:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.660651:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984522 is committed 00002000:00010000:2.0:1789760775.661019:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70508544 -> 70512640 00002000:00010000:2.0:1789760775.661025:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137736 -> 137744 00010000:00010000:2.0:1789760775.661039:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661053:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661063:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661071:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.661076:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661086:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661105:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.661113:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70508544->70512639] (req 70508544->70512639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.661204:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6918us (7299us total) trans 4294984522 rc 0/0 00000100:00100000:2.0:1789760775.661215:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17225 00000100:00100000:2.0:1789760775.661224:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713904090412 time 713914557774 state 0x2 ref 0 00000100:00100000:3.0:1789760775.666610:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.666774:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433216 00000100:00100000:2.0:1789760775.666784:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433216 00000100:00100000:2.0:1789760775.667131:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713904090412 time 713914557774 state 0x0 ref 1 00000100:00100000:2.0:1789760775.667148:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713914818190 time 713914557774 state 0x1 ref 1 00000100:00100000:2.0:1789760775.667176:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713914818190 time 713927467939 state 0x0 ref 1 00000100:00100000:2.0:1789760775.667189:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.667233:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70512640, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a10 00010000:00010000:2.0:1789760775.667241:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.667257:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.667261:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.667268:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.667281:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.671738:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984523 is committed 00002000:00010000:2.0:1789760775.671859:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70512640 -> 70516736 00002000:00010000:2.0:1789760775.671864:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137744 -> 137752 00010000:00010000:2.0:1789760775.672188:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672275:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672284:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672291:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.672295:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672304:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672324:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.672332:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70512640->70516735] (req 70512640->70516735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.672430:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5240us (5825us total) trans 4294984523 rc 0/0 00000100:00100000:2.0:1789760775.672665:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17226 00000100:00100000:2.0:1789760775.672676:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713914818190 time 713927467939 state 0x2 ref 0 00000100:00100000:0.0:1789760775.677486:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.677814:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433344 00000100:00100000:2.0:1789760775.677823:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433344 00000100:00100000:2.0:1789760775.677891:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713914818190 time 713927467939 state 0x0 ref 1 00000100:00100000:2.0:1789760775.677906:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713927728355 time 713927467939 state 0x1 ref 1 00000100:00100000:2.0:1789760775.677928:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713927728355 time 713938220134 state 0x0 ref 1 00000100:00100000:2.0:1789760775.677941:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.678304:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70516736, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a18 00010000:00010000:2.0:1789760775.678315:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.678330:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.678335:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.678341:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.678355:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.684299:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984524 is committed 00002000:00010000:2.0:1789760775.684406:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70516736 -> 70520832 00002000:00010000:2.0:1789760775.684411:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137752 -> 137760 00010000:00010000:2.0:1789760775.684422:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684434:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684443:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684451:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.684455:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684464:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684483:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.684496:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70516736->70520831] (req 70516736->70520831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.684584:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6642us (7104us total) trans 4294984524 rc 0/0 00000100:00100000:2.0:1789760775.684593:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17227 00000100:00100000:2.0:1789760775.684601:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713927728355 time 713938220134 state 0x2 ref 0 00000100:00100000:1.0:1789760775.689320:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.689517:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433472 00000100:00100000:2.0:1789760775.689528:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433472 00000100:00100000:2.0:1789760775.690169:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713927728355 time 713938220134 state 0x0 ref 1 00000100:00100000:2.0:1789760775.690186:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713938480550 time 713938220134 state 0x1 ref 1 00000100:00100000:2.0:1789760775.690220:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713938480550 time 713950511446 state 0x0 ref 1 00000100:00100000:2.0:1789760775.690233:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.690282:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70520832, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a20 00010000:00010000:2.0:1789760775.690291:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.690307:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.690311:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.690317:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.690337:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.695107:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984525 is committed 00002000:00010000:2.0:1789760775.695245:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70520832 -> 70524928 00002000:00010000:2.0:1789760775.695250:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137760 -> 137768 00010000:00010000:2.0:1789760775.695263:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695274:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695280:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695285:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.695288:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695294:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695317:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.695322:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70520832->70524927] (req 70520832->70524927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.695398:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5164us (6084us total) trans 4294984525 rc 0/0 00000100:00100000:2.0:1789760775.695410:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17228 00000100:00100000:2.0:1789760775.695419:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713938480550 time 713950511446 state 0x2 ref 0 00000100:00100000:3.0:1789760775.698311:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.698389:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433600 00000100:00100000:2.0:1789760775.698397:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433600 00000100:00100000:2.0:1789760775.698450:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713938480550 time 713950511446 state 0x0 ref 1 00000100:00100000:2.0:1789760775.698465:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713950771862 time 713950511446 state 0x1 ref 1 00000100:00100000:2.0:1789760775.698501:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713950771862 time 713958793052 state 0x0 ref 1 00000100:00100000:2.0:1789760775.698513:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.698559:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70524928, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a28 00010000:00010000:2.0:1789760775.698569:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.698585:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.698602:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.698608:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.698622:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.707021:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984526 is committed 00002000:00010000:2.0:1789760775.707143:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70524928 -> 70529024 00002000:00010000:2.0:1789760775.707148:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137768 -> 137776 00010000:00010000:2.0:1789760775.707161:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707174:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707184:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707193:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.707198:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707207:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707228:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.707237:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70524928->70529023] (req 70524928->70529023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.707329:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8813us (9031us total) trans 4294984526 rc 0/0 00000100:00100000:2.0:1789760775.707341:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17229 00000100:00100000:2.0:1789760775.707350:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713950771862 time 713958793052 state 0x2 ref 0 00000100:00100000:0.0:1789760775.715697:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.715813:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433728 00000100:00100000:2.0:1789760775.715823:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433728 00000100:00100000:2.0:1789760775.716415:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713950771862 time 713958793052 state 0x0 ref 1 00000100:00100000:2.0:1789760775.716431:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713959053468 time 713958793052 state 0x1 ref 1 00000100:00100000:2.0:1789760775.716465:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713959053468 time 713976757046 state 0x0 ref 1 00000100:00100000:2.0:1789760775.716479:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.716527:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70529024, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a30 00010000:00010000:2.0:1789760775.716537:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.716552:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1789760775.716558:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.716565:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.716579:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.724982:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984527 is committed 00002000:00010000:3.0:1789760775.725470:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70529024 -> 70533120 00002000:00010000:3.0:1789760775.725477:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137776 -> 137784 00010000:00010000:3.0:1789760775.725491:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725503:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725511:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725519:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.725524:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725534:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725555:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.725564:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d5e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70529024->70533119] (req 70529024->70533119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.725789:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9307us (10097us total) trans 4294984527 rc 0/0 00000100:00100000:3.0:1789760775.725799:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17230 00000100:00100000:3.0:1789760775.725809:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713959053468 time 713976757046 state 0x2 ref 0 00000100:00100000:3.0:1789760775.741549:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.741960:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433856 00000100:00100000:2.0:1789760775.741971:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433856 00000100:00100000:2.0:1789760775.742026:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713959053468 time 713976757046 state 0x0 ref 1 00000100:00100000:2.0:1789760775.742041:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713977017462 time 713976757046 state 0x1 ref 1 00000100:00100000:2.0:1789760775.742075:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713977017462 time 714002366539 state 0x0 ref 1 00000100:00100000:2.0:1789760775.742088:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.742146:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70533120, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a38 00010000:00010000:2.0:1789760775.742156:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.742172:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.742176:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.742184:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.742198:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.749229:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984528 is committed 00002000:00010000:1.0:1789760775.757380:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70533120 -> 70537216 00002000:00010000:1.0:1789760775.757391:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137784 -> 137792 00010000:00010000:1.0:1789760775.757405:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757419:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757428:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757435:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.757440:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757454:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757474:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.757482:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d5ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70533120->70537215] (req 70533120->70537215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.757950:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565433856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15860us (16409us total) trans 4294984528 rc 0/0 00000100:00100000:1.0:1789760775.757962:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17231 00000100:00100000:1.0:1789760775.757972:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713977017462 time 714002366539 state 0x2 ref 0 00000100:00100000:2.0:1789760775.767000:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.767076:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565433984 00000100:00100000:1.0:1789760775.767085:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565433984 00000100:00100000:1.0:1789760775.767145:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 713977017462 time 714002366539 state 0x0 ref 1 00000100:00100000:1.0:1789760775.767160:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714002626955 time 714002366539 state 0x1 ref 1 00000100:00100000:1.0:1789760775.767180:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714002626955 time 714027472683 state 0x0 ref 1 00000100:00100000:1.0:1789760775.767192:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.767239:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70537216, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a40 00010000:00010000:1.0:1789760775.767249:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.767265:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760775.767269:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.767275:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.767289:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.772152:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984529 is committed 00002000:00010000:1.0:1789760775.778416:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70537216 -> 70541312 00002000:00010000:1.0:1789760775.778426:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137792 -> 137800 00010000:00010000:1.0:1789760775.778439:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778451:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778460:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778467:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760775.778472:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778480:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778504:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.778512:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d5f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70537216->70541311] (req 70537216->70541311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.778611:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565433984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11416us (11617us total) trans 4294984529 rc 0/0 00000100:00100000:1.0:1789760775.778622:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17232 00000100:00100000:1.0:1789760775.778632:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714002626955 time 714027472683 state 0x2 ref 0 00000100:00100000:3.0:1789760775.782511:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.782618:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434112 00000100:00100000:2.0:1789760775.782628:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434112 00000100:00100000:2.0:1789760775.782697:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714002626955 time 714027472683 state 0x0 ref 1 00000100:00100000:2.0:1789760775.782762:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714027733099 time 714027472683 state 0x1 ref 1 00000100:00100000:2.0:1789760775.782790:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714027733099 time 714043082074 state 0x0 ref 1 00000100:00100000:2.0:1789760775.782802:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.782852:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70541312, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a48 00010000:00010000:2.0:1789760775.782861:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.782875:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.782879:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.782885:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.782902:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.787405:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984530 is committed 00002000:00010000:3.0:1789760775.787524:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70541312 -> 70545408 00002000:00010000:3.0:1789760775.787529:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137800 -> 137808 00010000:00010000:3.0:1789760775.787541:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787558:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787566:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787573:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.787577:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787584:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787601:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.787608:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d5fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70541312->70545407] (req 70541312->70545407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.787701:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4896us (5195us total) trans 4294984530 rc 0/0 00000100:00100000:3.0:1789760775.787738:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17233 00000100:00100000:3.0:1789760775.787757:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714027733099 time 714043082074 state 0x2 ref 0 00000100:00100000:3.0:1789760775.793547:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.794266:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434240 00000100:00100000:1.0:1789760775.794276:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434240 00000100:00100000:0.0:1789760775.794419:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714027733099 time 714043082074 state 0x0 ref 1 00000100:00100000:0.0:1789760775.794434:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714043342490 time 714043082074 state 0x1 ref 1 00000100:00100000:0.0:1789760775.794502:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714043342490 time 714054793554 state 0x0 ref 1 00000100:00100000:0.0:1789760775.794516:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.794564:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70545408, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a50 00010000:00010000:0.0:1789760775.794573:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.794587:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.794590:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.794596:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.794613:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.799472:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984531 is committed 00002000:00010000:0.0:1789760775.800040:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70545408 -> 70549504 00002000:00010000:0.0:1789760775.800046:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137808 -> 137816 00010000:00010000:0.0:1789760775.800059:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800072:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800081:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800088:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.800157:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800168:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800189:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.800198:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d601 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70545408->70549503] (req 70545408->70549503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.800334:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5816us (6791us total) trans 4294984531 rc 0/0 00000100:00100000:0.0:1789760775.800344:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17234 00000100:00100000:0.0:1789760775.800354:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714043342490 time 714054793554 state 0x2 ref 0 00000100:00100000:2.0:1789760775.809194:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.809283:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434368 00000100:00100000:1.0:1789760775.809292:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434368 00000100:00100000:1.0:1789760775.809347:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714043342490 time 714054793554 state 0x0 ref 1 00000100:00100000:1.0:1789760775.809364:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714055053970 time 714054793554 state 0x1 ref 1 00000100:00100000:1.0:1789760775.809396:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714055053970 time 714069688871 state 0x0 ref 1 00000100:00100000:1.0:1789760775.809409:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.809457:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70549504, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a58 00010000:00010000:1.0:1789760775.809467:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.809487:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760775.809492:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.809497:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.809511:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.814639:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984532 is committed 00002000:00010000:2.0:1789760775.815527:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70549504 -> 70553600 00002000:00010000:2.0:1789760775.815534:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137816 -> 137824 00010000:00010000:2.0:1789760775.815547:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815560:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815568:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815575:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.815581:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815589:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815607:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.815614:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d608 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70549504->70553599] (req 70549504->70553599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.815961:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6549us (6772us total) trans 4294984532 rc 0/0 00000100:00100000:2.0:1789760775.815972:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17235 00000100:00100000:2.0:1789760775.815981:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714055053970 time 714069688871 state 0x2 ref 0 00000100:00100000:3.0:1789760775.820909:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.821142:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434496 00000100:00100000:2.0:1789760775.821151:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434496 00000100:00100000:2.0:1789760775.821202:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714055053970 time 714069688871 state 0x0 ref 1 00000100:00100000:2.0:1789760775.821216:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714069949287 time 714069688871 state 0x1 ref 1 00000100:00100000:2.0:1789760775.821249:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714069949287 time 714081541326 state 0x0 ref 1 00000100:00100000:2.0:1789760775.821264:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.821311:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70553600, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a60 00010000:00010000:2.0:1789760775.821321:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.821336:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.821340:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.821346:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.821360:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.825811:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984533 is committed 00002000:00010000:2.0:1789760775.826162:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70553600 -> 70557696 00002000:00010000:2.0:1789760775.826168:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137824 -> 137832 00010000:00010000:2.0:1789760775.826182:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826195:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826203:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826210:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.826215:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826229:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826246:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.826253:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d60f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70553600->70557695] (req 70553600->70557695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.826535:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5268us (5629us total) trans 4294984533 rc 0/0 00000100:00100000:2.0:1789760775.826547:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17236 00000100:00100000:2.0:1789760775.826557:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714069949287 time 714081541326 state 0x2 ref 0 00000100:00100000:3.0:1789760775.830067:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.830490:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434624 00000100:00100000:0.0:1789760775.830501:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434624 00000100:00100000:0.0:1789760775.830560:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714069949287 time 714081541326 state 0x0 ref 1 00000100:00100000:0.0:1789760775.830579:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714081801742 time 714081541326 state 0x1 ref 1 00000100:00100000:0.0:1789760775.830604:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714081801742 time 714090895932 state 0x0 ref 1 00000100:00100000:0.0:1789760775.830617:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.830663:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70557696, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a68 00010000:00010000:0.0:1789760775.830672:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.830697:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.830869:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.830876:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.830890:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760775.843502:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984534 is committed 00002000:00010000:0.0:1789760775.846853:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70557696 -> 70561792 00002000:00010000:0.0:1789760775.846862:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137832 -> 137840 00010000:00010000:0.0:1789760775.846875:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.846887:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.846895:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.846901:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.846906:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.846979:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.846999:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.847006:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70557696->70561791] (req 70557696->70561791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.847165:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565434624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16545us (17101us total) trans 4294984534 rc 0/0 00000100:00100000:0.0:1789760775.847176:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17237 00000100:00100000:0.0:1789760775.847186:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714081801742 time 714090895932 state 0x2 ref 0 00000100:00100000:1.0:1789760775.853766:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.857053:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434752 00000100:00100000:2.0:1789760775.857069:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434752 00000100:00100000:2.0:1789760775.857128:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714081801742 time 714090895932 state 0x0 ref 1 00000100:00100000:2.0:1789760775.857143:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714091156348 time 714090895932 state 0x1 ref 1 00000100:00100000:2.0:1789760775.857176:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714091156348 time 714117468378 state 0x0 ref 1 00000100:00100000:2.0:1789760775.857190:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565434752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.857626:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70561792, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a70 00010000:00010000:2.0:1789760775.857636:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.857651:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.857656:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.857662:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.857675:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.867833:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984535 is committed 00002000:00010000:2.0:1789760775.867985:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70561792 -> 70565888 00002000:00010000:2.0:1789760775.867990:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137840 -> 137848 00010000:00010000:2.0:1789760775.868004:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868017:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868026:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868034:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.868039:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868048:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868068:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.868075:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d61d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70561792->70565887] (req 70561792->70565887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.868331:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565434752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11139us (16655us total) trans 4294984535 rc 0/0 00000100:00100000:2.0:1789760775.868342:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17238 00000100:00100000:2.0:1789760775.868352:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714091156348 time 714117468378 state 0x2 ref 0 00000100:00100000:3.0:1789760775.874544:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.877784:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565434880 00000100:00100000:2.0:1789760775.877800:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565434880 00000100:00100000:0.0:1789760775.878029:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714091156348 time 714117468378 state 0x0 ref 1 00000100:00100000:0.0:1789760775.878044:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714117728794 time 714117468378 state 0x1 ref 1 00000100:00100000:0.0:1789760775.878133:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714117728794 time 714138424394 state 0x0 ref 1 00000100:00100000:0.0:1789760775.878154:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.878200:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70565888, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a78 00010000:00010000:0.0:1789760775.878209:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.878233:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.878238:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.878244:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.878257:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.883446:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984536 is committed 00002000:00010000:0.0:1789760775.883560:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70565888 -> 70569984 00002000:00010000:0.0:1789760775.883565:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137848 -> 137856 00010000:00010000:0.0:1789760775.883579:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883592:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883600:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883608:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.883612:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883621:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883640:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.883648:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d624 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70565888->70569983] (req 70565888->70569983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.884525:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565434880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6367us (9982us total) trans 4294984536 rc 0/0 00000100:00100000:0.0:1789760775.884538:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17239 00000100:00100000:0.0:1789760775.884547:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714117728794 time 714138424394 state 0x2 ref 0 00000100:00100000:3.0:1789760775.892186:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.892305:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435008 00000100:00100000:0.0:1789760775.892315:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435008 00000100:00100000:0.0:1789760775.892369:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714117728794 time 714138424394 state 0x0 ref 1 00000100:00100000:0.0:1789760775.892384:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714138684810 time 714138424394 state 0x1 ref 1 00000100:00100000:0.0:1789760775.892416:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714138684810 time 714152707650 state 0x0 ref 1 00000100:00100000:0.0:1789760775.892429:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.892483:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70569984, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a80 00010000:00010000:0.0:1789760775.892493:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.892510:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.892514:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.892520:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.892535:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.897037:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984537 is committed 00002000:00010000:0.0:1789760775.897195:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70569984 -> 70574080 00002000:00010000:0.0:1789760775.897201:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137856 -> 137864 00010000:00010000:0.0:1789760775.897217:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897230:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897244:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897252:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.897257:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897265:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897284:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.897290:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d62b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70569984->70574079] (req 70569984->70574079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.897392:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4961us (5213us total) trans 4294984537 rc 0/0 00000100:00100000:0.0:1789760775.897403:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17240 00000100:00100000:0.0:1789760775.897413:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714138684810 time 714152707650 state 0x2 ref 0 00000100:00100000:0.0:1789760775.913195:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.913335:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435136 00000100:00100000:2.0:1789760775.913344:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435136 00000100:00100000:2.0:1789760775.913393:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714138684810 time 714152707650 state 0x0 ref 1 00000100:00100000:2.0:1789760775.913408:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714152968066 time 714152707650 state 0x1 ref 1 00000100:00100000:2.0:1789760775.913431:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714152968066 time 714173723853 state 0x0 ref 1 00000100:00100000:2.0:1789760775.913443:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.913490:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70574080, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a88 00010000:00010000:2.0:1789760775.913502:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.913519:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.913524:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.913530:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.913543:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.919588:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984538 is committed 00002000:00010000:0.0:1789760775.920148:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70574080 -> 70578176 00002000:00010000:0.0:1789760775.920154:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137864 -> 137872 00010000:00010000:0.0:1789760775.920168:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920181:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920190:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920197:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.920202:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920211:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920229:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.920237:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d632 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70574080->70578175] (req 70574080->70578175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.920331:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6884us (7140us total) trans 4294984538 rc 0/0 00000100:00100000:0.0:1789760775.920342:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17241 00000100:00100000:0.0:1789760775.920351:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714152968066 time 714173723853 state 0x2 ref 0 00000100:00100000:3.0:1789760775.925106:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.925249:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435264 00000100:00100000:0.0:1789760775.925260:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435264 00000100:00100000:0.0:1789760775.925315:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714152968066 time 714173723853 state 0x0 ref 1 00000100:00100000:0.0:1789760775.925330:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714173984269 time 714173723853 state 0x1 ref 1 00000100:00100000:0.0:1789760775.925365:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714173984269 time 714185656452 state 0x0 ref 1 00000100:00100000:0.0:1789760775.925381:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565435264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.925432:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70578176, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a90 00010000:00010000:0.0:1789760775.925443:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.925461:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.925466:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.925474:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.925490:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.934032:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984539 is committed 00002000:00010000:3.0:1789760775.934278:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70578176 -> 70582272 00002000:00010000:3.0:1789760775.934283:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137872 -> 137880 00010000:00010000:3.0:1789760775.934297:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934309:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934318:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934325:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760775.934330:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934339:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934357:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.934370:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674d639 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70578176->70582271] (req 70578176->70582271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.934477:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565435264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9095us (9373us total) trans 4294984539 rc 0/0 00000100:00100000:3.0:1789760775.934487:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17242 00000100:00100000:3.0:1789760775.934498:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714173984269 time 714185656452 state 0x2 ref 0 00000100:00100000:3.0:1789760775.938928:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.939255:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435392 00000100:00100000:0.0:1789760775.939264:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435392 00000100:00100000:0.0:1789760775.939320:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714173984269 time 714185656452 state 0x0 ref 1 00000100:00100000:0.0:1789760775.939335:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714185916868 time 714185656452 state 0x1 ref 1 00000100:00100000:0.0:1789760775.939360:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714185916868 time 714199652692 state 0x0 ref 1 00000100:00100000:0.0:1789760775.939374:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565435392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.939434:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70582272, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0x21a98 00010000:00010000:0.0:1789760775.939443:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.939612:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.939619:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.939627:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.939642:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.950674:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984540 is committed 00002000:00010000:0.0:1789760775.951559:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70582272 -> 70586368 00002000:00010000:0.0:1789760775.951565:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760775 -> 1789760776 00002000:00010000:0.0:1789760775.951568:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760775 -> 1789760776 00002000:00010000:0.0:1789760775.951570:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137880 -> 137888 00010000:00010000:0.0:1789760775.951584:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951595:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951605:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951617:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.951622:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951631:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951650:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.951658:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d640 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70582272->70586367] (req 70582272->70586367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.952330:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565435392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12950us (13403us total) trans 4294984540 rc 0/0 00000100:00100000:1.0:1789760775.952343:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17243 00000100:00100000:1.0:1789760775.952354:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714185916868 time 714199652692 state 0x2 ref 0 00000100:00100000:0.0:1789760775.962982:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760775.963521:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435520 00000100:00100000:2.0:1789760775.963531:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435520 00000100:00100000:2.0:1789760775.963586:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714185916868 time 714199652692 state 0x0 ref 1 00000100:00100000:2.0:1789760775.963600:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714199913108 time 714199652692 state 0x1 ref 1 00000100:00100000:2.0:1789760775.963634:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714199913108 time 714223926405 state 0x0 ref 1 00000100:00100000:2.0:1789760775.963648:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760775.963855:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70586368, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21aa0 00010000:00010000:2.0:1789760775.963865:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.963881:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760775.963885:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.963891:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.963905:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.970913:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984541 is committed 00002000:00010000:2.0:1789760775.971151:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70586368 -> 70590464 00002000:00010000:2.0:1789760775.971156:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137888 -> 137896 00010000:00010000:2.0:1789760775.971170:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971181:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971190:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971197:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760775.971201:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971209:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971227:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.971238:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d647 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70586368->70590463] (req 70586368->70590463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.971383:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7733us (8406us total) trans 4294984541 rc 0/0 00000100:00100000:2.0:1789760775.971395:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17244 00000100:00100000:2.0:1789760775.971403:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714199913108 time 714223926405 state 0x2 ref 0 00000100:00100000:3.0:1789760775.975256:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760775.975340:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435648 00000100:00100000:0.0:1789760775.975350:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435648 00000100:00100000:0.0:1789760775.975405:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714199913108 time 714223926405 state 0x0 ref 1 00000100:00100000:0.0:1789760775.975422:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714224186821 time 714223926405 state 0x1 ref 1 00000100:00100000:0.0:1789760775.975513:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714224186821 time 714235804109 state 0x0 ref 1 00000100:00100000:0.0:1789760775.975529:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760775.975577:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70590464, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21aa8 00010000:00010000:0.0:1789760775.975586:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.975601:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789760775.975605:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.975611:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.975635:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760775.987503:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984542 is committed 00002000:00010000:0.0:1789760775.987618:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70590464 -> 70594560 00002000:00010000:0.0:1789760775.987623:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137896 -> 137904 00010000:00010000:0.0:1789760775.987635:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987648:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987657:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987664:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760775.987669:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987677:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987696:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.987766:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674d64e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70590464->70594559] (req 70590464->70594559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760775.988030:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565435648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12500us (12778us total) trans 4294984542 rc 0/0 00000100:00100000:1.0:1789760775.988042:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17245 00000100:00100000:1.0:1789760775.988052:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714224186821 time 714235804109 state 0x2 ref 0 00000100:00100000:3.0:1789760775.994056:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760775.994292:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435776 00000100:00100000:1.0:1789760775.994302:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435776 00000100:00100000:1.0:1789760775.994355:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714224186821 time 714235804109 state 0x0 ref 1 00000100:00100000:1.0:1789760775.994369:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714236064525 time 714235804109 state 0x1 ref 1 00000100:00100000:1.0:1789760775.994404:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714236064525 time 714254695717 state 0x0 ref 1 00000100:00100000:1.0:1789760775.994415:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565435776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760775.994461:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70594560, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ab0 00010000:00010000:1.0:1789760775.994470:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.994485:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760775.994489:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.994495:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.994512:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.006584:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984543 is committed 00002000:00010000:1.0:1789760776.006768:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70594560 -> 70598656 00002000:00010000:1.0:1789760776.006773:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137904 -> 137912 00010000:00010000:1.0:1789760776.006786:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006798:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006815:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006828:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.006832:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006842:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006861:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.006869:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d655 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70594560->70598655] (req 70594560->70598655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.007183:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565435776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12764us (13131us total) trans 4294984543 rc 0/0 00000100:00100000:1.0:1789760776.007194:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17246 00000100:00100000:1.0:1789760776.007204:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714236064525 time 714254695717 state 0x2 ref 0 00000100:00100000:0.0:1789760776.012428:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.012582:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565435904 00000100:00100000:2.0:1789760776.012592:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565435904 00000100:00100000:2.0:1789760776.012660:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714236064525 time 714254695717 state 0x0 ref 1 00000100:00100000:2.0:1789760776.012675:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714254956133 time 714254695717 state 0x1 ref 1 00000100:00100000:2.0:1789760776.012789:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714254956133 time 714273080345 state 0x0 ref 1 00000100:00100000:2.0:1789760776.012802:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565435904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.012855:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70598656, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ab8 00010000:00010000:2.0:1789760776.012864:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.012879:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.012884:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.012890:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.012903:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760776.013559:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760776.019989:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984544 is committed 00002000:00010000:2.0:1789760776.020099:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70598656 -> 70602752 00002000:00010000:2.0:1789760776.020104:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137912 -> 137920 00010000:00010000:2.0:1789760776.020118:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020131:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020140:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020146:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.020151:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020159:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020177:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.020190:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d65c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70598656->70602751] (req 70598656->70602751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.020333:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565435904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7528us (7909us total) trans 4294984544 rc 0/0 00000100:00100000:2.0:1789760776.020343:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17247 00000100:00100000:2.0:1789760776.020352:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714254956133 time 714273080345 state 0x2 ref 0 00000100:00100000:3.0:1789760776.028690:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.028768:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436032 00000100:00100000:1.0:1789760776.028777:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436032 00000100:00100000:1.0:1789760776.028840:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714254956133 time 714273080345 state 0x0 ref 1 00000100:00100000:1.0:1789760776.028855:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714273340761 time 714273080345 state 0x1 ref 1 00000100:00100000:1.0:1789760776.028888:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714273340761 time 714289179455 state 0x0 ref 1 00000100:00100000:1.0:1789760776.028904:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.028950:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70602752, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ac0 00010000:00010000:1.0:1789760776.028959:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.028975:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.028980:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.028986:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.029000:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.047325:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984545 is committed 00002000:00010000:1.0:1789760776.047573:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70602752 -> 70606848 00002000:00010000:1.0:1789760776.047578:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137920 -> 137928 00010000:00010000:1.0:1789760776.047591:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047604:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047613:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047620:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.047626:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047635:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047655:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.047662:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d663 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70602752->70606847] (req 70602752->70606847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.047970:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19063us (19282us total) trans 4294984545 rc 0/0 00000100:00100000:1.0:1789760776.047982:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17248 00000100:00100000:1.0:1789760776.047991:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714273340761 time 714289179455 state 0x2 ref 0 00000100:00100000:3.0:1789760776.055543:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.056057:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436160 00000100:00100000:1.0:1789760776.056067:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436160 00000100:00100000:1.0:1789760776.056179:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714273340761 time 714289179455 state 0x0 ref 1 00000100:00100000:1.0:1789760776.056194:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714289439871 time 714289179455 state 0x1 ref 1 00000100:00100000:1.0:1789760776.056268:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714289439871 time 714316560108 state 0x0 ref 1 00000100:00100000:1.0:1789760776.056282:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.056332:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70606848, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ac8 00010000:00010000:1.0:1789760776.056343:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.056360:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.056364:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.056371:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.056384:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.065072:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984546 is committed 00002000:00010000:1.0:1789760776.065243:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70606848 -> 70610944 00002000:00010000:1.0:1789760776.065248:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137928 -> 137936 00010000:00010000:1.0:1789760776.065262:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065275:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065287:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065294:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.065299:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065309:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065330:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.065338:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d66a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70606848->70610943] (req 70606848->70610943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.065460:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9177us (9921us total) trans 4294984546 rc 0/0 00000100:00100000:1.0:1789760776.065471:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17249 00000100:00100000:1.0:1789760776.065480:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714289439871 time 714316560108 state 0x2 ref 0 00000100:00100000:2.0:1789760776.069546:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.070321:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436288 00000100:00100000:3.0:1789760776.070332:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436288 00000100:00100000:3.0:1789760776.070385:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714289439871 time 714316560108 state 0x0 ref 1 00000100:00100000:3.0:1789760776.070400:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714316820524 time 714316560108 state 0x1 ref 1 00000100:00100000:3.0:1789760776.070466:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714316820524 time 714330757734 state 0x0 ref 1 00000100:00100000:3.0:1789760776.070479:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565436288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.070527:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70610944, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ad0 00010000:00010000:3.0:1789760776.070536:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.070551:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.070555:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.070561:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.070574:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.078497:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984547 is committed 00002000:00010000:3.0:1789760776.079277:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70610944 -> 70615040 00002000:00010000:3.0:1789760776.079283:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137936 -> 137944 00010000:00010000:3.0:1789760776.079296:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079308:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079319:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079327:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.079331:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079340:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079365:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.079374:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d671 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70610944->70615039] (req 70610944->70615039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.079468:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565436288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8987us (9927us total) trans 4294984547 rc 0/0 00000100:00100000:3.0:1789760776.079479:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17250 00000100:00100000:3.0:1789760776.079488:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714316820524 time 714330757734 state 0x2 ref 0 00000100:00100000:3.0:1789760776.085696:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.086785:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436416 00000100:00100000:1.0:1789760776.086797:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436416 00000100:00100000:1.0:1789760776.086849:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714316820524 time 714330757734 state 0x0 ref 1 00000100:00100000:1.0:1789760776.086866:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714331018150 time 714330757734 state 0x1 ref 1 00000100:00100000:1.0:1789760776.086946:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714331018150 time 714347236199 state 0x0 ref 1 00000100:00100000:1.0:1789760776.086960:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.087012:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70615040, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ad8 00010000:00010000:1.0:1789760776.087022:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.087044:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.087048:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.087054:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.087067:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.094695:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984548 is committed 00002000:00010000:1.0:1789760776.094970:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70615040 -> 70619136 00002000:00010000:1.0:1789760776.094982:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137944 -> 137952 00010000:00010000:1.0:1789760776.094996:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095008:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095017:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095025:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.095030:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095039:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095075:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.095084:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d678 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70615040->70619135] (req 70615040->70619135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.095174:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8213us (9482us total) trans 4294984548 rc 0/0 00000100:00100000:1.0:1789760776.095185:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17251 00000100:00100000:1.0:1789760776.095194:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714331018150 time 714347236199 state 0x2 ref 0 00000100:00100000:2.0:1789760776.100266:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.100351:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436544 00000100:00100000:1.0:1789760776.100360:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436544 00000100:00100000:1.0:1789760776.100420:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714331018150 time 714347236199 state 0x0 ref 1 00000100:00100000:1.0:1789760776.100437:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714347496615 time 714347236199 state 0x1 ref 1 00000100:00100000:1.0:1789760776.100499:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714347496615 time 714360791177 state 0x0 ref 1 00000100:00100000:1.0:1789760776.100511:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.100559:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70619136, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ae0 00010000:00010000:1.0:1789760776.100567:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.100583:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.100587:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.100593:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.100607:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.106491:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984549 is committed 00002000:00010000:1.0:1789760776.110154:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70619136 -> 70623232 00002000:00010000:1.0:1789760776.110165:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137952 -> 137960 00010000:00010000:1.0:1789760776.110180:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110194:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110203:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110210:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.110216:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110225:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110244:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.110257:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d67f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70619136->70623231] (req 70619136->70623231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.110384:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9870us (10121us total) trans 4294984549 rc 0/0 00000100:00100000:1.0:1789760776.110395:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17252 00000100:00100000:1.0:1789760776.110404:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714347496615 time 714360791177 state 0x2 ref 0 00000100:00100000:2.0:1789760776.121612:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.122109:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436672 00000100:00100000:3.0:1789760776.122120:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436672 00000100:00100000:3.0:1789760776.122178:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714347496615 time 714360791177 state 0x0 ref 1 00000100:00100000:3.0:1789760776.122194:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714361051593 time 714360791177 state 0x1 ref 1 00000100:00100000:3.0:1789760776.122288:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714361051593 time 714382578530 state 0x0 ref 1 00000100:00100000:3.0:1789760776.122301:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.122351:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70623232, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ae8 00010000:00010000:3.0:1789760776.122361:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.122377:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.122381:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.122388:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.122402:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.127928:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984550 is committed 00002000:00010000:3.0:1789760776.128055:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70623232 -> 70627328 00002000:00010000:3.0:1789760776.128060:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137960 -> 137968 00010000:00010000:3.0:1789760776.128072:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128085:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128103:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128111:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.128116:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128125:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128150:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.128157:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d686 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70623232->70627327] (req 70623232->70627327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.128244:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565436672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5942us (6635us total) trans 4294984550 rc 0/0 00000100:00100000:3.0:1789760776.128254:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17253 00000100:00100000:3.0:1789760776.128263:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714361051593 time 714382578530 state 0x2 ref 0 00000100:00100000:3.0:1789760776.131594:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.131690:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436800 00000100:00100000:1.0:1789760776.131700:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436800 00000100:00100000:1.0:1789760776.131801:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714361051593 time 714382578530 state 0x0 ref 1 00000100:00100000:1.0:1789760776.132008:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714382838946 time 714382578530 state 0x1 ref 1 00000100:00100000:2.0:1789760776.132428:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714382838946 time 714392716413 state 0x0 ref 1 00000100:00100000:2.0:1789760776.132443:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.132495:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70627328, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21af0 00010000:00010000:2.0:1789760776.132504:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.132521:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.132526:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.132533:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.132553:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.142505:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984551 is committed 00002000:00010000:2.0:1789760776.142626:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70627328 -> 70631424 00002000:00010000:2.0:1789760776.142631:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137968 -> 137976 00010000:00010000:2.0:1789760776.142645:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142659:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142670:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142678:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.142683:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142693:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142760:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.142770:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d68d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70627328->70631423] (req 70627328->70631423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.142874:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565436800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10430us (11286us total) trans 4294984551 rc 0/0 00000100:00100000:2.0:1789760776.142886:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17254 00000100:00100000:2.0:1789760776.142896:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714382838946 time 714392716413 state 0x2 ref 0 00000100:00100000:2.0:1789760776.148091:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.148246:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565436928 00000100:00100000:1.0:1789760776.148256:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565436928 00000100:00100000:1.0:1789760776.148308:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714382838946 time 714392716413 state 0x0 ref 1 00000100:00100000:1.0:1789760776.148323:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714392976829 time 714392716413 state 0x1 ref 1 00000100:00100000:1.0:1789760776.148356:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714392976829 time 714408647627 state 0x0 ref 1 00000100:00100000:1.0:1789760776.148369:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565436928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.148414:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70631424, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21af8 00010000:00010000:1.0:1789760776.148423:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.148440:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.148444:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.148450:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.148463:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.155884:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984552 is committed 00002000:00010000:1.0:1789760776.156001:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70631424 -> 70635520 00002000:00010000:1.0:1789760776.156006:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137976 -> 137984 00010000:00010000:1.0:1789760776.156017:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156029:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156037:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156045:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.156050:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156059:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156083:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.156101:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70631424->70635519] (req 70631424->70635519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.156196:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565436928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7824us (8109us total) trans 4294984552 rc 0/0 00000100:00100000:1.0:1789760776.156207:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17255 00000100:00100000:1.0:1789760776.156215:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714392976829 time 714408647627 state 0x2 ref 0 00000100:00100000:0.0:1789760776.159568:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.159658:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437056 00000100:00100000:3.0:1789760776.159667:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437056 00000100:00100000:3.0:1789760776.159774:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714392976829 time 714408647627 state 0x0 ref 1 00000100:00100000:3.0:1789760776.159790:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714408908043 time 714408647627 state 0x1 ref 1 00000100:00100000:3.0:1789760776.159810:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714408908043 time 714420103103 state 0x0 ref 1 00000100:00100000:3.0:1789760776.159823:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565437056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.159869:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70635520, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b00 00010000:00010000:3.0:1789760776.159877:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.159892:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.159897:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.159904:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.159918:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.169104:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984553 is committed 00002000:00010000:2.0:1789760776.169225:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70635520 -> 70639616 00002000:00010000:2.0:1789760776.169230:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137984 -> 137992 00010000:00010000:2.0:1789760776.169242:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169256:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169264:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169272:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.169277:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169286:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169305:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.169314:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674d69b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70635520->70639615] (req 70635520->70639615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.169407:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565437056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9582us (9843us total) trans 4294984553 rc 0/0 00000100:00100000:2.0:1789760776.169417:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17256 00000100:00100000:2.0:1789760776.169426:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714408908043 time 714420103103 state 0x2 ref 0 00000100:00100000:3.0:1789760776.174429:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.174508:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437184 00000100:00100000:2.0:1789760776.174519:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437184 00000100:00100000:2.0:1789760776.174572:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714408908043 time 714420103103 state 0x0 ref 1 00000100:00100000:2.0:1789760776.174587:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714420363519 time 714420103103 state 0x1 ref 1 00000100:00100000:2.0:1789760776.174617:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714420363519 time 714434909350 state 0x0 ref 1 00000100:00100000:2.0:1789760776.174630:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.174677:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70639616, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b08 00010000:00010000:2.0:1789760776.174686:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.174700:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.174760:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.174767:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.174786:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.180142:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984554 is committed 00002000:00010000:2.0:1789760776.180276:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70639616 -> 70643712 00002000:00010000:2.0:1789760776.180281:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137992 -> 138000 00010000:00010000:2.0:1789760776.180293:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180303:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180313:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180320:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.180324:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180333:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180353:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.180361:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70639616->70643711] (req 70639616->70643711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.180450:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5818us (6026us total) trans 4294984554 rc 0/0 00000100:00100000:2.0:1789760776.180461:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17257 00000100:00100000:2.0:1789760776.180470:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714420363519 time 714434909350 state 0x2 ref 0 00000100:00100000:3.0:1789760776.183548:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.188003:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437312 00000100:00100000:1.0:1789760776.188020:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437312 00000100:00100000:1.0:1789760776.188083:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714420363519 time 714434909350 state 0x0 ref 1 00000100:00100000:1.0:1789760776.188098:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714435169766 time 714434909350 state 0x1 ref 1 00000100:00100000:1.0:1789760776.188140:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714435169766 time 714448432101 state 0x0 ref 1 00000100:00100000:1.0:1789760776.188154:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.188201:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70643712, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b10 00010000:00010000:1.0:1789760776.188211:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.188225:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.188230:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.188235:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.188247:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.194435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984555 is committed 00002000:00010000:1.0:1789760776.194603:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70643712 -> 70647808 00002000:00010000:1.0:1789760776.194608:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138000 -> 138008 00010000:00010000:1.0:1789760776.194622:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.194646:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.194656:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.194662:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.194667:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.194675:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.195822:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.195837:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70643712->70647807] (req 70643712->70647807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.195984:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7830us (12442us total) trans 4294984555 rc 0/0 00000100:00100000:1.0:1789760776.195992:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17258 00000100:00100000:1.0:1789760776.196000:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714435169766 time 714448432101 state 0x2 ref 0 00000100:00100000:0.0:1789760776.201770:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.202411:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437440 00000100:00100000:2.0:1789760776.202421:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437440 00000100:00100000:2.0:1789760776.202472:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714435169766 time 714448432101 state 0x0 ref 1 00000100:00100000:2.0:1789760776.202487:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714448692517 time 714448432101 state 0x1 ref 1 00000100:00100000:2.0:1789760776.202516:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714448692517 time 714462809379 state 0x0 ref 1 00000100:00100000:2.0:1789760776.202527:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.202577:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70647808, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b18 00010000:00010000:2.0:1789760776.202586:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.202602:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.202607:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.202613:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.202834:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.211791:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984556 is committed 00002000:00010000:3.0:1789760776.211962:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70647808 -> 70651904 00002000:00010000:3.0:1789760776.211968:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138008 -> 138016 00010000:00010000:3.0:1789760776.211983:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.211996:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.212004:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.212012:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.212142:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.212158:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.212177:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.212184:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d6b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70647808->70651903] (req 70647808->70651903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.212276:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9745us (10510us total) trans 4294984556 rc 0/0 00000100:00100000:3.0:1789760776.212286:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17259 00000100:00100000:3.0:1789760776.212295:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714448692517 time 714462809379 state 0x2 ref 0 00000100:00100000:3.0:1789760776.219929:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.219999:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437568 00000100:00100000:2.0:1789760776.220009:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437568 00000100:00100000:2.0:1789760776.220517:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714448692517 time 714462809379 state 0x0 ref 1 00000100:00100000:2.0:1789760776.220532:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714463069795 time 714462809379 state 0x1 ref 1 00000100:00100000:2.0:1789760776.220612:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714463069795 time 714480902571 state 0x0 ref 1 00000100:00100000:2.0:1789760776.220635:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.220680:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70651904, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b20 00010000:00010000:2.0:1789760776.220689:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.220759:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.220765:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.220771:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.220786:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.225700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984557 is committed 00002000:00010000:2.0:1789760776.225874:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70651904 -> 70656000 00002000:00010000:2.0:1789760776.225879:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138016 -> 138024 00010000:00010000:2.0:1789760776.225892:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225904:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225913:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225920:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.225924:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225932:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225949:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.225957:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674d6b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70651904->70655999] (req 70651904->70655999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.226078:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565437568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5451us (6152us total) trans 4294984557 rc 0/0 00000100:00100000:2.0:1789760776.226097:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17260 00000100:00100000:2.0:1789760776.226106:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714463069795 time 714480902571 state 0x2 ref 0 00000100:00100000:2.0:1789760776.230471:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.233090:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437696 00000100:00100000:1.0:1789760776.233106:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437696 00000100:00100000:1.0:1789760776.233167:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714463069795 time 714480902571 state 0x0 ref 1 00000100:00100000:1.0:1789760776.233182:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714481162987 time 714480902571 state 0x1 ref 1 00000100:00100000:1.0:1789760776.233280:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714481162987 time 714493570690 state 0x0 ref 1 00000100:00100000:1.0:1789760776.233295:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.233356:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70656000, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b28 00010000:00010000:1.0:1789760776.233366:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.233380:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.233385:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.233391:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.233415:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.250809:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984558 is committed 00002000:00010000:1.0:1789760776.250936:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70656000 -> 70660096 00002000:00010000:1.0:1789760776.250941:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138024 -> 138032 00010000:00010000:1.0:1789760776.250955:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.250968:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.250977:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.250985:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.250990:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.250999:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.251018:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.251027:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70656000->70660095] (req 70656000->70660095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.252299:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18999us (21828us total) trans 4294984558 rc 0/0 00000100:00100000:1.0:1789760776.252312:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17261 00000100:00100000:1.0:1789760776.252322:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714481162987 time 714493570690 state 0x2 ref 0 00000100:00100000:0.0:1789760776.257392:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.258061:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437824 00000100:00100000:3.0:1789760776.258072:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437824 00000100:00100000:3.0:1789760776.258200:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714481162987 time 714493570690 state 0x0 ref 1 00000100:00100000:3.0:1789760776.258215:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714493831106 time 714493570690 state 0x1 ref 1 00000100:00100000:3.0:1789760776.258251:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714493831106 time 714518542630 state 0x0 ref 1 00000100:00100000:3.0:1789760776.258264:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565437824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.258311:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70660096, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b30 00010000:00010000:3.0:1789760776.258322:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.258339:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.258343:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.258349:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.258363:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.264498:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984559 is committed 00002000:00010000:3.0:1789760776.264803:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70660096 -> 70664192 00002000:00010000:3.0:1789760776.264809:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138032 -> 138040 00010000:00010000:3.0:1789760776.264821:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264834:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264844:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264853:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.264858:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264867:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264887:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.264894:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70660096->70664191] (req 70660096->70664191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.265021:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565437824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6754us (7633us total) trans 4294984559 rc 0/0 00000100:00100000:3.0:1789760776.265033:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17262 00000100:00100000:3.0:1789760776.265041:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714493831106 time 714518542630 state 0x2 ref 0 00000100:00100000:3.0:1789760776.270210:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.270598:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565437952 00000100:00100000:2.0:1789760776.270609:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565437952 00000100:00100000:2.0:1789760776.270664:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714493831106 time 714518542630 state 0x0 ref 1 00000100:00100000:2.0:1789760776.270679:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714518803046 time 714518542630 state 0x1 ref 1 00000100:00100000:2.0:1789760776.270882:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714518803046 time 714531172597 state 0x0 ref 1 00000100:00100000:2.0:1789760776.270896:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.270941:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70664192, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b38 00010000:00010000:2.0:1789760776.270950:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.270965:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.270969:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.270974:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.270988:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.278272:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984560 is committed 00002000:00010000:2.0:1789760776.278455:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70664192 -> 70668288 00002000:00010000:2.0:1789760776.278460:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138040 -> 138048 00010000:00010000:2.0:1789760776.278474:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278491:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278499:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278507:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.278512:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278520:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278537:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.278544:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70664192->70668287] (req 70664192->70668287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.278632:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565437952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7735us (8428us total) trans 4294984560 rc 0/0 00000100:00100000:2.0:1789760776.278644:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17263 00000100:00100000:2.0:1789760776.278653:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714518803046 time 714531172597 state 0x2 ref 0 00000100:00100000:2.0:1789760776.286032:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.286524:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438080 00000100:00100000:1.0:1789760776.286534:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438080 00000100:00100000:1.0:1789760776.286669:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714518803046 time 714531172597 state 0x0 ref 1 00000100:00100000:1.0:1789760776.286683:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714531433013 time 714531172597 state 0x1 ref 1 00000100:00100000:1.0:1789760776.286768:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714531433013 time 714547059950 state 0x0 ref 1 00000100:00100000:1.0:1789760776.286782:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565438080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.286831:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70668288, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b40 00010000:00010000:1.0:1789760776.286840:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.286855:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.286859:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.286866:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.286884:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.293223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984561 is committed 00002000:00010000:1.0:1789760776.293353:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70668288 -> 70672384 00002000:00010000:1.0:1789760776.293358:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138048 -> 138056 00010000:00010000:1.0:1789760776.293371:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293384:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293394:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293401:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.293406:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293415:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293432:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.293440:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674d6d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70668288->70672383] (req 70668288->70672383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.293532:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565438080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6749us (7705us total) trans 4294984561 rc 0/0 00000100:00100000:1.0:1789760776.293543:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17264 00000100:00100000:1.0:1789760776.293553:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714531433013 time 714547059950 state 0x2 ref 0 00000100:00100000:1.0:1789760776.298834:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.298935:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438208 00000100:00100000:3.0:1789760776.298951:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438208 00000100:00100000:3.0:1789760776.299027:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714531433013 time 714547059950 state 0x0 ref 1 00000100:00100000:3.0:1789760776.299048:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714547320366 time 714547059950 state 0x1 ref 1 00000100:00100000:3.0:1789760776.299097:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714547320366 time 714559379080 state 0x0 ref 1 00000100:00100000:3.0:1789760776.299122:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565438208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.299189:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70672384, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b48 00010000:00010000:3.0:1789760776.299201:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.299237:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.299243:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.299252:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.299270:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.304734:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984562 is committed 00002000:00010000:3.0:1789760776.304916:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70672384 -> 70676480 00002000:00010000:3.0:1789760776.304921:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138056 -> 138064 00010000:00010000:3.0:1789760776.304934:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.304946:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.304955:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.304963:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.304967:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.304976:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.305000:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.305008:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70672384->70676479] (req 70672384->70676479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.305179:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565438208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6057us (6348us total) trans 4294984562 rc 0/0 00000100:00100000:3.0:1789760776.305191:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17265 00000100:00100000:3.0:1789760776.305200:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714547320366 time 714559379080 state 0x2 ref 0 00000100:00100000:3.0:1789760776.312980:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.313501:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438336 00000100:00100000:2.0:1789760776.313511:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438336 00000100:00100000:2.0:1789760776.313563:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714547320366 time 714559379080 state 0x0 ref 1 00000100:00100000:2.0:1789760776.313578:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714559639496 time 714559379080 state 0x1 ref 1 00000100:00100000:2.0:1789760776.313613:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714559639496 time 714573905817 state 0x0 ref 1 00000100:00100000:2.0:1789760776.313626:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.313674:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70676480, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b50 00010000:00010000:2.0:1789760776.313684:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.313700:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.313762:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.313770:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.313786:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.318098:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984563 is committed 00002000:00010000:2.0:1789760776.318229:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70676480 -> 70680576 00002000:00010000:2.0:1789760776.318234:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138064 -> 138072 00010000:00010000:2.0:1789760776.318247:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318266:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318276:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318283:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.318287:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318296:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318315:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.318322:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70676480->70680575] (req 70676480->70680575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.318449:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4820us (5472us total) trans 4294984563 rc 0/0 00000100:00100000:2.0:1789760776.318472:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17266 00000100:00100000:2.0:1789760776.318482:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714559639496 time 714573905817 state 0x2 ref 0 00000100:00100000:0.0:1789760776.331183:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760776.332860:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438464 00000100:00100000:1.0:1789760776.332888:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438464 00000100:00100000:1.0:1789760776.332952:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714559639496 time 714573905817 state 0x0 ref 1 00000100:00100000:1.0:1789760776.332968:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714574166233 time 714573905817 state 0x1 ref 1 00000100:00100000:1.0:1789760776.333195:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714574166233 time 714593485278 state 0x0 ref 1 00000100:00100000:1.0:1789760776.333210:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565438464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.333258:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70680576, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b58 00010000:00010000:1.0:1789760776.333268:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.333283:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1789760776.333288:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.333294:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.333307:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.340874:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984564 is committed 00002000:00010000:2.0:1789760776.341828:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70680576 -> 70684672 00002000:00010000:2.0:1789760776.341840:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138072 -> 138080 00010000:00010000:2.0:1789760776.341858:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341873:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341882:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341890:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.341896:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341907:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341932:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.341940:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d6e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70680576->70684671] (req 70680576->70684671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.342078:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565438464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8864us (10897us total) trans 4294984564 rc 0/0 00000100:00100000:2.0:1789760776.342091:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17267 00000100:00100000:2.0:1789760776.342104:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714574166233 time 714593485278 state 0x2 ref 0 00000100:00100000:1.0:1789760776.363164:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.363292:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438592 00000100:00100000:3.0:1789760776.363305:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438592 00000100:00100000:3.0:1789760776.363381:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714574166233 time 714593485278 state 0x0 ref 1 00000100:00100000:3.0:1789760776.363402:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714593745694 time 714593485278 state 0x1 ref 1 00000100:00100000:3.0:1789760776.363440:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714593745694 time 714623731429 state 0x0 ref 1 00000100:00100000:3.0:1789760776.363455:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.363522:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70684672, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b60 00010000:00010000:3.0:1789760776.363534:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.363559:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.363564:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.363572:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.363588:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.374889:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984565 is committed 00002000:00010000:3.0:1789760776.375197:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70684672 -> 70688768 00002000:00010000:3.0:1789760776.375203:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138080 -> 138088 00010000:00010000:3.0:1789760776.375216:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375229:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375238:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375245:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.375250:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375259:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375284:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.375292:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d6ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70684672->70688767] (req 70684672->70688767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.375433:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11976us (12280us total) trans 4294984565 rc 0/0 00000100:00100000:3.0:1789760776.375442:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17268 00000100:00100000:3.0:1789760776.375451:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714593745694 time 714623731429 state 0x2 ref 0 00000100:00100000:3.0:1789760776.382944:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.383060:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438720 00000100:00100000:2.0:1789760776.383077:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438720 00000100:00100000:2.0:1789760776.383144:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714593745694 time 714623731429 state 0x0 ref 1 00000100:00100000:2.0:1789760776.383160:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714623991845 time 714623731429 state 0x1 ref 1 00000100:00100000:2.0:1789760776.383199:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714623991845 time 714643491189 state 0x0 ref 1 00000100:00100000:2.0:1789760776.383214:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.383264:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70688768, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b68 00010000:00010000:2.0:1789760776.383274:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.383291:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.383296:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.383302:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.383316:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.391095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984566 is committed 00002000:00010000:2.0:1789760776.391260:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70688768 -> 70692864 00002000:00010000:2.0:1789760776.391266:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138088 -> 138096 00010000:00010000:2.0:1789760776.391279:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391299:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391308:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391315:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.391321:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391331:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391352:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.391361:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d6f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70688768->70692863] (req 70688768->70692863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.391465:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565438720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8249us (8532us total) trans 4294984566 rc 0/0 00000100:00100000:2.0:1789760776.391476:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17269 00000100:00100000:2.0:1789760776.391487:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714623991845 time 714643491189 state 0x2 ref 0 00000100:00100000:0.0:1789760776.396894:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1789760776.398804:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760776.399302:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438848 00000100:00100000:3.0:1789760776.399316:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438848 00000100:00100000:3.0:1789760776.399375:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714623991845 time 714643491189 state 0x0 ref 1 00000100:00100000:3.0:1789760776.399390:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714643751605 time 714643491189 state 0x1 ref 1 00000100:00100000:3.0:1789760776.399509:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714643751605 time 714659799763 state 0x0 ref 1 00000100:00100000:3.0:1789760776.399523:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565438848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.399571:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70692864, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b70 00010000:00010000:3.0:1789760776.399581:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.399604:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.399608:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.399614:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.399627:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.407995:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984567 is committed 00002000:00010000:3.0:1789760776.408127:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70692864 -> 70696960 00002000:00010000:3.0:1789760776.408133:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138096 -> 138104 00010000:00010000:3.0:1789760776.408145:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408157:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408166:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408173:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.408178:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408187:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408210:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.408219:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d6fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70692864->70696959] (req 70692864->70696959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.408308:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565438848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8782us (11417us total) trans 4294984567 rc 0/0 00000100:00100000:3.0:1789760776.408318:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17270 00000100:00100000:3.0:1789760776.408327:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714643751605 time 714659799763 state 0x2 ref 0 00000100:00100000:1.0:1789760776.414962:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.415062:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565438976 00000100:00100000:3.0:1789760776.415071:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565438976 00000100:00100000:3.0:1789760776.415548:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714643751605 time 714659799763 state 0x0 ref 1 00000100:00100000:3.0:1789760776.415566:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714660060179 time 714659799763 state 0x1 ref 1 00000100:00100000:3.0:1789760776.415600:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714660060179 time 714675892166 state 0x0 ref 1 00000100:00100000:3.0:1789760776.415615:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565438976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.415661:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70696960, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b78 00010000:00010000:3.0:1789760776.415672:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.415688:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.415692:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.415699:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.416554:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.423317:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984568 is committed 00002000:00010000:3.0:1789760776.423453:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70696960 -> 70701056 00002000:00010000:3.0:1789760776.423470:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138104 -> 138112 00010000:00010000:3.0:1789760776.423604:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423618:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423627:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423636:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.423641:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423651:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423672:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.423685:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d704 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70696960->70701055] (req 70696960->70701055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.424450:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565438976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8832us (9491us total) trans 4294984568 rc 0/0 00000100:00100000:2.0:1789760776.424476:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17271 00000100:00100000:2.0:1789760776.424486:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714660060179 time 714675892166 state 0x2 ref 0 00000100:00100000:0.0:1789760776.438208:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.438324:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439104 00000100:00100000:2.0:1789760776.438334:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439104 00000100:00100000:2.0:1789760776.438392:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714660060179 time 714675892166 state 0x0 ref 1 00000100:00100000:2.0:1789760776.438406:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714676152582 time 714675892166 state 0x1 ref 1 00000100:00100000:2.0:1789760776.438437:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714676152582 time 714698729189 state 0x0 ref 1 00000100:00100000:2.0:1789760776.438450:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565439104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.438493:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70701056, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b80 00010000:00010000:2.0:1789760776.438502:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.438519:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.438523:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.438529:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.438543:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.446793:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984569 is committed 00002000:00010000:2.0:1789760776.446909:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70701056 -> 70705152 00002000:00010000:2.0:1789760776.446913:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138112 -> 138120 00010000:00010000:2.0:1789760776.446926:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446938:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446948:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446957:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.446962:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446971:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446991:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.446999:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d70b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70701056->70705151] (req 70701056->70705151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.447101:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565439104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8641us (8891us total) trans 4294984569 rc 0/0 00000100:00100000:2.0:1789760776.447112:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17272 00000100:00100000:2.0:1789760776.447122:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714676152582 time 714698729189 state 0x2 ref 0 00000100:00100000:0.0:1789760776.462137:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.462417:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439232 00000100:00100000:3.0:1789760776.462428:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439232 00000100:00100000:3.0:1789760776.462482:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714676152582 time 714698729189 state 0x0 ref 1 00000100:00100000:3.0:1789760776.462498:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714698989605 time 714698729189 state 0x1 ref 1 00000100:00100000:3.0:1789760776.462579:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714698989605 time 714722869817 state 0x0 ref 1 00000100:00100000:3.0:1789760776.462593:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565439232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760776.462640:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70705152, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b88 00010000:00010000:3.0:1789760776.462650:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.462667:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789760776.462671:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760776.462678:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.462734:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.470918:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984570 is committed 00002000:00010000:3.0:1789760776.471253:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70705152 -> 70709248 00002000:00010000:3.0:1789760776.471259:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138120 -> 138128 00010000:00010000:3.0:1789760776.471273:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471285:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471294:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471302:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.471307:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471316:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471334:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.471342:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d712 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70705152->70709247] (req 70705152->70709247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.471972:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565439232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9376us (9839us total) trans 4294984570 rc 0/0 00000100:00100000:2.0:1789760776.471983:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17273 00000100:00100000:2.0:1789760776.471992:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714698989605 time 714722869817 state 0x2 ref 0 00000100:00100000:1.0:1789760776.477613:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.477695:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439360 00000100:00100000:2.0:1789760776.477738:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439360 00000100:00100000:2.0:1789760776.477949:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714698989605 time 714722869817 state 0x0 ref 1 00000100:00100000:2.0:1789760776.477965:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714723130233 time 714722869817 state 0x1 ref 1 00000100:00100000:2.0:1789760776.477995:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714723130233 time 714738287047 state 0x0 ref 1 00000100:00100000:2.0:1789760776.478010:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.478056:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70709248, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b90 00010000:00010000:2.0:1789760776.478065:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.478081:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.478197:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.478205:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.478227:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.489881:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984571 is committed 00002000:00010000:2.0:1789760776.490131:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70709248 -> 70713344 00002000:00010000:2.0:1789760776.490136:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138128 -> 138136 00010000:00010000:2.0:1789760776.490151:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490163:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490172:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490180:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.490185:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490194:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490214:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.490222:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d719 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70709248->70713343] (req 70709248->70713343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.490357:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12346us (12749us total) trans 4294984571 rc 0/0 00000100:00100000:2.0:1789760776.490367:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17274 00000100:00100000:2.0:1789760776.490377:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714723130233 time 714738287047 state 0x2 ref 0 00000100:00100000:0.0:1789760776.500119:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.501260:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439488 00000100:00100000:2.0:1789760776.501278:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439488 00000100:00100000:2.0:1789760776.501341:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714723130233 time 714738287047 state 0x0 ref 1 00000100:00100000:2.0:1789760776.501357:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714738547463 time 714738287047 state 0x1 ref 1 00000100:00100000:2.0:1789760776.501448:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714738547463 time 714761740077 state 0x0 ref 1 00000100:00100000:2.0:1789760776.501463:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.502008:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70713344, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21b98 00010000:00010000:2.0:1789760776.502019:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.502034:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.502038:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.502044:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.502057:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.513360:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984572 is committed 00002000:00010000:0.0:1789760776.513534:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70713344 -> 70717440 00002000:00010000:0.0:1789760776.513540:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138136 -> 138144 00010000:00010000:0.0:1789760776.513556:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513570:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513580:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513587:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.513591:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513599:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513618:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.513625:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674d720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70713344->70717439] (req 70713344->70717439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.513796:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12330us (13682us total) trans 4294984572 rc 0/0 00000100:00100000:0.0:1789760776.513807:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17275 00000100:00100000:0.0:1789760776.513818:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714738547463 time 714761740077 state 0x2 ref 0 00000100:00100000:0.0:1789760776.520986:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.521084:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439616 00000100:00100000:2.0:1789760776.521094:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439616 00000100:00100000:2.0:1789760776.521143:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714738547463 time 714761740077 state 0x0 ref 1 00000100:00100000:2.0:1789760776.521160:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714762000493 time 714761740077 state 0x1 ref 1 00000100:00100000:2.0:1789760776.521194:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714762000493 time 714781485692 state 0x0 ref 1 00000100:00100000:2.0:1789760776.521206:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565439616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.521256:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70717440, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ba0 00010000:00010000:2.0:1789760776.521266:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.521280:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.521285:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.521291:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.521304:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.530781:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984573 is committed 00002000:00010000:2.0:1789760776.533858:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70717440 -> 70721536 00002000:00010000:2.0:1789760776.533868:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138144 -> 138152 00010000:00010000:2.0:1789760776.533881:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.533894:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.533903:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.533975:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.533980:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.533991:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.534011:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.534019:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d727 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70717440->70721535] (req 70717440->70721535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.534111:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565439616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12902us (13199us total) trans 4294984573 rc 0/0 00000100:00100000:2.0:1789760776.534219:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17276 00000100:00100000:2.0:1789760776.534229:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714762000493 time 714781485692 state 0x2 ref 0 00000100:00100000:1.0:1789760776.541841:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.542014:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439744 00000100:00100000:2.0:1789760776.542025:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439744 00000100:00100000:2.0:1789760776.542080:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714762000493 time 714781485692 state 0x0 ref 1 00000100:00100000:2.0:1789760776.542096:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714781746108 time 714781485692 state 0x1 ref 1 00000100:00100000:2.0:1789760776.543250:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714781746108 time 714802422173 state 0x0 ref 1 00000100:00100000:2.0:1789760776.543281:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.543328:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70721536, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21ba8 00010000:00010000:2.0:1789760776.543338:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.543354:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.543361:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.543367:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.543381:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.558316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984574 is committed 00002000:00010000:2.0:1789760776.558582:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70721536 -> 70725632 00002000:00010000:2.0:1789760776.558587:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138152 -> 138160 00010000:00010000:2.0:1789760776.558599:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558612:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558626:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558634:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.558639:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558649:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558668:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.558676:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d72e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70721536->70725631] (req 70721536->70725631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.558933:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565439744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15657us (17095us total) trans 4294984574 rc 0/0 00000100:00100000:2.0:1789760776.558942:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17277 00000100:00100000:2.0:1789760776.558950:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714781746108 time 714802422173 state 0x2 ref 0 00000100:00100000:0.0:1789760776.564506:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.564589:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565439872 00000100:00100000:2.0:1789760776.564598:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565439872 00000100:00100000:2.0:1789760776.564650:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714781746108 time 714802422173 state 0x0 ref 1 00000100:00100000:2.0:1789760776.564665:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714802682589 time 714802422173 state 0x1 ref 1 00000100:00100000:2.0:1789760776.564697:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714802682589 time 714824989200 state 0x0 ref 1 00000100:00100000:2.0:1789760776.564737:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565439872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.564794:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70725632, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bb0 00010000:00010000:2.0:1789760776.564804:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.564819:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.564823:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.564830:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.564843:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.574311:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984575 is committed 00002000:00010000:0.0:1789760776.574418:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70725632 -> 70729728 00002000:00010000:0.0:1789760776.574423:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138160 -> 138168 00010000:00010000:0.0:1789760776.574437:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574449:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574457:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574464:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.574469:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574478:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574498:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.574504:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674d735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70725632->70729727] (req 70725632->70729727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.574594:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565439872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9856us (10093us total) trans 4294984575 rc 0/0 00000100:00100000:0.0:1789760776.574604:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17278 00000100:00100000:0.0:1789760776.574613:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714802682589 time 714824989200 state 0x2 ref 0 00000100:00100000:3.0:1789760776.592271:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.592318:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.592360:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.592384:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760776.592410:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440128 00000100:00100000:3.0:1789760776.592423:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440128 00000100:00100000:3.0:1789760776.592472:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 396 00000100:00100000:3.0:1789760776.592481:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2357:x1876699565440128:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760776.592542:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440256 00000100:00100000:1.0:1789760776.592548:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440256 00000100:00100000:3.0:1789760776.592549:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2357:x1876699565440128:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.592584:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440384 00000100:00100000:1.0:1789760776.592587:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440384 00000100:00100000:1.0:1789760776.592620:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 462 00000100:00100000:1.0:1789760776.592629:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2357:x1876699565440256:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760776.592664:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2357:x1876699565440256:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.592671:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 462 00000100:00100000:1.0:1789760776.592688:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 463 00000100:00100000:1.0:1789760776.592693:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2357:x1876699565440384:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760776.592760:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2357:x1876699565440384:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.592766:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 463 00000100:00100000:2.0:1789760776.592826:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440000 00000100:00100000:2.0:1789760776.592831:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440000 00000100:00100000:2.0:1789760776.592867:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714802682589 time 714824989200 state 0x0 ref 1 00000100:00100000:2.0:1789760776.592881:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714825249616 time 714824989200 state 0x1 ref 1 00000100:00100000:2.0:1789760776.592900:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714825249616 time 714853191742 state 0x0 ref 1 00000100:00100000:2.0:1789760776.592910:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565440000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.592955:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70729728, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bb8 00010000:00010000:2.0:1789760776.592965:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.592981:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.592987:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.592993:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.593008:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.593549:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 396 00000100:00080000:0.0:1789760776.594879:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789760776.602255:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984576 is committed 00002000:00010000:2.0:1789760776.602460:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70729728 -> 70733824 00002000:00010000:2.0:1789760776.602465:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138168 -> 138176 00010000:00010000:2.0:1789760776.602478:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602490:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602498:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602504:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.602509:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602521:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602539:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.602546:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d73c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70729728->70733823] (req 70729728->70733823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.602638:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565440000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9725us (10372us total) trans 4294984576 rc 0/0 00000100:00100000:2.0:1789760776.602648:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17279 00000100:00100000:2.0:1789760776.602657:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714825249616 time 714853191742 state 0x2 ref 0 00000100:00100000:3.0:1789760776.607758:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.607860:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440512 00000100:00100000:2.0:1789760776.607871:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440512 00000100:00100000:2.0:1789760776.607925:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714825249616 time 714853191742 state 0x0 ref 1 00000100:00100000:2.0:1789760776.607940:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714853452158 time 714853191742 state 0x1 ref 1 00000100:00100000:2.0:1789760776.607960:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714853452158 time 714868252341 state 0x0 ref 1 00000100:00100000:2.0:1789760776.607971:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565440512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.608017:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70733824, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bc0 00010000:00010000:2.0:1789760776.608026:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.608043:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.608048:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.608054:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.608067:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.617640:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984577 is committed 00002000:00010000:2.0:1789760776.617823:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70733824 -> 70737920 00002000:00010000:2.0:1789760776.617829:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138176 -> 138184 00010000:00010000:2.0:1789760776.617842:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617914:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617924:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617931:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.617935:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617945:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617970:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.617979:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d743 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70733824->70737919] (req 70733824->70737919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.618121:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565440512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10145us (10417us total) trans 4294984577 rc 0/0 00000100:00100000:2.0:1789760776.618139:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17280 00000100:00100000:2.0:1789760776.618149:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714853452158 time 714868252341 state 0x2 ref 0 00000100:00100000:0.0:1789760776.624843:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.625124:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440640 00000100:00100000:2.0:1789760776.625301:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440640 00000100:00100000:2.0:1789760776.625357:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714853452158 time 714868252341 state 0x0 ref 1 00000100:00100000:2.0:1789760776.625373:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714868512757 time 714868252341 state 0x1 ref 1 00000100:00100000:2.0:1789760776.625402:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714868512757 time 714885693980 state 0x0 ref 1 00000100:00100000:2.0:1789760776.625415:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565440640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.625459:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70737920, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bc8 00010000:00010000:2.0:1789760776.625468:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.625484:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.625489:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.625495:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.625511:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760776.635422:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984578 is committed 00002000:00010000:2.0:1789760776.635602:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70737920 -> 70742016 00002000:00010000:2.0:1789760776.635607:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138184 -> 138192 00010000:00010000:2.0:1789760776.635622:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635636:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635646:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635654:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.635660:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635670:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635765:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.635781:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d74a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70737920->70742015] (req 70737920->70742015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.635987:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565440640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10569us (11147us total) trans 4294984578 rc 0/0 00000100:00100000:2.0:1789760776.635999:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17281 00000100:00100000:2.0:1789760776.636009:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714868512757 time 714885693980 state 0x2 ref 0 00000100:00100000:0.0:1789760776.643495:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.643790:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440768 00000100:00100000:2.0:1789760776.643800:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440768 00000100:00100000:2.0:1789760776.643865:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714868512757 time 714885693980 state 0x0 ref 1 00000100:00100000:2.0:1789760776.643880:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714885954396 time 714885693980 state 0x1 ref 1 00000100:00100000:2.0:1789760776.643901:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714885954396 time 714904193208 state 0x0 ref 1 00000100:00100000:2.0:1789760776.643913:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565440768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.643957:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70742016, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bd0 00010000:00010000:2.0:1789760776.643967:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.643984:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.643988:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.643995:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.644015:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.654479:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984579 is committed 00002000:00010000:2.0:1789760776.654826:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70742016 -> 70746112 00002000:00010000:2.0:1789760776.654832:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138192 -> 138200 00010000:00010000:2.0:1789760776.654845:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.654858:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.655167:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.655176:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.655182:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.655192:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.655213:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.655221:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70742016->70746111] (req 70742016->70746111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.655592:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565440768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11675us (12101us total) trans 4294984579 rc 0/0 00000100:00100000:2.0:1789760776.655605:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17282 00000100:00100000:2.0:1789760776.655614:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714885954396 time 714904193208 state 0x2 ref 0 00000100:00100000:3.0:1789760776.661563:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.663200:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565440896 00000100:00100000:2.0:1789760776.663213:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565440896 00000100:00100000:2.0:1789760776.663270:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714885954396 time 714904193208 state 0x0 ref 1 00000100:00100000:2.0:1789760776.663283:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714904453624 time 714904193208 state 0x1 ref 1 00000100:00100000:2.0:1789760776.663366:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714904453624 time 714923657539 state 0x0 ref 1 00000100:00100000:2.0:1789760776.663447:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565440896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.663569:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70746112, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bd8 00010000:00010000:2.0:1789760776.663579:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.663594:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.663599:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.663605:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.663620:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.672062:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984580 is committed 00002000:00010000:2.0:1789760776.672282:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70746112 -> 70750208 00002000:00010000:2.0:1789760776.672288:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138200 -> 138208 00010000:00010000:2.0:1789760776.672301:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672322:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672330:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672337:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.672341:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672351:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672370:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.672377:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70746112->70750207] (req 70746112->70750207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.672467:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565440896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9086us (10913us total) trans 4294984580 rc 0/0 00000100:00100000:2.0:1789760776.672478:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17283 00000100:00100000:2.0:1789760776.672487:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714904453624 time 714923657539 state 0x2 ref 0 00000100:00100000:0.0:1789760776.678500:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.678618:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441024 00000100:00100000:2.0:1789760776.678629:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441024 00000100:00100000:2.0:1789760776.678682:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714904453624 time 714923657539 state 0x0 ref 1 00000100:00100000:2.0:1789760776.678696:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714923917955 time 714923657539 state 0x1 ref 1 00000100:00100000:2.0:1789760776.678782:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714923917955 time 714939073770 state 0x0 ref 1 00000100:00100000:2.0:1789760776.678801:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565441024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.679398:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70750208, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21be0 00010000:00010000:2.0:1789760776.679410:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.679426:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.679430:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.679437:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.679450:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.689983:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984581 is committed 00002000:00010000:2.0:1789760776.690223:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70750208 -> 70754304 00002000:00010000:2.0:1789760776.690229:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138208 -> 138216 00010000:00010000:2.0:1789760776.690242:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690255:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690264:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690271:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.690275:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690284:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690302:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.690309:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d75f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70750208->70754303] (req 70750208->70754303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.690405:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565441024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11607us (11909us total) trans 4294984581 rc 0/0 00000100:00100000:2.0:1789760776.690415:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17284 00000100:00100000:2.0:1789760776.690426:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714923917955 time 714939073770 state 0x2 ref 0 00000100:00100000:0.0:1789760776.702326:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.705629:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441152 00000100:00100000:2.0:1789760776.705644:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441152 00000100:00100000:2.0:1789760776.705728:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714923917955 time 714939073770 state 0x0 ref 1 00000100:00100000:2.0:1789760776.705754:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714939334186 time 714939073770 state 0x1 ref 1 00000100:00100000:2.0:1789760776.705865:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714939334186 time 714966155414 state 0x0 ref 1 00000100:00100000:2.0:1789760776.705880:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565441152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.705930:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70754304, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21be8 00010000:00010000:2.0:1789760776.705940:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.705955:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.705960:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.705967:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.705980:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.712152:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984582 is committed 00002000:00010000:2.0:1789760776.712323:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70754304 -> 70758400 00002000:00010000:2.0:1789760776.712329:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138216 -> 138224 00010000:00010000:2.0:1789760776.712341:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712359:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712367:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712375:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.712379:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712388:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712407:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.712415:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d766 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70754304->70758399] (req 70754304->70758399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.712627:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565441152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6745us (10303us total) trans 4294984582 rc 0/0 00000100:00100000:2.0:1789760776.712639:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17285 00000100:00100000:2.0:1789760776.712650:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714939334186 time 714966155414 state 0x2 ref 0 00000100:00100000:3.0:1789760776.724628:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.724899:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441280 00000100:00100000:2.0:1789760776.724910:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441280 00000100:00100000:2.0:1789760776.724968:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714939334186 time 714966155414 state 0x0 ref 1 00000100:00100000:2.0:1789760776.724983:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714966415830 time 714966155414 state 0x1 ref 1 00000100:00100000:2.0:1789760776.725015:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714966415830 time 714985306637 state 0x0 ref 1 00000100:00100000:2.0:1789760776.725028:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.725076:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70758400, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bf0 00010000:00010000:2.0:1789760776.725199:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.725216:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.725221:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.725226:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.725240:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.734485:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984583 is committed 00002000:00010000:3.0:1789760776.734664:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70758400 -> 70762496 00002000:00010000:3.0:1789760776.734670:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138224 -> 138232 00010000:00010000:3.0:1789760776.734683:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734696:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734732:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734749:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760776.734754:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734763:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734787:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.734794:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d76d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70758400->70762495] (req 70758400->70762495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.735024:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9994us (14419us total) trans 4294984583 rc 0/0 00000100:00100000:3.0:1789760776.735035:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17286 00000100:00100000:3.0:1789760776.735044:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714966415830 time 714985306637 state 0x2 ref 0 00000100:00100000:0.0:1789760776.739199:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.739281:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441408 00000100:00100000:2.0:1789760776.739290:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441408 00000100:00100000:2.0:1789760776.739347:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714966415830 time 714985306637 state 0x0 ref 1 00000100:00100000:2.0:1789760776.739363:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714985567053 time 714985306637 state 0x1 ref 1 00000100:00100000:2.0:1789760776.739405:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714985567053 time 714999696421 state 0x0 ref 1 00000100:00100000:2.0:1789760776.739419:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565441408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.739466:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70762496, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21bf8 00010000:00010000:2.0:1789760776.739475:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.739491:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789760776.739505:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.739511:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.739526:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.750404:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984584 is committed 00002000:00010000:0.0:1789760776.750647:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70762496 -> 70766592 00002000:00010000:0.0:1789760776.750653:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138232 -> 138240 00010000:00010000:0.0:1789760776.750667:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750793:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750803:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750809:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.750814:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750822:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750963:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.750972:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d774 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70762496->70766591] (req 70762496->70766591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.751190:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565441408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11769us (11996us total) trans 4294984584 rc 0/0 00000100:00100000:0.0:1789760776.751201:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17287 00000100:00100000:0.0:1789760776.751211:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714985567053 time 714999696421 state 0x2 ref 0 00000100:00100000:1.0:1789760776.763926:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.766675:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441536 00000100:00100000:2.0:1789760776.766778:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441536 00000100:00100000:2.0:1789760776.766840:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714985567053 time 714999696421 state 0x0 ref 1 00000100:00100000:2.0:1789760776.766930:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714999956837 time 714999696421 state 0x1 ref 1 00000100:00100000:2.0:1789760776.767028:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714999956837 time 715027318915 state 0x0 ref 1 00000100:00100000:2.0:1789760776.767043:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.767107:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70766592, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c00 00010000:00010000:2.0:1789760776.767117:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.767133:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.767137:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.767143:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.767158:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.774355:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984585 is committed 00002000:00010000:2.0:1789760776.776945:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70766592 -> 70770688 00002000:00010000:2.0:1789760776.776954:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138240 -> 138248 00010000:00010000:2.0:1789760776.776968:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.776980:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.776989:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.776996:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.777001:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.777010:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.777035:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.777043:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d77b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70766592->70770687] (req 70766592->70770687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.777195:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10151us (13276us total) trans 4294984585 rc 0/0 00000100:00100000:2.0:1789760776.777207:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17288 00000100:00100000:2.0:1789760776.777217:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714999956837 time 715027318915 state 0x2 ref 0 00000100:00100000:3.0:1789760776.781660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.781780:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441664 00000100:00100000:2.0:1789760776.781789:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441664 00000100:00100000:2.0:1789760776.781842:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 714999956837 time 715027318915 state 0x0 ref 1 00000100:00100000:2.0:1789760776.782111:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715027579331 time 715027318915 state 0x1 ref 1 00000100:00100000:2.0:1789760776.782144:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715027579331 time 715042436358 state 0x0 ref 1 00000100:00100000:2.0:1789760776.782158:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565441664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.782204:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70770688, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c08 00010000:00010000:2.0:1789760776.782213:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.782228:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.782233:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.782240:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.782254:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.789316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984586 is committed 00002000:00010000:2.0:1789760776.789453:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70770688 -> 70774784 00002000:00010000:2.0:1789760776.789457:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138248 -> 138256 00010000:00010000:2.0:1789760776.789470:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789483:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789491:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789498:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.789503:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789511:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789530:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.789543:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d782 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70770688->70774783] (req 70770688->70774783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.789681:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565441664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7523us (8026us total) trans 4294984586 rc 0/0 00000100:00100000:2.0:1789760776.789692:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17289 00000100:00100000:2.0:1789760776.789759:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715027579331 time 715042436358 state 0x2 ref 0 00000100:00100000:0.0:1789760776.793589:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.794200:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441792 00000100:00100000:2.0:1789760776.794211:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441792 00000100:00100000:2.0:1789760776.794270:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715027579331 time 715042436358 state 0x0 ref 1 00000100:00100000:2.0:1789760776.794287:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715042696774 time 715042436358 state 0x1 ref 1 00000100:00100000:2.0:1789760776.794353:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715042696774 time 715054644033 state 0x0 ref 1 00000100:00100000:2.0:1789760776.794365:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565441792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.794411:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70774784, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c10 00010000:00010000:2.0:1789760776.794422:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.794438:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.794443:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.794450:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.794469:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.799671:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984587 is committed 00002000:00010000:0.0:1789760776.799919:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70774784 -> 70778880 00002000:00010000:0.0:1789760776.799924:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138256 -> 138264 00010000:00010000:0.0:1789760776.800003:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800017:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800026:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800033:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.800038:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800046:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800076:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.800092:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d789 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70774784->70778879] (req 70774784->70778879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.800183:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565441792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5816us (6600us total) trans 4294984587 rc 0/0 00000100:00100000:0.0:1789760776.800195:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17290 00000100:00100000:0.0:1789760776.800204:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715042696774 time 715054644033 state 0x2 ref 0 00000100:00100000:1.0:1789760776.804318:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.804435:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565441920 00000100:00100000:2.0:1789760776.804445:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565441920 00000100:00100000:2.0:1789760776.804501:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715042696774 time 715054644033 state 0x0 ref 1 00000100:00100000:2.0:1789760776.804515:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715054904449 time 715054644033 state 0x1 ref 1 00000100:00100000:2.0:1789760776.804580:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715054904449 time 715064871420 state 0x0 ref 1 00000100:00100000:2.0:1789760776.804593:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.804641:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70778880, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c18 00010000:00010000:2.0:1789760776.804650:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.804667:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.804672:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.804678:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.804729:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.810897:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984588 is committed 00002000:00010000:0.0:1789760776.811018:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70778880 -> 70782976 00002000:00010000:0.0:1789760776.811024:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138264 -> 138272 00010000:00010000:0.0:1789760776.811038:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811051:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811059:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811072:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.811077:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811097:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811115:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.811124:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674d790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70778880->70782975] (req 70778880->70782975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.811216:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565441920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6621us (6903us total) trans 4294984588 rc 0/0 00000100:00100000:0.0:1789760776.811239:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17291 00000100:00100000:0.0:1789760776.811249:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715054904449 time 715064871420 state 0x2 ref 0 00000100:00100000:3.0:1789760776.821907:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.822019:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442048 00000100:00100000:2.0:1789760776.822029:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442048 00000100:00100000:2.0:1789760776.822082:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715054904449 time 715064871420 state 0x0 ref 1 00000100:00100000:2.0:1789760776.822164:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715065131836 time 715064871420 state 0x1 ref 1 00000100:00100000:2.0:1789760776.822227:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715065131836 time 715082519257 state 0x0 ref 1 00000100:00100000:2.0:1789760776.822241:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.822286:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70782976, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c20 00010000:00010000:2.0:1789760776.822295:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.822310:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.822314:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.822320:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.822333:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760776.826814:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984589 is committed 00002000:00010000:2.0:1789760776.827233:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70782976 -> 70787072 00002000:00010000:2.0:1789760776.827239:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138272 -> 138280 00010000:00010000:2.0:1789760776.827252:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827264:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827273:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827280:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.827284:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827292:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827311:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.827319:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d797 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70782976->70787071] (req 70782976->70787071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.827412:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5168us (5508us total) trans 4294984589 rc 0/0 00000100:00100000:2.0:1789760776.827424:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17292 00000100:00100000:2.0:1789760776.827433:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715065131836 time 715082519257 state 0x2 ref 0 00000100:00100000:3.0:1789760776.834623:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.834863:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442176 00000100:00100000:0.0:1789760776.834874:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442176 00000100:00100000:0.0:1789760776.834931:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715065131836 time 715082519257 state 0x0 ref 1 00000100:00100000:0.0:1789760776.835073:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715082779673 time 715082519257 state 0x1 ref 1 00000100:00100000:0.0:1789760776.835107:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715082779673 time 715095398385 state 0x0 ref 1 00000100:00100000:0.0:1789760776.835121:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760776.835175:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70787072, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c28 00010000:00010000:0.0:1789760776.835185:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.835202:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760776.835206:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.835212:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.835227:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.840589:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984590 is committed 00002000:00010000:0.0:1789760776.840694:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70787072 -> 70791168 00002000:00010000:0.0:1789760776.840700:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138280 -> 138288 00010000:00010000:0.0:1789760776.840730:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840752:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840762:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840770:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.840776:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840786:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840805:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.840813:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d79e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70787072->70791167] (req 70787072->70791167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.840907:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5785us (6300us total) trans 4294984590 rc 0/0 00000100:00100000:0.0:1789760776.840917:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17293 00000100:00100000:0.0:1789760776.840927:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715082779673 time 715095398385 state 0x2 ref 0 00000100:00100000:1.0:1789760776.844321:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.844823:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442304 00000100:00100000:0.0:1789760776.844832:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442304 00000100:00100000:1.0:1789760776.844967:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715082779673 time 715095398385 state 0x0 ref 1 00000100:00100000:1.0:1789760776.844982:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715095658801 time 715095398385 state 0x1 ref 1 00000100:00100000:1.0:1789760776.845052:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715095658801 time 715105342961 state 0x0 ref 1 00000100:00100000:1.0:1789760776.845066:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565442304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760776.845118:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70791168, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c30 00010000:00010000:1.0:1789760776.845128:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.845143:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760776.845148:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760776.845154:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.845167:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.849537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984591 is committed 00002000:00010000:1.0:1789760776.849657:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70791168 -> 70795264 00002000:00010000:1.0:1789760776.849664:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138288 -> 138296 00010000:00010000:1.0:1789760776.849682:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849698:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849731:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849750:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.849755:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849764:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849784:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.849792:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d7a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70791168->70795263] (req 70791168->70795263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.849880:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565442304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4813us (5563us total) trans 4294984591 rc 0/0 00000100:00100000:1.0:1789760776.849892:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17294 00000100:00100000:1.0:1789760776.849901:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715095658801 time 715105342961 state 0x2 ref 0 00000100:00100000:3.0:1789760776.854832:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.854977:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442432 00000100:00100000:0.0:1789760776.854988:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442432 00000100:00100000:0.0:1789760776.855043:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715095658801 time 715105342961 state 0x0 ref 1 00000100:00100000:0.0:1789760776.855059:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715105603377 time 715105342961 state 0x1 ref 1 00000100:00100000:0.0:1789760776.855097:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715105603377 time 715115388643 state 0x0 ref 1 00000100:00100000:0.0:1789760776.855111:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565442432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760776.855160:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70795264, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c38 00010000:00010000:0.0:1789760776.855170:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.855185:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760776.855190:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.855197:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.855210:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.860804:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984592 is committed 00002000:00010000:0.0:1789760776.861010:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70795264 -> 70799360 00002000:00010000:0.0:1789760776.861016:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138296 -> 138304 00010000:00010000:0.0:1789760776.861029:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861041:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861050:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861057:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.861062:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861076:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861473:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.861482:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70795264->70799359] (req 70795264->70799359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.861624:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565442432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6511us (6798us total) trans 4294984592 rc 0/0 00000100:00100000:0.0:1789760776.861635:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17295 00000100:00100000:0.0:1789760776.861645:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715105603377 time 715115388643 state 0x2 ref 0 00000100:00100000:3.0:1789760776.865948:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.866042:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442560 00000100:00100000:0.0:1789760776.866051:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442560 00000100:00100000:0.0:1789760776.866115:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715105603377 time 715115388643 state 0x0 ref 1 00000100:00100000:0.0:1789760776.866135:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715115649059 time 715115388643 state 0x1 ref 1 00000100:00100000:0.0:1789760776.866165:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715115649059 time 715126456878 state 0x0 ref 1 00000100:00100000:0.0:1789760776.866177:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760776.866221:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70799360, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c40 00010000:00010000:0.0:1789760776.866230:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.866247:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760776.866251:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.866257:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.866270:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.870477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984593 is committed 00002000:00010000:2.0:1789760776.870595:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70799360 -> 70803456 00002000:00010000:2.0:1789760776.870600:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138304 -> 138312 00010000:00010000:2.0:1789760776.870614:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870628:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870637:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870644:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.870649:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870658:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870689:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.870697:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674d7b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70799360->70803455] (req 70799360->70803455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.870864:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4685us (4920us total) trans 4294984593 rc 0/0 00000100:00100000:2.0:1789760776.870875:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17296 00000100:00100000:2.0:1789760776.870885:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715115649059 time 715126456878 state 0x2 ref 0 00000100:00100000:1.0:1789760776.878341:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.879428:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442688 00000100:00100000:2.0:1789760776.879441:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442688 00000100:00100000:2.0:1789760776.879499:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715115649059 time 715126456878 state 0x0 ref 1 00000100:00100000:2.0:1789760776.879514:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715126717294 time 715126456878 state 0x1 ref 1 00000100:00100000:2.0:1789760776.879548:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715126717294 time 715139839971 state 0x0 ref 1 00000100:00100000:2.0:1789760776.879559:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.880145:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70803456, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c48 00010000:00010000:2.0:1789760776.880157:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.880172:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.880177:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.880184:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.880198:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.885131:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984594 is committed 00002000:00010000:2.0:1789760776.885497:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70803456 -> 70807552 00002000:00010000:2.0:1789760776.885502:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138312 -> 138320 00010000:00010000:2.0:1789760776.885515:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885533:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885542:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885550:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.885554:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885563:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885584:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.885592:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70803456->70807551] (req 70803456->70807551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.885993:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565442688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6428us (7654us total) trans 4294984594 rc 0/0 00000100:00100000:2.0:1789760776.886003:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17297 00000100:00100000:2.0:1789760776.886013:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715126717294 time 715139839971 state 0x2 ref 0 00000100:00100000:3.0:1789760776.899838:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.901552:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442816 00000100:00100000:0.0:1789760776.901565:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442816 00000100:00100000:0.0:1789760776.901625:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715126717294 time 715139839971 state 0x0 ref 1 00000100:00100000:0.0:1789760776.901641:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715140100387 time 715139839971 state 0x1 ref 1 00000100:00100000:0.0:1789760776.901866:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715140100387 time 715162156365 state 0x0 ref 1 00000100:00100000:0.0:1789760776.901882:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565442816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760776.901929:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70807552, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c50 00010000:00010000:0.0:1789760776.901939:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.901953:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760776.901958:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.901965:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.901984:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.906663:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984595 is committed 00002000:00010000:0.0:1789760776.907952:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70807552 -> 70811648 00002000:00010000:0.0:1789760776.907961:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138320 -> 138328 00010000:00010000:0.0:1789760776.907977:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.907988:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.907996:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.908013:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.908018:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.908027:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.908044:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.908052:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70807552->70811647] (req 70807552->70811647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.908179:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565442816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6296us (8345us total) trans 4294984595 rc 0/0 00000100:00100000:0.0:1789760776.908190:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17298 00000100:00100000:0.0:1789760776.908199:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715140100387 time 715162156365 state 0x2 ref 0 00000100:00100000:3.0:1789760776.912382:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.912489:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565442944 00000100:00100000:2.0:1789760776.912500:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565442944 00000100:00100000:2.0:1789760776.912553:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715140100387 time 715162156365 state 0x0 ref 1 00000100:00100000:2.0:1789760776.912569:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715162416781 time 715162156365 state 0x1 ref 1 00000100:00100000:2.0:1789760776.912601:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715162416781 time 715172893324 state 0x0 ref 1 00000100:00100000:2.0:1789760776.912613:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565442944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.912663:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70811648, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c58 00010000:00010000:2.0:1789760776.912673:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.912702:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.912749:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.912757:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.912772:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.917780:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984596 is committed 00002000:00010000:2.0:1789760776.918272:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70811648 -> 70815744 00002000:00010000:2.0:1789760776.918278:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138328 -> 138336 00010000:00010000:2.0:1789760776.918291:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918303:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918317:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918324:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.918329:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918338:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918356:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.918364:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70811648->70815743] (req 70811648->70815743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.918494:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565442944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5878us (6117us total) trans 4294984596 rc 0/0 00000100:00100000:2.0:1789760776.918505:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17299 00000100:00100000:2.0:1789760776.918515:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715162416781 time 715172893324 state 0x2 ref 0 00000100:00100000:1.0:1789760776.926995:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.927152:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443072 00000100:00100000:2.0:1789760776.927162:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443072 00000100:00100000:2.0:1789760776.927208:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715162416781 time 715172893324 state 0x0 ref 1 00000100:00100000:2.0:1789760776.927221:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715173153740 time 715172893324 state 0x1 ref 1 00000100:00100000:2.0:1789760776.927356:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715173153740 time 715187647069 state 0x0 ref 1 00000100:00100000:2.0:1789760776.927370:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.927429:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70815744, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c60 00010000:00010000:2.0:1789760776.927437:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.927451:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.927464:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.927474:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.927488:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.936767:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984597 is committed 00002000:00010000:2.0:1789760776.936888:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70815744 -> 70819840 00002000:00010000:2.0:1789760776.936900:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138336 -> 138344 00010000:00010000:2.0:1789760776.936917:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936929:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936938:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936954:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.936958:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936967:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936986:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.936993:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70815744->70819839] (req 70815744->70819839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.937088:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9709us (10097us total) trans 4294984597 rc 0/0 00000100:00100000:2.0:1789760776.937099:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17300 00000100:00100000:2.0:1789760776.937109:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715173153740 time 715187647069 state 0x2 ref 0 00000100:00100000:2.0:1789760776.943330:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760776.943908:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443200 00000100:00100000:0.0:1789760776.943918:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443200 00000100:00100000:0.0:1789760776.944130:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715173153740 time 715187647069 state 0x0 ref 1 00000100:00100000:0.0:1789760776.944146:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715187907485 time 715187647069 state 0x1 ref 1 00000100:00100000:0.0:1789760776.944182:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715187907485 time 715204473793 state 0x0 ref 1 00000100:00100000:0.0:1789760776.944195:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565443200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760776.944240:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70819840, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0x21c68 00010000:00010000:0.0:1789760776.944249:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.944265:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760776.944270:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.944276:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.944290:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.957622:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984598 is committed 00002000:00010000:0.0:1789760776.957770:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70819840 -> 70823936 00002000:00010000:0.0:1789760776.957775:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760776 -> 1789760777 00002000:00010000:0.0:1789760776.957778:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760776 -> 1789760777 00002000:00010000:0.0:1789760776.957780:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138344 -> 138352 00010000:00010000:0.0:1789760776.957792:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957805:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957814:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957821:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760776.957826:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957835:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957930:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.957939:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70819840->70823935] (req 70819840->70823935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.958043:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565443200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13846us (14718us total) trans 4294984598 rc 0/0 00000100:00100000:0.0:1789760776.958055:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17301 00000100:00100000:0.0:1789760776.958064:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715187907485 time 715204473793 state 0x2 ref 0 00000100:00100000:3.0:1789760776.966065:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.966144:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443328 00000100:00100000:2.0:1789760776.966155:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443328 00000100:00100000:2.0:1789760776.966210:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715187907485 time 715204473793 state 0x0 ref 1 00000100:00100000:2.0:1789760776.966224:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715204734209 time 715204473793 state 0x1 ref 1 00000100:00100000:2.0:1789760776.966255:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715204734209 time 715226547633 state 0x0 ref 1 00000100:00100000:2.0:1789760776.966267:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.966312:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70823936, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c70 00010000:00010000:2.0:1789760776.966320:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.966336:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.966341:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.966347:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.966362:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.975161:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984599 is committed 00002000:00010000:2.0:1789760776.977129:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70823936 -> 70828032 00002000:00010000:2.0:1789760776.977139:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138352 -> 138360 00010000:00010000:2.0:1789760776.977157:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977172:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977183:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977190:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760776.977196:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977206:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977231:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.977239:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70823936->70828031] (req 70823936->70828031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760776.977530:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11258us (11468us total) trans 4294984599 rc 0/0 00000100:00100000:2.0:1789760776.977543:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17302 00000100:00100000:2.0:1789760776.977552:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715204734209 time 715226547633 state 0x2 ref 0 00000100:00100000:1.0:1789760776.984526:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760776.985663:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443456 00000100:00100000:2.0:1789760776.985675:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443456 00000100:00100000:2.0:1789760776.985782:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715204734209 time 715226547633 state 0x0 ref 1 00000100:00100000:2.0:1789760776.985796:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715226808049 time 715226547633 state 0x1 ref 1 00000100:00100000:2.0:1789760776.985828:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715226808049 time 715246119670 state 0x0 ref 1 00000100:00100000:2.0:1789760776.985841:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565443456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760776.985887:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70828032, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c78 00010000:00010000:2.0:1789760776.985896:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.985912:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760776.985916:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.985922:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.985936:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.994396:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984600 is committed 00002000:00010000:1.0:1789760776.994520:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70828032 -> 70832128 00002000:00010000:1.0:1789760776.994526:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138360 -> 138368 00010000:00010000:1.0:1789760776.994540:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994552:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994561:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994568:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760776.994573:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994582:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994601:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.994609:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d7e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70828032->70832127] (req 70828032->70832127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.994806:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565443456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8964us (10284us total) trans 4294984600 rc 0/0 00000100:00100000:1.0:1789760776.994818:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17303 00000100:00100000:1.0:1789760776.994827:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715226808049 time 715246119670 state 0x2 ref 0 00000100:00100000:1.0:1789760777.001163:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.001435:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443584 00000100:00100000:0.0:1789760777.001445:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443584 00000100:00100000:0.0:1789760777.001500:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715226808049 time 715246119670 state 0x0 ref 1 00000100:00100000:0.0:1789760777.001515:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715246380086 time 715246119670 state 0x1 ref 1 00000100:00100000:0.0:1789760777.001584:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715246380086 time 715261875247 state 0x0 ref 1 00000100:00100000:0.0:1789760777.001596:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565443584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.001643:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70832128, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c80 00010000:00010000:0.0:1789760777.001652:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.001667:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760777.001671:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.001677:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.001689:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.012427:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984601 is committed 00002000:00010000:0.0:1789760777.013314:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70832128 -> 70836224 00002000:00010000:0.0:1789760777.013321:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138368 -> 138376 00010000:00010000:0.0:1789760777.013335:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013349:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013359:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013367:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760777.013372:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013381:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013400:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.013407:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674d7eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70832128->70836223] (req 70832128->70836223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.013625:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565443584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12026us (12466us total) trans 4294984601 rc 0/0 00000100:00100000:0.0:1789760777.013638:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17304 00000100:00100000:0.0:1789760777.013647:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715246380086 time 715261875247 state 0x2 ref 0 00000100:00100000:3.0:1789760777.023456:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.023810:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443712 00000100:00100000:2.0:1789760777.023821:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443712 00000100:00100000:2.0:1789760777.023875:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715246380086 time 715261875247 state 0x0 ref 1 00000100:00100000:2.0:1789760777.023891:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715262135663 time 715261875247 state 0x1 ref 1 00000100:00100000:2.0:1789760777.023994:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715262135663 time 715284284854 state 0x0 ref 1 00000100:00100000:2.0:1789760777.024008:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.024054:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70836224, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c88 00010000:00010000:2.0:1789760777.024063:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.024078:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.024092:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.024100:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.024116:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.030860:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984602 is committed 00002000:00010000:0.0:1789760777.030936:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70836224 -> 70840320 00002000:00010000:0.0:1789760777.030942:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138376 -> 138384 00010000:00010000:0.0:1789760777.030955:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.030968:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.030976:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.030983:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760777.030987:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.030996:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.031015:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.031022:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d7f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70836224->70840319] (req 70836224->70840319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.031176:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565443712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7165us (7724us total) trans 4294984602 rc 0/0 00000100:00100000:0.0:1789760777.031186:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17305 00000100:00100000:0.0:1789760777.031196:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715262135663 time 715284284854 state 0x2 ref 0 00000100:00100000:1.0:1789760777.036236:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.036318:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443840 00000100:00100000:2.0:1789760777.036327:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443840 00000100:00100000:2.0:1789760777.036374:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715262135663 time 715284284854 state 0x0 ref 1 00000100:00100000:2.0:1789760777.036388:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715284545270 time 715284284854 state 0x1 ref 1 00000100:00100000:2.0:1789760777.036449:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715284545270 time 715296740176 state 0x0 ref 1 00000100:00100000:2.0:1789760777.036462:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565443840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.036508:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70840320, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c90 00010000:00010000:2.0:1789760777.036517:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.036533:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.036537:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.036543:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.036557:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.041827:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984603 is committed 00002000:00010000:2.0:1789760777.042026:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70840320 -> 70844416 00002000:00010000:2.0:1789760777.042032:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138384 -> 138392 00010000:00010000:2.0:1789760777.042047:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042060:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042069:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042077:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.042133:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042143:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042162:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.042170:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d7f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70840320->70844415] (req 70840320->70844415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.043044:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565443840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6576us (6810us total) trans 4294984603 rc 0/0 00000100:00100000:2.0:1789760777.043055:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17306 00000100:00100000:2.0:1789760777.043064:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715284545270 time 715296740176 state 0x2 ref 0 00000100:00100000:1.0:1789760777.054508:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.058696:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565443968 00000100:00100000:0.0:1789760777.058758:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565443968 00000100:00100000:0.0:1789760777.058820:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715284545270 time 715296740176 state 0x0 ref 1 00000100:00100000:0.0:1789760777.058834:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715297000592 time 715296740176 state 0x1 ref 1 00000100:00100000:0.0:1789760777.058857:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715297000592 time 715319149591 state 0x0 ref 1 00000100:00100000:0.0:1789760777.058869:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565443968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.058923:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70844416, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21c98 00010000:00010000:0.0:1789760777.058932:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.058947:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760777.058951:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.058957:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.058971:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.063759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984604 is committed 00002000:00010000:0.0:1789760777.063862:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70844416 -> 70848512 00002000:00010000:0.0:1789760777.063867:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138392 -> 138400 00010000:00010000:0.0:1789760777.063880:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063903:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063913:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063921:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760777.063926:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063935:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063954:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.063962:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674d800 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70844416->70848511] (req 70844416->70848511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.064046:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565443968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5174us (9543us total) trans 4294984604 rc 0/0 00000100:00100000:0.0:1789760777.064057:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17307 00000100:00100000:0.0:1789760777.064066:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715297000592 time 715319149591 state 0x2 ref 0 00000100:00100000:0.0:1789760777.070382:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.070504:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444096 00000100:00100000:2.0:1789760777.070513:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444096 00000100:00100000:2.0:1789760777.070564:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715297000592 time 715319149591 state 0x0 ref 1 00000100:00100000:2.0:1789760777.070578:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715319410007 time 715319149591 state 0x1 ref 1 00000100:00100000:2.0:1789760777.070605:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715319410007 time 715330897605 state 0x0 ref 1 00000100:00100000:2.0:1789760777.070616:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.070657:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70848512, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21ca0 00010000:00010000:2.0:1789760777.070667:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.070681:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.070685:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.070691:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.070725:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.081047:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984605 is committed 00002000:00010000:2.0:1789760777.081209:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70848512 -> 70852608 00002000:00010000:2.0:1789760777.081214:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138400 -> 138408 00010000:00010000:2.0:1789760777.081226:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081240:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081249:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081256:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.081261:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081270:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081288:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.081295:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d807 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70848512->70852607] (req 70848512->70852607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.081387:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10768us (11008us total) trans 4294984605 rc 0/0 00000100:00100000:2.0:1789760777.081397:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17308 00000100:00100000:2.0:1789760777.081406:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715319410007 time 715330897605 state 0x2 ref 0 00000100:00100000:1.0:1789760777.086784:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.086911:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444224 00000100:00100000:2.0:1789760777.086920:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444224 00000100:00100000:2.0:1789760777.086969:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715319410007 time 715330897605 state 0x0 ref 1 00000100:00100000:2.0:1789760777.086983:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715331158021 time 715330897605 state 0x1 ref 1 00000100:00100000:2.0:1789760777.087010:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715331158021 time 715347302170 state 0x0 ref 1 00000100:00100000:2.0:1789760777.087021:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565444224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.087062:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70852608, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21ca8 00010000:00010000:2.0:1789760777.087071:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.087087:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.087091:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.087097:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.087112:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.097185:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984606 is committed 00002000:00010000:1.0:1789760777.097326:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70852608 -> 70856704 00002000:00010000:1.0:1789760777.097332:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138408 -> 138416 00010000:00010000:1.0:1789760777.097345:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097359:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097369:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097377:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.097382:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097397:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097417:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.097425:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d80e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70852608->70856703] (req 70852608->70856703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.097615:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565444224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10590us (10835us total) trans 4294984606 rc 0/0 00000100:00100000:1.0:1789760777.097627:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17309 00000100:00100000:1.0:1789760777.097637:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715331158021 time 715347302170 state 0x2 ref 0 00000100:00100000:1.0:1789760777.106213:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.109253:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444352 00000100:00100000:0.0:1789760777.109265:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444352 00000100:00100000:0.0:1789760777.109327:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715331158021 time 715347302170 state 0x0 ref 1 00000100:00100000:0.0:1789760777.109343:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715347562586 time 715347302170 state 0x1 ref 1 00000100:00100000:0.0:1789760777.109428:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715347562586 time 715369719659 state 0x0 ref 1 00000100:00100000:0.0:1789760777.109442:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.109498:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70856704, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cb0 00010000:00010000:0.0:1789760777.109508:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.109524:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760777.109529:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.109535:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.109549:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.115824:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984607 is committed 00002000:00010000:1.0:1789760777.127311:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70856704 -> 70860800 00002000:00010000:1.0:1789760777.127321:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138416 -> 138424 00010000:00010000:1.0:1789760777.127335:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127348:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127357:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127368:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.127372:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127380:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127400:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.127407:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674d815 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70856704->70860799] (req 70856704->70860799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.127518:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18074us (21310us total) trans 4294984607 rc 0/0 00000100:00100000:1.0:1789760777.127529:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17310 00000100:00100000:1.0:1789760777.127538:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715347562586 time 715369719659 state 0x2 ref 0 00000100:00100000:0.0:1789760777.132076:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.133306:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444480 00000100:00100000:2.0:1789760777.133321:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444480 00000100:00100000:2.0:1789760777.133388:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715347562586 time 715369719659 state 0x0 ref 1 00000100:00100000:2.0:1789760777.133412:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715369980075 time 715369719659 state 0x1 ref 1 00000100:00100000:2.0:1789760777.133449:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715369980075 time 715393741107 state 0x0 ref 1 00000100:00100000:2.0:1789760777.133462:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565444480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.133509:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70860800, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cb8 00010000:00010000:2.0:1789760777.133518:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.133538:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.133545:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.133551:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.133569:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.138804:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984608 is committed 00002000:00010000:2.0:1789760777.138924:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70860800 -> 70864896 00002000:00010000:2.0:1789760777.138930:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138424 -> 138432 00010000:00010000:2.0:1789760777.138942:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.138956:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.138965:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.138974:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.138979:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.138988:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.139007:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.139015:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d81c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70860800->70864895] (req 70860800->70864895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.139110:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565444480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5644us (7037us total) trans 4294984608 rc 0/0 00000100:00100000:2.0:1789760777.139121:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17311 00000100:00100000:2.0:1789760777.139131:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715369980075 time 715393741107 state 0x2 ref 0 00000100:00100000:3.0:1789760777.142695:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.142789:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444608 00000100:00100000:1.0:1789760777.142798:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444608 00000100:00100000:1.0:1789760777.142851:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715369980075 time 715393741107 state 0x0 ref 1 00000100:00100000:1.0:1789760777.142867:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715394001523 time 715393741107 state 0x1 ref 1 00000100:00100000:1.0:1789760777.142896:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715394001523 time 715403187325 state 0x0 ref 1 00000100:00100000:1.0:1789760777.142914:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.142960:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70864896, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cc0 00010000:00010000:1.0:1789760777.142971:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.142986:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.142991:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.142997:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.143014:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.153220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984609 is committed 00002000:00010000:2.0:1789760777.153349:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70864896 -> 70868992 00002000:00010000:2.0:1789760777.153354:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138432 -> 138440 00010000:00010000:2.0:1789760777.153369:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153381:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153397:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153405:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.153410:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153418:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153438:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.153446:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674d823 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70864896->70868991] (req 70864896->70868991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.153539:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10627us (10848us total) trans 4294984609 rc 0/0 00000100:00100000:2.0:1789760777.153550:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17312 00000100:00100000:2.0:1789760777.153559:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715394001523 time 715403187325 state 0x2 ref 0 00000100:00100000:1.0:1789760777.156668:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.156882:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444736 00000100:00100000:2.0:1789760777.156892:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444736 00000100:00100000:2.0:1789760777.156946:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715394001523 time 715403187325 state 0x0 ref 1 00000100:00100000:2.0:1789760777.156962:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715403447741 time 715403187325 state 0x1 ref 1 00000100:00100000:2.0:1789760777.157002:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715403447741 time 715417293626 state 0x0 ref 1 00000100:00100000:2.0:1789760777.157016:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565444736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.157071:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70868992, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cc8 00010000:00010000:2.0:1789760777.157091:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.157109:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.157114:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.157121:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.157136:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.161937:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984610 is committed 00002000:00010000:2.0:1789760777.162138:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70868992 -> 70873088 00002000:00010000:2.0:1789760777.162144:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138440 -> 138448 00010000:00010000:2.0:1789760777.162159:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162172:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162180:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162193:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.162200:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162209:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162226:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.162232:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d82a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70868992->70873087] (req 70868992->70873087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.162322:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565444736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5304us (5660us total) trans 4294984610 rc 0/0 00000100:00100000:2.0:1789760777.162331:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17313 00000100:00100000:2.0:1789760777.162340:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715403447741 time 715417293626 state 0x2 ref 0 00000100:00100000:0.0:1789760777.167346:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.167422:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444864 00000100:00100000:2.0:1789760777.167431:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444864 00000100:00100000:2.0:1789760777.167487:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715403447741 time 715417293626 state 0x0 ref 1 00000100:00100000:2.0:1789760777.167501:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715417554042 time 715417293626 state 0x1 ref 1 00000100:00100000:2.0:1789760777.167533:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715417554042 time 715427825529 state 0x0 ref 1 00000100:00100000:2.0:1789760777.167551:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.167598:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70873088, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cd0 00010000:00010000:2.0:1789760777.167607:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.167624:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.167629:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.167635:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.167651:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.173272:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984611 is committed 00002000:00010000:2.0:1789760777.173383:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70873088 -> 70877184 00002000:00010000:2.0:1789760777.173389:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138448 -> 138456 00010000:00010000:2.0:1789760777.173402:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173414:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173423:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173431:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.173436:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173446:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173464:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.173472:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d831 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70873088->70877183] (req 70873088->70877183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.173565:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565444864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6012us (6226us total) trans 4294984611 rc 0/0 00000100:00100000:2.0:1789760777.173575:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17314 00000100:00100000:2.0:1789760777.173585:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715417554042 time 715427825529 state 0x2 ref 0 00000100:00100000:3.0:1789760777.177132:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.177197:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565444992 00000100:00100000:2.0:1789760777.177205:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565444992 00000100:00100000:2.0:1789760777.177267:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715417554042 time 715427825529 state 0x0 ref 1 00000100:00100000:2.0:1789760777.177283:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715428085945 time 715427825529 state 0x1 ref 1 00000100:00100000:2.0:1789760777.177315:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715428085945 time 715437607068 state 0x0 ref 1 00000100:00100000:2.0:1789760777.177328:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565444992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.177374:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70877184, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cd8 00010000:00010000:2.0:1789760777.177384:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.177401:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.177405:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.177411:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.177425:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.183495:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984612 is committed 00002000:00010000:3.0:1789760777.184211:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70877184 -> 70881280 00002000:00010000:3.0:1789760777.184216:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138456 -> 138464 00010000:00010000:3.0:1789760777.184230:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184242:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184251:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184259:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.184263:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184273:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184291:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.184304:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674d838 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70877184->70881279] (req 70877184->70881279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.187898:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565444992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10559us (10760us total) trans 4294984612 rc 0/0 00000100:00100000:3.0:1789760777.187915:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17315 00000100:00100000:3.0:1789760777.187926:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715428085945 time 715437607068 state 0x2 ref 0 00000100:00100000:1.0:1789760777.194830:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.194905:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445120 00000100:00100000:2.0:1789760777.194916:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445120 00000100:00100000:2.0:1789760777.194968:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715428085945 time 715437607068 state 0x0 ref 1 00000100:00100000:2.0:1789760777.194983:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715437867484 time 715437607068 state 0x1 ref 1 00000100:00100000:2.0:1789760777.195013:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715437867484 time 715455305382 state 0x0 ref 1 00000100:00100000:2.0:1789760777.195026:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565445120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.195070:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70881280, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21ce0 00010000:00010000:2.0:1789760777.195079:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.195095:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.195100:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.195106:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.195120:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.200700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984613 is committed 00002000:00010000:2.0:1789760777.200888:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70881280 -> 70885376 00002000:00010000:2.0:1789760777.200894:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138464 -> 138472 00010000:00010000:2.0:1789760777.200913:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200927:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200937:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200944:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.200949:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200958:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200977:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.200985:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d83f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70881280->70885375] (req 70881280->70885375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.201193:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565445120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6164us (6367us total) trans 4294984613 rc 0/0 00000100:00100000:2.0:1789760777.201206:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17316 00000100:00100000:2.0:1789760777.201215:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715437867484 time 715455305382 state 0x2 ref 0 00000100:00100000:1.0:1789760777.206105:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.206559:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445248 00000100:00100000:2.0:1789760777.206569:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445248 00000100:00100000:2.0:1789760777.206621:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715437867484 time 715455305382 state 0x0 ref 1 00000100:00100000:2.0:1789760777.206636:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715455565798 time 715455305382 state 0x1 ref 1 00000100:00100000:2.0:1789760777.206668:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715455565798 time 715466960115 state 0x0 ref 1 00000100:00100000:2.0:1789760777.206689:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.206873:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70885376, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21ce8 00010000:00010000:2.0:1789760777.206884:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.206900:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.206904:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.206910:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.206925:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.211996:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984614 is committed 00002000:00010000:2.0:1789760777.212598:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70885376 -> 70889472 00002000:00010000:2.0:1789760777.212604:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138472 -> 138480 00010000:00010000:2.0:1789760777.212618:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212632:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212641:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212649:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.212654:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212663:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212825:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.212967:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d846 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70885376->70889471] (req 70885376->70889471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.213242:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6550us (7141us total) trans 4294984614 rc 0/0 00000100:00100000:2.0:1789760777.213254:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17317 00000100:00100000:2.0:1789760777.213265:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715455565798 time 715466960115 state 0x2 ref 0 00000100:00100000:3.0:1789760777.220463:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.220841:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445376 00000100:00100000:1.0:1789760777.220851:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445376 00000100:00100000:1.0:1789760777.220905:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715455565798 time 715466960115 state 0x0 ref 1 00000100:00100000:1.0:1789760777.220922:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715467220531 time 715466960115 state 0x1 ref 1 00000100:00100000:1.0:1789760777.220958:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715467220531 time 715481249855 state 0x0 ref 1 00000100:00100000:1.0:1789760777.220970:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.221016:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70889472, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cf0 00010000:00010000:1.0:1789760777.221025:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.221042:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.221046:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.221052:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.221066:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.229394:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984615 is committed 00002000:00010000:1.0:1789760777.229641:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70889472 -> 70893568 00002000:00010000:1.0:1789760777.229648:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138480 -> 138488 00010000:00010000:1.0:1789760777.229663:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229687:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229697:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229759:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.229764:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229773:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229789:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.229797:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d84d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70889472->70893567] (req 70889472->70893567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.229899:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8926us (9441us total) trans 4294984615 rc 0/0 00000100:00100000:1.0:1789760777.229910:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17318 00000100:00100000:1.0:1789760777.229919:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715467220531 time 715481249855 state 0x2 ref 0 00000100:00100000:1.0:1789760777.235839:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.235984:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445504 00000100:00100000:2.0:1789760777.235993:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445504 00000100:00100000:2.0:1789760777.236046:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715467220531 time 715481249855 state 0x0 ref 1 00000100:00100000:2.0:1789760777.236066:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715481510271 time 715481249855 state 0x1 ref 1 00000100:00100000:2.0:1789760777.236095:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715481510271 time 715496387099 state 0x0 ref 1 00000100:00100000:2.0:1789760777.236107:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.236155:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70893568, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21cf8 00010000:00010000:2.0:1789760777.236165:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.236182:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.236186:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.236192:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.236207:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.240600:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984616 is committed 00002000:00010000:2.0:1789760777.240804:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70893568 -> 70897664 00002000:00010000:2.0:1789760777.240809:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138488 -> 138496 00010000:00010000:2.0:1789760777.240824:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240837:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240846:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240854:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.240859:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240867:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240886:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.240894:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d854 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70893568->70897663] (req 70893568->70897663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.240993:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4883us (5160us total) trans 4294984616 rc 0/0 00000100:00100000:2.0:1789760777.241004:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17319 00000100:00100000:2.0:1789760777.241013:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715481510271 time 715496387099 state 0x2 ref 0 00000100:00100000:3.0:1789760777.246556:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.246811:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445632 00000100:00100000:2.0:1789760777.246821:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445632 00000100:00100000:2.0:1789760777.246872:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715481510271 time 715496387099 state 0x0 ref 1 00000100:00100000:2.0:1789760777.246888:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715496647515 time 715496387099 state 0x1 ref 1 00000100:00100000:2.0:1789760777.246918:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715496647515 time 715507210292 state 0x0 ref 1 00000100:00100000:2.0:1789760777.246930:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.246977:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70897664, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d00 00010000:00010000:2.0:1789760777.246987:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.247002:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.247006:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.247011:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.247025:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.253408:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984617 is committed 00002000:00010000:2.0:1789760777.253608:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70897664 -> 70901760 00002000:00010000:2.0:1789760777.253613:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138496 -> 138504 00010000:00010000:2.0:1789760777.253634:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.253652:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.253661:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.253669:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.253674:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.253683:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.254899:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.254916:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d85b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70897664->70901759] (req 70897664->70901759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.255073:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565445632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8139us (8520us total) trans 4294984617 rc 0/0 00000100:00100000:2.0:1789760777.255095:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17320 00000100:00100000:2.0:1789760777.255104:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715496647515 time 715507210292 state 0x2 ref 0 00000100:00100000:3.0:1789760777.259970:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.260055:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445760 00000100:00100000:1.0:1789760777.260064:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445760 00000100:00100000:1.0:1789760777.260116:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715496647515 time 715507210292 state 0x0 ref 1 00000100:00100000:1.0:1789760777.260130:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715507470708 time 715507210292 state 0x1 ref 1 00000100:00100000:1.0:1789760777.260206:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715507470708 time 715520497890 state 0x0 ref 1 00000100:00100000:1.0:1789760777.260221:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565445760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.260269:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70901760, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d08 00010000:00010000:1.0:1789760777.260278:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.260292:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.260296:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.260302:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.260316:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.264601:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984618 is committed 00002000:00010000:1.0:1789760777.264880:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70901760 -> 70905856 00002000:00010000:1.0:1789760777.264885:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138504 -> 138512 00010000:00010000:1.0:1789760777.264897:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264910:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264919:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264934:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.264944:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264954:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264973:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.264981:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d862 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70901760->70905855] (req 70901760->70905855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.265159:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565445760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4936us (5192us total) trans 4294984618 rc 0/0 00000100:00100000:1.0:1789760777.265170:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17321 00000100:00100000:1.0:1789760777.265249:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715507470708 time 715520497890 state 0x2 ref 0 00000100:00100000:1.0:1789760777.269530:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.270345:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565445888 00000100:00100000:2.0:1789760777.270356:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565445888 00000100:00100000:2.0:1789760777.270504:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715507470708 time 715520497890 state 0x0 ref 1 00000100:00100000:2.0:1789760777.270521:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715520758306 time 715520497890 state 0x1 ref 1 00000100:00100000:2.0:1789760777.270552:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715520758306 time 715530844917 state 0x0 ref 1 00000100:00100000:2.0:1789760777.270566:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565445888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.270611:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70905856, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d10 00010000:00010000:2.0:1789760777.270620:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.270635:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.270640:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.270646:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.270660:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.275887:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984619 is committed 00002000:00010000:2.0:1789760777.276007:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70905856 -> 70909952 00002000:00010000:2.0:1789760777.276012:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138512 -> 138520 00010000:00010000:2.0:1789760777.276026:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276038:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276065:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276072:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.276077:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276087:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276104:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.276112:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d869 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70905856->70909951] (req 70905856->70909951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.276199:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565445888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5633us (6673us total) trans 4294984619 rc 0/0 00000100:00100000:2.0:1789760777.276209:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17322 00000100:00100000:2.0:1789760777.276218:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715520758306 time 715530844917 state 0x2 ref 0 00000100:00100000:3.0:1789760777.281818:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.281921:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446016 00000100:00100000:2.0:1789760777.281930:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446016 00000100:00100000:2.0:1789760777.281991:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715520758306 time 715530844917 state 0x0 ref 1 00000100:00100000:2.0:1789760777.282008:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715531105333 time 715530844917 state 0x1 ref 1 00000100:00100000:2.0:1789760777.282038:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715531105333 time 715542329827 state 0x0 ref 1 00000100:00100000:2.0:1789760777.282050:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565446016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.282102:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70909952, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d18 00010000:00010000:2.0:1789760777.282112:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.282128:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.282133:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.282140:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.282154:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.286200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984620 is committed 00002000:00010000:2.0:1789760777.286442:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70909952 -> 70914048 00002000:00010000:2.0:1789760777.286448:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138520 -> 138528 00010000:00010000:2.0:1789760777.286460:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286472:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286481:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286495:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.286500:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286509:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286530:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.286536:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d870 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70909952->70914047] (req 70909952->70914047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.286684:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565446016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4630us (4870us total) trans 4294984620 rc 0/0 00000100:00100000:2.0:1789760777.286695:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17323 00000100:00100000:2.0:1789760777.286805:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715531105333 time 715542329827 state 0x2 ref 0 00000100:00100000:3.0:1789760777.298813:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.299017:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446144 00000100:00100000:1.0:1789760777.299027:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446144 00000100:00100000:1.0:1789760777.299083:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715531105333 time 715542329827 state 0x0 ref 1 00000100:00100000:1.0:1789760777.299165:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715542590243 time 715542329827 state 0x1 ref 1 00000100:00100000:1.0:1789760777.299197:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715542590243 time 715559488606 state 0x0 ref 1 00000100:00100000:1.0:1789760777.299316:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565446144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.299369:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70914048, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d20 00010000:00010000:1.0:1789760777.299501:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.299518:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.299522:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.299530:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.299545:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.312803:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984621 is committed 00002000:00010000:1.0:1789760777.313331:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70914048 -> 70918144 00002000:00010000:1.0:1789760777.313337:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138528 -> 138536 00010000:00010000:1.0:1789760777.313351:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313365:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313373:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313380:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.313386:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313395:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313415:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.313423:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d877 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70914048->70918143] (req 70914048->70918143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.313524:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565446144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14311us (14715us total) trans 4294984621 rc 0/0 00000100:00100000:1.0:1789760777.313534:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17324 00000100:00100000:1.0:1789760777.313545:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715542590243 time 715559488606 state 0x2 ref 0 00000100:00100000:1.0:1789760777.316804:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.317088:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446272 00000100:00100000:2.0:1789760777.317098:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446272 00000100:00100000:2.0:1789760777.317150:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715542590243 time 715559488606 state 0x0 ref 1 00000100:00100000:2.0:1789760777.317165:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715559749022 time 715559488606 state 0x1 ref 1 00000100:00100000:2.0:1789760777.317194:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715559749022 time 715577485643 state 0x0 ref 1 00000100:00100000:2.0:1789760777.317209:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565446272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.317258:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70918144, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d28 00010000:00010000:2.0:1789760777.317268:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.317284:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.317289:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.317295:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.317310:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.322769:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984622 is committed 00002000:00010000:2.0:1789760777.322881:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70918144 -> 70922240 00002000:00010000:2.0:1789760777.322886:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138536 -> 138544 00010000:00010000:2.0:1789760777.322900:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322912:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322921:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322928:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.322933:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322942:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322961:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.322969:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d87e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70918144->70922239] (req 70918144->70922239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.323064:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565446272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5854us (6264us total) trans 4294984622 rc 0/0 00000100:00100000:2.0:1789760777.323076:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17325 00000100:00100000:2.0:1789760777.323086:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715559749022 time 715577485643 state 0x2 ref 0 00000100:00100000:0.0:1789760777.334288:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.334511:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446400 00000100:00100000:2.0:1789760777.334520:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446400 00000100:00100000:2.0:1789760777.334569:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715559749022 time 715577485643 state 0x0 ref 1 00000100:00100000:2.0:1789760777.334584:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715577746059 time 715577485643 state 0x1 ref 1 00000100:00100000:2.0:1789760777.334651:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715577746059 time 715594941435 state 0x0 ref 1 00000100:00100000:2.0:1789760777.334664:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.334754:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70922240, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d30 00010000:00010000:2.0:1789760777.334763:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.334778:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.334783:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.334789:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.334802:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.339925:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984623 is committed 00002000:00010000:2.0:1789760777.340198:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70922240 -> 70926336 00002000:00010000:2.0:1789760777.340203:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138544 -> 138552 00010000:00010000:2.0:1789760777.340217:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340230:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340238:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340245:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.340250:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340258:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340278:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.340286:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d885 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70922240->70926335] (req 70922240->70926335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.340415:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5748us (6130us total) trans 4294984623 rc 0/0 00000100:00100000:2.0:1789760777.340426:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17326 00000100:00100000:2.0:1789760777.340435:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715577746059 time 715594941435 state 0x2 ref 0 00000100:00100000:3.0:1789760777.346540:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.346643:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446528 00000100:00100000:1.0:1789760777.346653:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446528 00000100:00100000:1.0:1789760777.346758:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715577746059 time 715594941435 state 0x0 ref 1 00000100:00100000:1.0:1789760777.346775:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715595201851 time 715594941435 state 0x1 ref 1 00000100:00100000:1.0:1789760777.346801:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715595201851 time 715607092834 state 0x0 ref 1 00000100:00100000:1.0:1789760777.346820:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565446528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.346869:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70926336, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d38 00010000:00010000:1.0:1789760777.346879:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.346895:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.346900:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.346906:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.346920:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.353771:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984624 is committed 00002000:00010000:1.0:1789760777.353938:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70926336 -> 70930432 00002000:00010000:1.0:1789760777.353944:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138552 -> 138560 00010000:00010000:1.0:1789760777.353957:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.353970:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.353979:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.353988:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.353993:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.354002:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.354021:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.354028:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d88c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70926336->70930431] (req 70926336->70930431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.354376:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565446528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7554us (7840us total) trans 4294984624 rc 0/0 00000100:00100000:1.0:1789760777.354387:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17327 00000100:00100000:1.0:1789760777.354397:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715595201851 time 715607092834 state 0x2 ref 0 00000100:00100000:1.0:1789760777.359314:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.359570:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446656 00000100:00100000:2.0:1789760777.359581:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446656 00000100:00100000:2.0:1789760777.359634:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715595201851 time 715607092834 state 0x0 ref 1 00000100:00100000:2.0:1789760777.359650:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715607353250 time 715607092834 state 0x1 ref 1 00000100:00100000:2.0:1789760777.359670:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715607353250 time 715619962821 state 0x0 ref 1 00000100:00100000:2.0:1789760777.359683:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565446656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.359771:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70930432, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d40 00010000:00010000:2.0:1789760777.359780:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.359794:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.359798:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.359804:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.359818:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.367227:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984625 is committed 00002000:00010000:2.0:1789760777.367387:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70930432 -> 70934528 00002000:00010000:2.0:1789760777.367393:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138560 -> 138568 00010000:00010000:2.0:1789760777.367405:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367418:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367426:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367438:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.367443:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367451:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367471:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.367484:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d893 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70930432->70934527] (req 70930432->70934527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.367574:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565446656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7889us (8266us total) trans 4294984625 rc 0/0 00000100:00100000:2.0:1789760777.367589:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17328 00000100:00100000:2.0:1789760777.367599:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715607353250 time 715619962821 state 0x2 ref 0 00000100:00100000:0.0:1789760777.371502:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.371613:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446784 00000100:00100000:2.0:1789760777.371622:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446784 00000100:00100000:2.0:1789760777.371674:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715607353250 time 715619962821 state 0x0 ref 1 00000100:00100000:2.0:1789760777.371691:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715620223237 time 715619962821 state 0x1 ref 1 00000100:00100000:3.0:1789760777.372830:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715620223237 time 715633115717 state 0x0 ref 1 00000100:00100000:3.0:1789760777.372852:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.372942:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70934528, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d48 00010000:00010000:3.0:1789760777.372952:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.372969:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.372972:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.372978:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.372992:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.378970:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984626 is committed 00002000:00010000:3.0:1789760777.380072:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70934528 -> 70938624 00002000:00010000:3.0:1789760777.380358:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138568 -> 138576 00010000:00010000:3.0:1789760777.380372:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380385:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380394:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380402:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.380406:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380415:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380448:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.380456:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d89a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70934528->70938623] (req 70934528->70938623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.380602:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7753us (9105us total) trans 4294984626 rc 0/0 00000100:00100000:3.0:1789760777.380613:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17329 00000100:00100000:3.0:1789760777.380622:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715620223237 time 715633115717 state 0x2 ref 0 00000100:00100000:3.0:1789760777.391448:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.391554:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565446912 00000100:00100000:1.0:1789760777.391563:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565446912 00000100:00100000:1.0:1789760777.391614:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715620223237 time 715633115717 state 0x0 ref 1 00000100:00100000:1.0:1789760777.391628:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715633376133 time 715633115717 state 0x1 ref 1 00000100:00100000:1.0:1789760777.391658:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715633376133 time 715651950164 state 0x0 ref 1 00000100:00100000:1.0:1789760777.391669:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.391771:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70938624, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d50 00010000:00010000:1.0:1789760777.391781:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.391796:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.391801:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.391807:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.391820:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.403653:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984627 is committed 00002000:00010000:1.0:1789760777.403894:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70938624 -> 70942720 00002000:00010000:1.0:1789760777.403899:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138576 -> 138584 00010000:00010000:1.0:1789760777.403912:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403924:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403934:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403942:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.403948:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403962:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403982:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.403990:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d8a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70938624->70942719] (req 70938624->70942719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.404805:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565446912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12406us (12636us total) trans 4294984627 rc 0/0 00000100:00100000:1.0:1789760777.404819:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17330 00000100:00100000:1.0:1789760777.404829:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715633376133 time 715651950164 state 0x2 ref 0 00000100:00100000:1.0:1789760777.411357:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.411449:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447040 00000100:00100000:2.0:1789760777.411459:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447040 00000100:00100000:2.0:1789760777.411510:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715633376133 time 715651950164 state 0x0 ref 1 00000100:00100000:2.0:1789760777.411526:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715652210580 time 715651950164 state 0x1 ref 1 00000100:00100000:2.0:1789760777.411561:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715652210580 time 715671852773 state 0x0 ref 1 00000100:00100000:2.0:1789760777.411573:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.411620:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70942720, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d58 00010000:00010000:2.0:1789760777.411632:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.411646:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.411650:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.411657:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.411671:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.417305:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984628 is committed 00002000:00010000:1.0:1789760777.417417:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70942720 -> 70946816 00002000:00010000:1.0:1789760777.417669:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138584 -> 138592 00010000:00010000:1.0:1789760777.417685:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417698:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417797:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417811:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.417816:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417825:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417898:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.417908:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674d8a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70942720->70946815] (req 70942720->70946815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.418060:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6483us (6706us total) trans 4294984628 rc 0/0 00000100:00100000:1.0:1789760777.418070:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17331 00000100:00100000:1.0:1789760777.418079:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715652210580 time 715671852773 state 0x2 ref 0 00010000:00010000:1.0:1789760777.421166:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760777.427957:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.428040:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447168 00000100:00100000:3.0:1789760777.428049:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447168 00000100:00100000:3.0:1789760777.428103:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715652210580 time 715671852773 state 0x0 ref 1 00000100:00100000:3.0:1789760777.428118:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715672113189 time 715671852773 state 0x1 ref 1 00000100:00100000:3.0:1789760777.428149:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715672113189 time 715688441422 state 0x0 ref 1 00000100:00100000:3.0:1789760777.428163:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.428210:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70946816, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d60 00010000:00010000:3.0:1789760777.428219:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.428240:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.428244:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.428251:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.428265:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.435167:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984629 is committed 00002000:00010000:3.0:1789760777.435274:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70946816 -> 70950912 00002000:00010000:3.0:1789760777.435278:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138592 -> 138600 00010000:00010000:3.0:1789760777.435291:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435303:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435311:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435319:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.435323:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435332:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435357:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.435365:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70946816->70950911] (req 70946816->70950911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.435459:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7295us (7508us total) trans 4294984629 rc 0/0 00000100:00100000:3.0:1789760777.435469:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17332 00000100:00100000:3.0:1789760777.435478:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715672113189 time 715688441422 state 0x2 ref 0 00000100:00100000:3.0:1789760777.442010:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.442745:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447296 00000100:00100000:1.0:1789760777.442756:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447296 00000100:00100000:1.0:1789760777.442956:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715672113189 time 715688441422 state 0x0 ref 1 00000100:00100000:1.0:1789760777.442973:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715688701838 time 715688441422 state 0x1 ref 1 00000100:00100000:1.0:1789760777.443121:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715688701838 time 715703412670 state 0x0 ref 1 00000100:00100000:1.0:1789760777.443134:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.443180:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70950912, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d68 00010000:00010000:1.0:1789760777.443188:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.443204:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.443208:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.443214:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.443229:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.449120:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984630 is committed 00002000:00010000:3.0:1789760777.449256:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70950912 -> 70955008 00002000:00010000:3.0:1789760777.449261:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138600 -> 138608 00010000:00010000:3.0:1789760777.449274:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449287:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449296:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449304:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.449308:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449317:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449336:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.449343:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674d8b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70950912->70955007] (req 70950912->70955007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.449595:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6458us (7592us total) trans 4294984630 rc 0/0 00000100:00100000:3.0:1789760777.450546:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17333 00000100:00100000:3.0:1789760777.450561:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715688701838 time 715703412670 state 0x2 ref 0 00000100:00100000:1.0:1789760777.458452:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.458622:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447424 00000100:00100000:2.0:1789760777.458632:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447424 00000100:00100000:2.0:1789760777.458689:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715688701838 time 715703412670 state 0x0 ref 1 00000100:00100000:2.0:1789760777.458758:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715703673086 time 715703412670 state 0x1 ref 1 00000100:00100000:2.0:1789760777.458780:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715703673086 time 715719072738 state 0x0 ref 1 00000100:00100000:2.0:1789760777.458793:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.458854:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70955008, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d70 00010000:00010000:2.0:1789760777.458863:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.458878:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.458882:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.458887:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.458900:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.464031:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984631 is committed 00002000:00010000:1.0:1789760777.464296:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70955008 -> 70959104 00002000:00010000:1.0:1789760777.464301:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138608 -> 138616 00010000:00010000:1.0:1789760777.464315:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464329:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464338:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464347:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.464353:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464362:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464381:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.464389:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674d8bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70955008->70959103] (req 70955008->70959103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.464522:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5727us (6076us total) trans 4294984631 rc 0/0 00000100:00100000:1.0:1789760777.464533:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17334 00000100:00100000:1.0:1789760777.464542:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715703673086 time 715719072738 state 0x2 ref 0 00000100:00100000:0.0:1789760777.469330:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.469439:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447552 00000100:00100000:3.0:1789760777.469448:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447552 00000100:00100000:3.0:1789760777.469503:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715703673086 time 715719072738 state 0x0 ref 1 00000100:00100000:3.0:1789760777.469517:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715719333154 time 715719072738 state 0x1 ref 1 00000100:00100000:3.0:1789760777.469546:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715719333154 time 715729837981 state 0x0 ref 1 00000100:00100000:3.0:1789760777.469558:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.469603:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70959104, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d78 00010000:00010000:3.0:1789760777.469612:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.469628:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.469633:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.469639:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.469654:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.475748:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984632 is committed 00002000:00010000:3.0:1789760777.475918:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70959104 -> 70963200 00002000:00010000:3.0:1789760777.475924:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138616 -> 138624 00010000:00010000:3.0:1789760777.475938:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.475951:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.475961:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.475968:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.475972:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.475981:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.476006:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.476014:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70959104->70963199] (req 70959104->70963199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.476149:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6588us (6824us total) trans 4294984632 rc 0/0 00000100:00100000:3.0:1789760777.476159:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17335 00000100:00100000:3.0:1789760777.476169:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715719333154 time 715729837981 state 0x2 ref 0 00000100:00100000:0.0:1789760777.484888:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760777.484911:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760777.484979:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760777.485193:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066048 00000100:00100000:3.0:1789760777.485202:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066048 00000100:00100000:3.0:1789760777.485327:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789760777.485338:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760777.485361:0:6955:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3853123584 avail 3618590720 00000100:00100000:3.0:1789760777.485416:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.485423:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760777.486922:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760777.487615:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.487744:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447680 00000100:00100000:3.0:1789760777.487751:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447680 00000100:00100000:3.0:1789760777.487812:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715719333154 time 715729837981 state 0x0 ref 1 00000100:00100000:3.0:1789760777.487827:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715730098397 time 715729837981 state 0x1 ref 1 00000100:00100000:3.0:1789760777.487858:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715730098397 time 715748149607 state 0x0 ref 1 00000100:00100000:3.0:1789760777.487871:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.487920:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70963200, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d80 00010000:00010000:3.0:1789760777.487930:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.487946:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.487950:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.487957:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.487970:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760777.489858:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760777.492283:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984633 is committed 00002000:00010000:3.0:1789760777.492396:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70963200 -> 70967296 00002000:00010000:3.0:1789760777.492402:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138624 -> 138632 00010000:00010000:3.0:1789760777.492416:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492430:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492440:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492448:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.492454:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492464:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492484:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.492492:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70963200->70967295] (req 70963200->70967295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.492647:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4774us (5041us total) trans 4294984633 rc 0/0 00000100:00100000:3.0:1789760777.492658:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17336 00000100:00100000:3.0:1789760777.492668:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715730098397 time 715748149607 state 0x2 ref 0 00000100:00100000:1.0:1789760777.498769:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.498900:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447808 00000100:00100000:2.0:1789760777.498910:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447808 00000100:00100000:2.0:1789760777.498961:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715730098397 time 715748149607 state 0x0 ref 1 00000100:00100000:2.0:1789760777.498977:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715748410023 time 715748149607 state 0x1 ref 1 00000100:00100000:2.0:1789760777.499009:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715748410023 time 715759301352 state 0x0 ref 1 00000100:00100000:2.0:1789760777.499023:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.499070:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70967296, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d88 00010000:00010000:2.0:1789760777.499080:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.499096:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.499101:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.499107:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.499126:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.507562:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984634 is committed 00002000:00010000:1.0:1789760777.507680:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70967296 -> 70971392 00002000:00010000:1.0:1789760777.507686:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138632 -> 138640 00010000:00010000:1.0:1789760777.507700:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507751:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507767:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507775:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.507780:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507790:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507818:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.507826:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674d8d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70967296->70971391] (req 70967296->70971391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.507926:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565447808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8901us (9162us total) trans 4294984634 rc 0/0 00000100:00100000:1.0:1789760777.507938:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17337 00000100:00100000:1.0:1789760777.507947:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715748410023 time 715759301352 state 0x2 ref 0 00000100:00100000:0.0:1789760777.513256:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.513343:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565447936 00000100:00100000:3.0:1789760777.513353:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565447936 00000100:00100000:3.0:1789760777.513406:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715748410023 time 715759301352 state 0x0 ref 1 00000100:00100000:3.0:1789760777.513422:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715759561768 time 715759301352 state 0x1 ref 1 00000100:00100000:3.0:1789760777.513450:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715759561768 time 715773741510 state 0x0 ref 1 00000100:00100000:3.0:1789760777.513462:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.513508:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70971392, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d90 00010000:00010000:3.0:1789760777.513517:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.513534:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.513538:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.513545:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.513558:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.520353:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984635 is committed 00002000:00010000:3.0:1789760777.520553:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70971392 -> 70975488 00002000:00010000:3.0:1789760777.520559:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138640 -> 138648 00010000:00010000:3.0:1789760777.520573:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520586:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520595:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520603:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.520607:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520616:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520634:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.520641:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d8d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70971392->70975487] (req 70971392->70975487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.520938:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565447936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7472us (7685us total) trans 4294984635 rc 0/0 00000100:00100000:3.0:1789760777.520948:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17338 00000100:00100000:3.0:1789760777.520959:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715759561768 time 715773741510 state 0x2 ref 0 00000100:00100000:3.0:1789760777.526450:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.526642:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448064 00000100:00100000:0.0:1789760777.526652:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448064 00000100:00100000:0.0:1789760777.526761:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715759561768 time 715773741510 state 0x0 ref 1 00000100:00100000:0.0:1789760777.526778:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715774001926 time 715773741510 state 0x1 ref 1 00000100:00100000:0.0:1789760777.526813:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715774001926 time 715787105154 state 0x0 ref 1 00000100:00100000:0.0:1789760777.526826:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.526876:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70975488, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21d98 00010000:00010000:0.0:1789760777.526885:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.526906:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1789760777.526911:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.526918:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.526931:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.537494:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984636 is committed 00002000:00010000:0.0:1789760777.538663:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70975488 -> 70979584 00002000:00010000:0.0:1789760777.538670:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138648 -> 138656 00010000:00010000:0.0:1789760777.538685:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.538697:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.538999:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.539009:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760777.539014:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.539023:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.539048:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.539056:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674d8e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70975488->70979583] (req 70975488->70979583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.539203:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12374us (12759us total) trans 4294984636 rc 0/0 00000100:00100000:0.0:1789760777.539213:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17339 00000100:00100000:0.0:1789760777.539222:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715774001926 time 715787105154 state 0x2 ref 0 00000100:00100000:1.0:1789760777.549160:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.549310:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448192 00000100:00100000:2.0:1789760777.549321:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448192 00000100:00100000:2.0:1789760777.549371:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715774001926 time 715787105154 state 0x0 ref 1 00000100:00100000:2.0:1789760777.549385:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715787365570 time 715787105154 state 0x1 ref 1 00000100:00100000:2.0:1789760777.549417:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715787365570 time 715809708945 state 0x0 ref 1 00000100:00100000:2.0:1789760777.549429:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.549478:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70979584, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21da0 00010000:00010000:2.0:1789760777.549489:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.549505:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.549510:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.549517:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.549531:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.556240:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984637 is committed 00002000:00010000:2.0:1789760777.556348:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70979584 -> 70983680 00002000:00010000:2.0:1789760777.556354:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138656 -> 138664 00010000:00010000:2.0:1789760777.556369:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556382:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556392:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556399:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.556404:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556414:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556433:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.556441:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70979584->70983679] (req 70979584->70983679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.556532:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7099us (7377us total) trans 4294984637 rc 0/0 00000100:00100000:2.0:1789760777.556543:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17340 00000100:00100000:2.0:1789760777.556552:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715787365570 time 715809708945 state 0x2 ref 0 00000100:00100000:1.0:1789760777.562355:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.562548:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448320 00000100:00100000:3.0:1789760777.562558:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448320 00000100:00100000:3.0:1789760777.562612:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715787365570 time 715809708945 state 0x0 ref 1 00000100:00100000:3.0:1789760777.562628:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715809969361 time 715809708945 state 0x1 ref 1 00000100:00100000:3.0:1789760777.562754:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715809969361 time 715823045240 state 0x0 ref 1 00000100:00100000:3.0:1789760777.562767:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.562812:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70983680, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21da8 00010000:00010000:3.0:1789760777.563927:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.563953:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.563958:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.563965:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.563980:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.569756:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984638 is committed 00002000:00010000:3.0:1789760777.569877:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70983680 -> 70987776 00002000:00010000:3.0:1789760777.569882:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138664 -> 138672 00010000:00010000:3.0:1789760777.569895:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569908:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569918:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569926:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.569931:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569941:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569965:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.569977:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d8ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70983680->70987775] (req 70983680->70987775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.570071:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7301us (7718us total) trans 4294984638 rc 0/0 00000100:00100000:3.0:1789760777.570081:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17341 00000100:00100000:3.0:1789760777.570091:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715809969361 time 715823045240 state 0x2 ref 0 00000100:00100000:3.0:1789760777.574386:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.577598:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448448 00000100:00100000:0.0:1789760777.577613:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448448 00000100:00100000:1.0:1789760777.581371:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715809969361 time 715823045240 state 0x0 ref 1 00000100:00100000:1.0:1789760777.581393:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715823305656 time 715823045240 state 0x1 ref 1 00000100:00100000:1.0:1789760777.582147:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715823305656 time 715842371293 state 0x0 ref 1 00000100:00100000:1.0:1789760777.582167:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.582219:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70987776, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21db0 00010000:00010000:1.0:1789760777.582229:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.582245:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.582250:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.582256:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.582271:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.588298:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984639 is committed 00002000:00010000:1.0:1789760777.588496:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70987776 -> 70991872 00002000:00010000:1.0:1789760777.588502:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138672 -> 138680 00010000:00010000:1.0:1789760777.588515:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588528:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588538:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588546:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.588551:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588630:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588650:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.588657:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674d8f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70987776->70991871] (req 70987776->70991871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.589005:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565448448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6838us (14625us total) trans 4294984639 rc 0/0 00000100:00100000:1.0:1789760777.589016:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17342 00000100:00100000:1.0:1789760777.589027:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715823305656 time 715842371293 state 0x2 ref 0 00000100:00100000:1.0:1789760777.603284:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.603492:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448576 00000100:00100000:2.0:1789760777.603503:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448576 00000100:00100000:2.0:1789760777.603559:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715823305656 time 715842371293 state 0x0 ref 1 00000100:00100000:2.0:1789760777.603575:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715842631709 time 715842371293 state 0x1 ref 1 00000100:00100000:2.0:1789760777.604001:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715842631709 time 715864290252 state 0x0 ref 1 00000100:00100000:2.0:1789760777.604016:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565448576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.604064:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70991872, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21db8 00010000:00010000:2.0:1789760777.604342:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.604359:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.604364:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.604370:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.604386:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.609480:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984640 is committed 00002000:00010000:1.0:1789760777.609726:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70991872 -> 70995968 00002000:00010000:1.0:1789760777.609740:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138680 -> 138688 00010000:00010000:1.0:1789760777.609754:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609764:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609773:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609780:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.609785:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609794:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609813:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.609829:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674d8fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70991872->70995967] (req 70991872->70995967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.609921:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565448576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5904us (6641us total) trans 4294984640 rc 0/0 00000100:00100000:1.0:1789760777.609932:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17343 00000100:00100000:1.0:1789760777.609941:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715842631709 time 715864290252 state 0x2 ref 0 00000100:00100000:1.0:1789760777.615191:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.615308:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448704 00000100:00100000:3.0:1789760777.615318:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448704 00000100:00100000:3.0:1789760777.615367:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715842631709 time 715864290252 state 0x0 ref 1 00000100:00100000:3.0:1789760777.615380:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715864550668 time 715864290252 state 0x1 ref 1 00000100:00100000:3.0:1789760777.615410:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715864550668 time 715875702630 state 0x0 ref 1 00000100:00100000:3.0:1789760777.615422:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565448704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.615473:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70995968, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21dc0 00010000:00010000:3.0:1789760777.615482:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.615501:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.615505:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.615511:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.615523:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.621929:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984641 is committed 00002000:00010000:3.0:1789760777.622058:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70995968 -> 71000064 00002000:00010000:3.0:1789760777.622063:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138688 -> 138696 00010000:00010000:3.0:1789760777.622374:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622389:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622397:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622405:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760777.622410:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622419:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622443:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.622450:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674d903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70995968->71000063] (req 70995968->71000063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.622543:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565448704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7118us (7365us total) trans 4294984641 rc 0/0 00000100:00100000:3.0:1789760777.622554:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17344 00000100:00100000:3.0:1789760777.622565:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715864550668 time 715875702630 state 0x2 ref 0 00000100:00100000:3.0:1789760777.626856:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.626921:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448832 00000100:00100000:1.0:1789760777.626930:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448832 00000100:00100000:1.0:1789760777.626982:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715864550668 time 715875702630 state 0x0 ref 1 00000100:00100000:1.0:1789760777.627002:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715875963046 time 715875702630 state 0x1 ref 1 00000100:00100000:1.0:1789760777.627023:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715875963046 time 715887315754 state 0x0 ref 1 00000100:00100000:1.0:1789760777.627035:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.627079:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71000064, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21dc8 00010000:00010000:1.0:1789760777.627088:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.627105:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.627110:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.627116:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.627129:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.631445:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984642 is committed 00002000:00010000:1.0:1789760777.631545:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71000064 -> 71004160 00002000:00010000:1.0:1789760777.631550:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138696 -> 138704 00010000:00010000:1.0:1789760777.631563:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631575:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631584:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631591:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.631595:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631604:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631621:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.631629:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d90a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71000064->71004159] (req 71000064->71004159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.631753:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4716us (4940us total) trans 4294984642 rc 0/0 00000100:00100000:1.0:1789760777.631764:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17345 00000100:00100000:1.0:1789760777.631773:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715875963046 time 715887315754 state 0x2 ref 0 00000100:00100000:1.0:1789760777.636861:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.637915:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565448960 00000100:00100000:2.0:1789760777.637928:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565448960 00000100:00100000:2.0:1789760777.637990:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715875963046 time 715887315754 state 0x0 ref 1 00000100:00100000:2.0:1789760777.638006:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715887576170 time 715887315754 state 0x1 ref 1 00000100:00100000:2.0:1789760777.638042:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715887576170 time 715898333712 state 0x0 ref 1 00000100:00100000:2.0:1789760777.638055:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.638101:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71004160, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21dd0 00010000:00010000:2.0:1789760777.638111:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.638127:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.638131:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.638138:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.638152:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.643128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984643 is committed 00002000:00010000:2.0:1789760777.643242:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71004160 -> 71008256 00002000:00010000:2.0:1789760777.643247:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138704 -> 138712 00010000:00010000:2.0:1789760777.643260:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643273:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643287:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643357:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.643362:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643371:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643396:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.643404:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674d911 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71004160->71008255] (req 71004160->71008255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.643497:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565448960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5440us (6641us total) trans 4294984643 rc 0/0 00000100:00100000:2.0:1789760777.643507:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17346 00000100:00100000:2.0:1789760777.643516:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715887576170 time 715898333712 state 0x2 ref 0 00000100:00100000:2.0:1789760777.648007:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.648185:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449088 00000100:00100000:3.0:1789760777.648200:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449088 00000100:00100000:3.0:1789760777.650026:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715887576170 time 715898333712 state 0x0 ref 1 00000100:00100000:3.0:1789760777.650051:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715898594128 time 715898333712 state 0x1 ref 1 00000100:00100000:3.0:1789760777.650204:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715898594128 time 715910494275 state 0x0 ref 1 00000100:00100000:3.0:1789760777.650229:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.650295:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71008256, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21dd8 00010000:00010000:3.0:1789760777.650307:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.650328:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.650333:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.650341:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.650358:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.661429:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984644 is committed 00002000:00010000:1.0:1789760777.661551:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71008256 -> 71012352 00002000:00010000:1.0:1789760777.661556:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138712 -> 138720 00010000:00010000:1.0:1789760777.661570:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661582:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661591:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661598:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.661602:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661610:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661627:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.661634:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674d918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71008256->71012351] (req 71008256->71012351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.661767:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11545us (13770us total) trans 4294984644 rc 0/0 00000100:00100000:1.0:1789760777.661776:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17347 00000100:00100000:1.0:1789760777.661787:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715898594128 time 715910494275 state 0x2 ref 0 00000100:00100000:3.0:1789760777.666918:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.666966:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449216 00000100:00100000:1.0:1789760777.666976:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449216 00000100:00100000:1.0:1789760777.667028:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715898594128 time 715910494275 state 0x0 ref 1 00000100:00100000:1.0:1789760777.667044:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715910754691 time 715910494275 state 0x1 ref 1 00000100:00100000:1.0:1789760777.667120:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715910754691 time 715927410544 state 0x0 ref 1 00000100:00100000:1.0:1789760777.667135:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.667184:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71012352, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21de0 00010000:00010000:1.0:1789760777.667194:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.667209:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.667214:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.667220:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.667234:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.671608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984645 is committed 00002000:00010000:1.0:1789760777.671831:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71012352 -> 71016448 00002000:00010000:1.0:1789760777.671836:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138720 -> 138728 00010000:00010000:1.0:1789760777.671850:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671863:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671873:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671886:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.671892:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671903:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671922:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.671931:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674d91f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71012352->71016447] (req 71012352->71016447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.672026:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4889us (5112us total) trans 4294984645 rc 0/0 00000100:00100000:1.0:1789760777.672036:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17348 00000100:00100000:1.0:1789760777.672045:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715910754691 time 715927410544 state 0x2 ref 0 00000100:00100000:3.0:1789760777.676172:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.676325:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449344 00000100:00100000:2.0:1789760777.676335:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449344 00000100:00100000:2.0:1789760777.676394:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715910754691 time 715927410544 state 0x0 ref 1 00000100:00100000:2.0:1789760777.676410:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715927670960 time 715927410544 state 0x1 ref 1 00000100:00100000:2.0:1789760777.676442:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715927670960 time 715936734235 state 0x0 ref 1 00000100:00100000:2.0:1789760777.676455:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.676500:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71016448, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21de8 00010000:00010000:2.0:1789760777.676509:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.676524:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.676528:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.676534:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.676547:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.681316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984646 is committed 00002000:00010000:2.0:1789760777.681870:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71016448 -> 71020544 00002000:00010000:2.0:1789760777.681875:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138728 -> 138736 00010000:00010000:2.0:1789760777.681888:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681908:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681918:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681926:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.681931:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681941:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681960:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.681968:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d926 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71016448->71020543] (req 71016448->71020543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.682057:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5600us (5890us total) trans 4294984646 rc 0/0 00000100:00100000:2.0:1789760777.682068:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17349 00000100:00100000:2.0:1789760777.682086:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715927670960 time 715936734235 state 0x2 ref 0 00000100:00100000:2.0:1789760777.686884:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.686981:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449472 00000100:00100000:1.0:1789760777.686992:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449472 00000100:00100000:1.0:1789760777.687046:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715927670960 time 715936734235 state 0x0 ref 1 00000100:00100000:1.0:1789760777.687062:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715936994651 time 715936734235 state 0x1 ref 1 00000100:00100000:1.0:1789760777.687097:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715936994651 time 715947389203 state 0x0 ref 1 00000100:00100000:1.0:1789760777.687114:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.687163:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71020544, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21df0 00010000:00010000:1.0:1789760777.687174:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.687191:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1789760777.687195:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.687202:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.687226:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.691631:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984647 is committed 00002000:00010000:1.0:1789760777.694865:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71020544 -> 71024640 00002000:00010000:1.0:1789760777.694876:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138736 -> 138744 00010000:00010000:1.0:1789760777.694891:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694904:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694914:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694922:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.694927:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694935:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694955:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.694962:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674d92d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71020544->71024639] (req 71020544->71024639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.695181:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8064us (8301us total) trans 4294984647 rc 0/0 00000100:00100000:1.0:1789760777.695193:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17350 00000100:00100000:1.0:1789760777.695203:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715936994651 time 715947389203 state 0x2 ref 0 00000100:00100000:1.0:1789760777.701490:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.701962:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449600 00000100:00100000:3.0:1789760777.701972:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449600 00000100:00100000:2.0:1789760777.702232:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715936994651 time 715947389203 state 0x0 ref 1 00000100:00100000:2.0:1789760777.702246:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715947649619 time 715947389203 state 0x1 ref 1 00000100:00100000:2.0:1789760777.702314:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715947649619 time 715962605686 state 0x0 ref 1 00000100:00100000:2.0:1789760777.702328:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.702376:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71024640, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21df8 00010000:00010000:2.0:1789760777.702385:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.702399:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.702470:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.702476:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.702491:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.709439:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984648 is committed 00002000:00010000:2.0:1789760777.709601:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71024640 -> 71028736 00002000:00010000:2.0:1789760777.709606:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138744 -> 138752 00010000:00010000:2.0:1789760777.709619:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709632:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709646:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709653:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.709658:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709667:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709686:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.709693:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d934 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71024640->71028735] (req 71024640->71028735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.709977:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7646us (8493us total) trans 4294984648 rc 0/0 00000100:00100000:2.0:1789760777.709988:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17351 00000100:00100000:2.0:1789760777.709997:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715947649619 time 715962605686 state 0x2 ref 0 00000100:00100000:3.0:1789760777.716912:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.717873:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449728 00000100:00100000:2.0:1789760777.717883:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449728 00000100:00100000:2.0:1789760777.717938:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715947649619 time 715962605686 state 0x0 ref 1 00000100:00100000:2.0:1789760777.717953:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715962866102 time 715962605686 state 0x1 ref 1 00000100:00100000:2.0:1789760777.718034:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715962866102 time 715978324908 state 0x0 ref 1 00000100:00100000:2.0:1789760777.718047:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.718094:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71028736, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e00 00010000:00010000:2.0:1789760777.718103:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.718117:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1789760777.718131:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.718138:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.718152:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.722551:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984649 is committed 00002000:00010000:2.0:1789760777.722775:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71028736 -> 71032832 00002000:00010000:2.0:1789760777.722780:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138752 -> 138760 00010000:00010000:2.0:1789760777.722884:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722898:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722908:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722920:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.722925:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722934:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722953:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.722961:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d93b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71028736->71032831] (req 71028736->71032831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.723053:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565449728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5003us (6264us total) trans 4294984649 rc 0/0 00000100:00100000:2.0:1789760777.723062:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17352 00000100:00100000:2.0:1789760777.723072:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715962866102 time 715978324908 state 0x2 ref 0 00000100:00100000:1.0:1789760777.727578:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760777.727907:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449856 00000100:00100000:3.0:1789760777.727916:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449856 00000100:00100000:3.0:1789760777.727968:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715962866102 time 715978324908 state 0x0 ref 1 00000100:00100000:3.0:1789760777.727982:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715978585324 time 715978324908 state 0x1 ref 1 00000100:00100000:3.0:1789760777.728013:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715978585324 time 715988304777 state 0x0 ref 1 00000100:00100000:3.0:1789760777.728029:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565449856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760777.728074:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71032832, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e08 00010000:00010000:3.0:1789760777.728083:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.728099:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789760777.728103:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.728110:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.728664:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.737184:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984650 is committed 00002000:00010000:1.0:1789760777.737441:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71032832 -> 71036928 00002000:00010000:1.0:1789760777.737446:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138760 -> 138768 00010000:00010000:1.0:1789760777.737461:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737474:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737488:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737495:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.737500:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737509:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737527:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.737536:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674d942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71032832->71036927] (req 71032832->71036927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.737947:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565449856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9913us (10371us total) trans 4294984650 rc 0/0 00000100:00100000:1.0:1789760777.737957:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17353 00000100:00100000:1.0:1789760777.737967:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715978585324 time 715988304777 state 0x2 ref 0 00000100:00100000:1.0:1789760777.743227:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.743321:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565449984 00000100:00100000:2.0:1789760777.743330:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565449984 00000100:00100000:2.0:1789760777.743383:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715978585324 time 715988304777 state 0x0 ref 1 00000100:00100000:2.0:1789760777.743398:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715988565193 time 715988304777 state 0x1 ref 1 00000100:00100000:2.0:1789760777.743429:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715988565193 time 716003720746 state 0x0 ref 1 00000100:00100000:2.0:1789760777.743443:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.743488:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71036928, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e10 00010000:00010000:2.0:1789760777.743496:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.743511:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760777.743515:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.743521:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.743535:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.750194:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984651 is committed 00002000:00010000:1.0:1789760777.750331:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71036928 -> 71041024 00002000:00010000:1.0:1789760777.750337:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138768 -> 138776 00010000:00010000:1.0:1789760777.750350:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750363:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750372:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750379:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.750383:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750393:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750412:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.750420:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674d949 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71036928->71041023] (req 71036928->71041023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.750516:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565449984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7069us (7292us total) trans 4294984651 rc 0/0 00000100:00100000:1.0:1789760777.750526:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17354 00000100:00100000:1.0:1789760777.750535:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715988565193 time 716003720746 state 0x2 ref 0 00000100:00100000:2.0:1789760777.754476:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.754560:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450112 00000100:00100000:1.0:1789760777.754570:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450112 00000100:00100000:1.0:1789760777.756995:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 715988565193 time 716003720746 state 0x0 ref 1 00000100:00100000:1.0:1789760777.757018:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716003981162 time 716003720746 state 0x1 ref 1 00000100:00100000:1.0:1789760777.757114:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716003981162 time 716017405631 state 0x0 ref 1 00000100:00100000:1.0:1789760777.757137:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.757187:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71041024, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e18 00010000:00010000:1.0:1789760777.757196:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.757222:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.757226:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.757232:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.757246:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.761676:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984652 is committed 00002000:00010000:1.0:1789760777.763415:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71041024 -> 71045120 00002000:00010000:1.0:1789760777.763424:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138776 -> 138784 00010000:00010000:1.0:1789760777.763437:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763449:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763463:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763471:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.763476:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763485:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763505:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.763512:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d950 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71041024->71045119] (req 71041024->71045119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.763594:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6464us (9123us total) trans 4294984652 rc 0/0 00000100:00100000:1.0:1789760777.763604:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17355 00000100:00100000:1.0:1789760777.763613:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716003981162 time 716017405631 state 0x2 ref 0 00000100:00100000:2.0:1789760777.770757:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.770912:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450240 00000100:00100000:1.0:1789760777.770931:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450240 00000100:00100000:1.0:1789760777.770983:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716003981162 time 716017405631 state 0x0 ref 1 00000100:00100000:1.0:1789760777.770997:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716017666047 time 716017405631 state 0x1 ref 1 00000100:00100000:1.0:1789760777.771068:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716017666047 time 716031359688 state 0x0 ref 1 00000100:00100000:1.0:1789760777.771080:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.771127:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71045120, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e20 00010000:00010000:1.0:1789760777.771136:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.771151:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.771155:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.771161:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.771174:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.776345:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984653 is committed 00002000:00010000:1.0:1789760777.776456:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71045120 -> 71049216 00002000:00010000:1.0:1789760777.776475:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138784 -> 138792 00010000:00010000:1.0:1789760777.776488:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776499:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776507:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776518:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.776523:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776531:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776549:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.776555:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d957 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71045120->71049215] (req 71045120->71049215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.776642:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5557us (5934us total) trans 4294984653 rc 0/0 00000100:00100000:1.0:1789760777.776652:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17356 00000100:00100000:1.0:1789760777.776662:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716017666047 time 716031359688 state 0x2 ref 0 00000100:00100000:0.0:1789760777.784386:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.784556:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450368 00000100:00100000:1.0:1789760777.784566:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450368 00000100:00100000:1.0:1789760777.784688:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716017666047 time 716031359688 state 0x0 ref 1 00000100:00100000:1.0:1789760777.784768:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716031620104 time 716031359688 state 0x1 ref 1 00000100:00100000:1.0:1789760777.784826:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716031620104 time 716045117400 state 0x0 ref 1 00000100:00100000:1.0:1789760777.784841:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.784898:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71049216, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e28 00010000:00010000:1.0:1789760777.784908:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.784923:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.784928:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.784935:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.784948:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.789914:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984654 is committed 00002000:00010000:1.0:1789760777.790106:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71049216 -> 71053312 00002000:00010000:1.0:1789760777.790111:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138792 -> 138800 00010000:00010000:1.0:1789760777.790124:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790137:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790146:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790154:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.790159:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790168:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790188:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.790196:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d95e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71049216->71053311] (req 71049216->71053311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.790320:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5476us (5938us total) trans 4294984654 rc 0/0 00000100:00100000:1.0:1789760777.790330:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17357 00000100:00100000:1.0:1789760777.790339:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716031620104 time 716045117400 state 0x2 ref 0 00000100:00100000:2.0:1789760777.795510:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.795586:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450496 00000100:00100000:1.0:1789760777.795596:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450496 00000100:00100000:1.0:1789760777.795652:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716031620104 time 716045117400 state 0x0 ref 1 00000100:00100000:1.0:1789760777.795667:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716045377816 time 716045117400 state 0x1 ref 1 00000100:00100000:1.0:1789760777.795751:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716045377816 time 716056042877 state 0x0 ref 1 00000100:00100000:1.0:1789760777.795763:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565450496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.795810:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71053312, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e30 00010000:00010000:1.0:1789760777.795820:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.795834:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.795838:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.795845:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.795858:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.803583:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984655 is committed 00002000:00010000:1.0:1789760777.803876:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71053312 -> 71057408 00002000:00010000:1.0:1789760777.803882:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138800 -> 138808 00010000:00010000:1.0:1789760777.803897:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.803913:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.803988:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.803997:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.804002:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.804011:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.804032:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.804039:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d965 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71053312->71057407] (req 71053312->71057407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.804235:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565450496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8468us (8730us total) trans 4294984655 rc 0/0 00000100:00100000:1.0:1789760777.804246:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17358 00000100:00100000:1.0:1789760777.804255:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716045377816 time 716056042877 state 0x2 ref 0 00000100:00100000:2.0:1789760777.813417:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.813560:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450624 00000100:00100000:1.0:1789760777.813570:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450624 00000100:00100000:1.0:1789760777.813625:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716045377816 time 716056042877 state 0x0 ref 1 00000100:00100000:1.0:1789760777.813640:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716056303293 time 716056042877 state 0x1 ref 1 00000100:00100000:1.0:1789760777.813679:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716056303293 time 716073963850 state 0x0 ref 1 00000100:00100000:1.0:1789760777.813692:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.813779:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71057408, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e38 00010000:00010000:1.0:1789760777.813789:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.813805:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.813811:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.813817:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.813830:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.818686:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984656 is committed 00002000:00010000:1.0:1789760777.819455:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71057408 -> 71061504 00002000:00010000:1.0:1789760777.819461:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138808 -> 138816 00010000:00010000:1.0:1789760777.819474:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819487:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819495:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819502:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.819507:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819515:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819535:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.819547:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d96c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71057408->71061503] (req 71057408->71061503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.819640:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5946us (6229us total) trans 4294984656 rc 0/0 00000100:00100000:1.0:1789760777.819651:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17359 00000100:00100000:1.0:1789760777.819660:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716056303293 time 716073963850 state 0x2 ref 0 00000100:00100000:0.0:1789760777.827487:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.827534:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450752 00000100:00100000:1.0:1789760777.827543:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450752 00000100:00100000:1.0:1789760777.827598:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716056303293 time 716073963850 state 0x0 ref 1 00000100:00100000:1.0:1789760777.827613:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716074224266 time 716073963850 state 0x1 ref 1 00000100:00100000:1.0:1789760777.827692:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716074224266 time 716087982941 state 0x0 ref 1 00000100:00100000:1.0:1789760777.827757:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565450752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.827803:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71061504, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e40 00010000:00010000:1.0:1789760777.827812:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.827827:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.827832:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.827837:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.827856:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.834021:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984657 is committed 00002000:00010000:1.0:1789760777.834811:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71061504 -> 71065600 00002000:00010000:1.0:1789760777.834819:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138816 -> 138824 00010000:00010000:1.0:1789760777.834831:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834845:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834853:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834861:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.834867:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834875:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834895:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.834903:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d973 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71061504->71065599] (req 71061504->71065599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.835011:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565450752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7302us (7532us total) trans 4294984657 rc 0/0 00000100:00100000:1.0:1789760777.835021:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17360 00000100:00100000:1.0:1789760777.835031:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716074224266 time 716087982941 state 0x2 ref 0 00000100:00100000:2.0:1789760777.841651:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.841759:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565450880 00000100:00100000:1.0:1789760777.841769:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565450880 00000100:00100000:1.0:1789760777.841822:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716074224266 time 716087982941 state 0x0 ref 1 00000100:00100000:1.0:1789760777.841838:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716088243357 time 716087982941 state 0x1 ref 1 00000100:00100000:1.0:1789760777.841869:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716088243357 time 716102160987 state 0x0 ref 1 00000100:00100000:1.0:1789760777.841881:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.841937:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71065600, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e48 00010000:00010000:1.0:1789760777.841947:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.841963:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.841967:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.841974:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.841987:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.846209:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984658 is committed 00002000:00010000:1.0:1789760777.846335:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71065600 -> 71069696 00002000:00010000:1.0:1789760777.846341:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138824 -> 138832 00010000:00010000:1.0:1789760777.846355:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846368:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846377:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846385:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.846390:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846399:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846419:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.846427:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d97a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71065600->71069695] (req 71065600->71069695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.846533:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565450880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4648us (4885us total) trans 4294984658 rc 0/0 00000100:00100000:1.0:1789760777.846544:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17361 00000100:00100000:1.0:1789760777.846554:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716088243357 time 716102160987 state 0x2 ref 0 00000100:00100000:2.0:1789760777.851823:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.854153:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451008 00000100:00100000:1.0:1789760777.854167:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451008 00000100:00100000:1.0:1789760777.854227:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716088243357 time 716102160987 state 0x0 ref 1 00000100:00100000:1.0:1789760777.854242:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716102421403 time 716102160987 state 0x1 ref 1 00000100:00100000:1.0:1789760777.854279:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716102421403 time 716114571409 state 0x0 ref 1 00000100:00100000:1.0:1789760777.854291:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.854335:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71069696, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e50 00010000:00010000:1.0:1789760777.854344:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.854359:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.854364:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.854370:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.854384:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.864203:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984659 is committed 00002000:00010000:1.0:1789760777.864327:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71069696 -> 71073792 00002000:00010000:1.0:1789760777.864332:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138832 -> 138840 00010000:00010000:1.0:1789760777.864345:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864358:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864367:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864374:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.864379:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864388:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864406:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.864415:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d981 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71069696->71073791] (req 71069696->71073791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.864511:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10217us (12693us total) trans 4294984659 rc 0/0 00000100:00100000:1.0:1789760777.864521:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17362 00000100:00100000:1.0:1789760777.864532:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716102421403 time 716114571409 state 0x2 ref 0 00000100:00100000:0.0:1789760777.872901:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.873513:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451136 00000100:00100000:1.0:1789760777.873523:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451136 00000100:00100000:1.0:1789760777.873576:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716102421403 time 716114571409 state 0x0 ref 1 00000100:00100000:1.0:1789760777.873591:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716114831825 time 716114571409 state 0x1 ref 1 00000100:00100000:1.0:1789760777.873625:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716114831825 time 716133917481 state 0x0 ref 1 00000100:00100000:1.0:1789760777.873638:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.873683:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71073792, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e58 00010000:00010000:1.0:1789760777.873692:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.873751:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.873756:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.873762:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.873776:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.879178:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984660 is committed 00002000:00010000:2.0:1789760777.879294:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71073792 -> 71077888 00002000:00010000:2.0:1789760777.879299:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138840 -> 138848 00010000:00010000:2.0:1789760777.879313:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879329:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879339:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879347:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.879352:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879360:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879379:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.879387:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674d988 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71073792->71077887] (req 71073792->71077887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.879526:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5886us (6629us total) trans 4294984660 rc 0/0 00000100:00100000:2.0:1789760777.879537:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17363 00000100:00100000:2.0:1789760777.879546:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716114831825 time 716133917481 state 0x2 ref 0 00000100:00100000:2.0:1789760777.887930:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.888064:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451264 00000100:00100000:1.0:1789760777.888074:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451264 00000100:00100000:1.0:1789760777.888137:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716114831825 time 716133917481 state 0x0 ref 1 00000100:00100000:1.0:1789760777.888153:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716134177897 time 716133917481 state 0x1 ref 1 00000100:00100000:1.0:1789760777.888187:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716134177897 time 716148479253 state 0x0 ref 1 00000100:00100000:1.0:1789760777.888199:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.888246:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71077888, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e60 00010000:00010000:1.0:1789760777.888256:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.888272:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.888276:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.888283:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.888297:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.894585:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984661 is committed 00002000:00010000:1.0:1789760777.896529:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71077888 -> 71081984 00002000:00010000:1.0:1789760777.896539:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138848 -> 138856 00010000:00010000:1.0:1789760777.896553:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896566:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896575:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896590:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.896595:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896604:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896624:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.896632:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d98f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71077888->71081983] (req 71077888->71081983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.896947:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8745us (9023us total) trans 4294984661 rc 0/0 00000100:00100000:1.0:1789760777.896958:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17364 00000100:00100000:1.0:1789760777.896968:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716134177897 time 716148479253 state 0x2 ref 0 00000100:00100000:2.0:1789760777.906360:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.906432:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451392 00000100:00100000:1.0:1789760777.906443:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451392 00000100:00100000:1.0:1789760777.906508:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716134177897 time 716148479253 state 0x0 ref 1 00000100:00100000:1.0:1789760777.906524:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716148739669 time 716148479253 state 0x1 ref 1 00000100:00100000:1.0:1789760777.906592:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716148739669 time 716166883877 state 0x0 ref 1 00000100:00100000:1.0:1789760777.906608:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.906654:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71081984, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e68 00010000:00010000:1.0:1789760777.906663:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.906679:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.906684:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.906719:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.906742:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.912954:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984662 is committed 00002000:00010000:1.0:1789760777.913227:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71081984 -> 71086080 00002000:00010000:1.0:1789760777.913233:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138856 -> 138864 00010000:00010000:1.0:1789760777.913245:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913258:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913267:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913274:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.913280:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913300:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913319:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.913327:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d996 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71081984->71086079] (req 71081984->71086079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.913417:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6808us (7062us total) trans 4294984662 rc 0/0 00000100:00100000:1.0:1789760777.913427:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17365 00000100:00100000:1.0:1789760777.913436:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716148739669 time 716166883877 state 0x2 ref 0 00000100:00100000:0.0:1789760777.919236:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.919961:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451520 00000100:00100000:2.0:1789760777.919972:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451520 00000100:00100000:2.0:1789760777.920026:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716148739669 time 716166883877 state 0x0 ref 1 00000100:00100000:2.0:1789760777.920042:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716167144293 time 716166883877 state 0x1 ref 1 00000100:00100000:2.0:1789760777.920256:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716167144293 time 716180546677 state 0x0 ref 1 00000100:00100000:2.0:1789760777.920269:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.920860:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71086080, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e70 00010000:00010000:2.0:1789760777.920870:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.920886:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760777.920890:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.920897:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.920910:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.929128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984663 is committed 00002000:00010000:2.0:1789760777.929244:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71086080 -> 71090176 00002000:00010000:2.0:1789760777.929250:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138864 -> 138872 00010000:00010000:2.0:1789760777.929263:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929280:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929362:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929372:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.929376:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929386:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929474:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.929484:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674d99d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71086080->71090175] (req 71086080->71090175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.929582:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9309us (10349us total) trans 4294984663 rc 0/0 00000100:00100000:2.0:1789760777.929592:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17366 00000100:00100000:2.0:1789760777.929601:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716167144293 time 716180546677 state 0x2 ref 0 00000100:00100000:2.0:1789760777.934832:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.934934:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451648 00000100:00100000:0.0:1789760777.934944:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451648 00000100:00100000:0.0:1789760777.935000:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716167144293 time 716180546677 state 0x0 ref 1 00000100:00100000:0.0:1789760777.935187:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716180807093 time 716180546677 state 0x1 ref 1 00000100:00100000:0.0:1789760777.935259:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716180807093 time 716195550436 state 0x0 ref 1 00000100:00100000:0.0:1789760777.935274:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.935325:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71090176, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0x21e78 00010000:00010000:0.0:1789760777.935334:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.935349:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760777.935353:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.935360:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.935374:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.942246:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984664 is committed 00002000:00010000:2.0:1789760777.942508:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71090176 -> 71094272 00002000:00010000:2.0:1789760777.942513:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760777 -> 1789760778 00002000:00010000:2.0:1789760777.942516:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760777 -> 1789760778 00002000:00010000:2.0:1789760777.942518:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138872 -> 138880 00010000:00010000:2.0:1789760777.942532:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942545:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942554:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942561:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.942565:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942574:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942593:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.942602:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674d9a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71090176->71094271] (req 71090176->71094271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.942775:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565451648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7500us (7947us total) trans 4294984664 rc 0/0 00000100:00100000:2.0:1789760777.942787:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17367 00000100:00100000:2.0:1789760777.942797:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716180807093 time 716195550436 state 0x2 ref 0 00000100:00100000:0.0:1789760777.947639:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.947906:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451776 00000100:00100000:1.0:1789760777.947916:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451776 00000100:00100000:1.0:1789760777.947967:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716180807093 time 716195550436 state 0x0 ref 1 00000100:00100000:1.0:1789760777.947984:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716195810852 time 716195550436 state 0x1 ref 1 00000100:00100000:1.0:1789760777.948043:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716195810852 time 716208335108 state 0x0 ref 1 00000100:00100000:1.0:1789760777.948056:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.948113:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71094272, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21e80 00010000:00010000:1.0:1789760777.948122:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.948138:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.948143:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.948149:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.948162:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.953435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984665 is committed 00002000:00010000:1.0:1789760777.953675:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71094272 -> 71098368 00002000:00010000:1.0:1789760777.953680:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138880 -> 138888 00010000:00010000:1.0:1789760777.953693:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954381:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954392:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954400:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.954404:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954425:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954449:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.954457:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674d9ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71094272->71098367] (req 71094272->71098367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.954551:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6492us (6917us total) trans 4294984665 rc 0/0 00000100:00100000:1.0:1789760777.954561:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17368 00000100:00100000:1.0:1789760777.954570:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716195810852 time 716208335108 state 0x2 ref 0 00000100:00100000:0.0:1789760777.960227:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.960332:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565451904 00000100:00100000:2.0:1789760777.960341:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565451904 00000100:00100000:2.0:1789760777.960393:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716195810852 time 716208335108 state 0x0 ref 1 00000100:00100000:2.0:1789760777.963190:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716208595524 time 716208335108 state 0x1 ref 1 00000100:00100000:2.0:1789760777.963248:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716208595524 time 716223537448 state 0x0 ref 1 00000100:00100000:2.0:1789760777.963273:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.963330:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71098368, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21e88 00010000:00010000:2.0:1789760777.963340:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.963356:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760777.963360:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.963366:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.963380:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.968874:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984666 is committed 00002000:00010000:2.0:1789760777.968991:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71098368 -> 71102464 00002000:00010000:2.0:1789760777.968996:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138888 -> 138896 00010000:00010000:2.0:1789760777.969009:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969021:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969030:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969038:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760777.969043:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969052:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969072:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.969090:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674d9b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71098368->71102463] (req 71098368->71102463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760777.969187:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565451904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5922us (8965us total) trans 4294984666 rc 0/0 00000100:00100000:2.0:1789760777.969198:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17369 00000100:00100000:2.0:1789760777.969209:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716208595524 time 716223537448 state 0x2 ref 0 00000100:00100000:2.0:1789760777.973512:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760777.973643:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452032 00000100:00100000:0.0:1789760777.973651:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452032 00000100:00100000:0.0:1789760777.973759:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716208595524 time 716223537448 state 0x0 ref 1 00000100:00100000:0.0:1789760777.973775:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716223797864 time 716223537448 state 0x1 ref 1 00000100:00100000:0.0:1789760777.973797:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716223797864 time 716234088696 state 0x0 ref 1 00000100:00100000:0.0:1789760777.973810:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760777.973856:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71102464, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21e90 00010000:00010000:0.0:1789760777.973867:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.973884:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760777.973889:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.973895:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.973910:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.979420:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984667 is committed 00002000:00010000:0.0:1789760777.979652:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71102464 -> 71106560 00002000:00010000:0.0:1789760777.979657:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138896 -> 138904 00010000:00010000:0.0:1789760777.979680:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979692:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979701:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979870:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760777.979875:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979886:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979907:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.979915:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71102464->71106559] (req 71102464->71106559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.979996:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6184us (6491us total) trans 4294984667 rc 0/0 00000100:00100000:0.0:1789760777.980006:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17370 00000100:00100000:0.0:1789760777.980016:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716223797864 time 716234088696 state 0x2 ref 0 00000100:00100000:0.0:1789760777.984134:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760777.984223:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452160 00000100:00100000:1.0:1789760777.984232:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452160 00000100:00100000:1.0:1789760777.984284:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716223797864 time 716234088696 state 0x0 ref 1 00000100:00100000:1.0:1789760777.984297:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716234349112 time 716234088696 state 0x1 ref 1 00000100:00100000:1.0:1789760777.984356:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716234349112 time 716244647777 state 0x0 ref 1 00000100:00100000:1.0:1789760777.984369:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760777.984413:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71106560, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21e98 00010000:00010000:1.0:1789760777.984423:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.984439:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760777.984444:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.984450:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.984465:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760777.989079:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984668 is committed 00002000:00010000:1.0:1789760777.989245:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71106560 -> 71110656 00002000:00010000:1.0:1789760777.989250:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138904 -> 138912 00010000:00010000:1.0:1789760777.989264:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989276:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989284:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989291:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760777.989295:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989303:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989332:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.989340:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674d9c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71106560->71110655] (req 71106560->71110655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.989428:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5056us (5299us total) trans 4294984668 rc 0/0 00000100:00100000:1.0:1789760777.989439:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17371 00000100:00100000:1.0:1789760777.989448:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716234349112 time 716244647777 state 0x2 ref 0 00000100:00100000:1.0:1789760777.997894:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760777.997987:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452288 00000100:00100000:2.0:1789760777.997996:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452288 00000100:00100000:2.0:1789760777.998049:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716234349112 time 716244647777 state 0x0 ref 1 00000100:00100000:2.0:1789760777.998064:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716244908193 time 716244647777 state 0x1 ref 1 00000100:00100000:2.0:1789760777.998097:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716244908193 time 716258389357 state 0x0 ref 1 00000100:00100000:2.0:1789760777.998110:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760777.998157:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71110656, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ea0 00010000:00010000:2.0:1789760777.998166:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.998182:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760777.998186:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760777.998193:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760777.998219:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.006432:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984669 is committed 00002000:00010000:0.0:1789760778.006539:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71110656 -> 71114752 00002000:00010000:0.0:1789760778.006543:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138912 -> 138920 00010000:00010000:0.0:1789760778.006557:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006569:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006577:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006584:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.006589:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006597:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006616:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.006623:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674d9c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71110656->71114751] (req 71110656->71114751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.006904:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565452288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8791us (9016us total) trans 4294984669 rc 0/0 00000100:00100000:0.0:1789760778.006914:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17372 00000100:00100000:0.0:1789760778.006924:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716244908193 time 716258389357 state 0x2 ref 0 00000100:00100000:2.0:1789760778.015101:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.015462:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452416 00000100:00100000:0.0:1789760778.015472:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452416 00000100:00100000:0.0:1789760778.015613:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716244908193 time 716258389357 state 0x0 ref 1 00000100:00100000:0.0:1789760778.015628:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716258649773 time 716258389357 state 0x1 ref 1 00000100:00100000:0.0:1789760778.015658:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716258649773 time 716275950186 state 0x0 ref 1 00000100:00100000:0.0:1789760778.015673:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565452416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.015751:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71114752, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ea8 00010000:00010000:0.0:1789760778.015760:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.015776:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.015780:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.015786:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.015799:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760778.016544:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760778.020765:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984670 is committed 00002000:00010000:0.0:1789760778.020885:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71114752 -> 71118848 00002000:00010000:0.0:1789760778.020891:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138920 -> 138928 00010000:00010000:0.0:1789760778.020905:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020918:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020926:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020934:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.020938:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020946:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020968:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.020975:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71114752->71118847] (req 71114752->71118847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.021216:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565452416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5543us (6120us total) trans 4294984670 rc 0/0 00000100:00100000:0.0:1789760778.021226:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17373 00000100:00100000:0.0:1789760778.021234:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716258649773 time 716275950186 state 0x2 ref 0 00000100:00100000:2.0:1789760778.026052:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.026244:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452544 00000100:00100000:1.0:1789760778.026255:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452544 00000100:00100000:1.0:1789760778.026314:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716258649773 time 716275950186 state 0x0 ref 1 00000100:00100000:1.0:1789760778.026329:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716276210602 time 716275950186 state 0x1 ref 1 00000100:00100000:1.0:1789760778.026354:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716276210602 time 716286646651 state 0x0 ref 1 00000100:00100000:1.0:1789760778.026378:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.026425:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71118848, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21eb0 00010000:00010000:1.0:1789760778.026435:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.026457:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.026462:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.026468:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.026483:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.033907:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984671 is committed 00002000:00010000:1.0:1789760778.035292:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71118848 -> 71122944 00002000:00010000:1.0:1789760778.035300:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138928 -> 138936 00010000:00010000:1.0:1789760778.035313:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035326:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035334:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035341:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.035346:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035354:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035378:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.035385:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674d9d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71118848->71122943] (req 71118848->71122943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.035537:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9167us (9491us total) trans 4294984671 rc 0/0 00000100:00100000:1.0:1789760778.035549:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17374 00000100:00100000:1.0:1789760778.035559:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716276210602 time 716286646651 state 0x2 ref 0 00000100:00100000:1.0:1789760778.047059:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.049413:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452672 00000100:00100000:0.0:1789760778.049429:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452672 00000100:00100000:0.0:1789760778.049489:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716276210602 time 716286646651 state 0x0 ref 1 00000100:00100000:0.0:1789760778.049506:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716286907067 time 716286646651 state 0x1 ref 1 00000100:00100000:0.0:1789760778.049598:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716286907067 time 716309889154 state 0x0 ref 1 00000100:00100000:0.0:1789760778.049610:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565452672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.049656:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71122944, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21eb8 00010000:00010000:0.0:1789760778.049665:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.049681:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.049686:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.049693:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.049755:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.054225:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984672 is committed 00002000:00010000:0.0:1789760778.054343:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71122944 -> 71127040 00002000:00010000:0.0:1789760778.054348:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138936 -> 138944 00010000:00010000:0.0:1789760778.054362:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054375:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054384:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054392:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.054397:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054406:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054424:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.054437:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71122944->71127039] (req 71122944->71127039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.054651:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565452672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5037us (7595us total) trans 4294984672 rc 0/0 00000100:00100000:0.0:1789760778.054662:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17375 00000100:00100000:0.0:1789760778.054682:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716286907067 time 716309889154 state 0x2 ref 0 00000100:00100000:2.0:1789760778.061892:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.061977:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452800 00000100:00100000:0.0:1789760778.061987:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452800 00000100:00100000:0.0:1789760778.062043:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716286907067 time 716309889154 state 0x0 ref 1 00000100:00100000:0.0:1789760778.062058:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716310149570 time 716309889154 state 0x1 ref 1 00000100:00100000:0.0:1789760778.062093:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716310149570 time 716322385408 state 0x0 ref 1 00000100:00100000:0.0:1789760778.062106:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.062155:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71127040, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ec0 00010000:00010000:0.0:1789760778.062166:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.062181:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.062186:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.062194:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.062213:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.070061:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984673 is committed 00002000:00010000:0.0:1789760778.070207:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71127040 -> 71131136 00002000:00010000:0.0:1789760778.070213:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138944 -> 138952 00010000:00010000:0.0:1789760778.070227:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070240:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070249:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070256:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.070261:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070271:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070290:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.070299:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71127040->71131135] (req 71127040->71131135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.070392:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8283us (8504us total) trans 4294984673 rc 0/0 00000100:00100000:0.0:1789760778.070402:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17376 00000100:00100000:0.0:1789760778.070412:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716310149570 time 716322385408 state 0x2 ref 0 00000100:00100000:2.0:1789760778.074221:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.086660:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565452928 00000100:00100000:1.0:1789760778.086680:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565452928 00000100:00100000:1.0:1789760778.087075:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716310149570 time 716322385408 state 0x0 ref 1 00000100:00100000:1.0:1789760778.087095:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716322645824 time 716322385408 state 0x1 ref 1 00000100:00100000:1.0:1789760778.087133:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716322645824 time 716347423929 state 0x0 ref 1 00000100:00100000:1.0:1789760778.087148:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.087351:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71131136, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ec8 00010000:00010000:1.0:1789760778.087362:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.087384:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.087389:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.087395:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.087414:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.094615:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984674 is committed 00002000:00010000:1.0:1789760778.095293:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71131136 -> 71135232 00002000:00010000:1.0:1789760778.095300:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138952 -> 138960 00010000:00010000:1.0:1789760778.095313:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095325:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095334:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095341:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.095346:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095355:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095379:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.095386:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71131136->71135231] (req 71131136->71135231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.095488:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565452928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8339us (21271us total) trans 4294984674 rc 0/0 00000100:00100000:1.0:1789760778.095498:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17377 00000100:00100000:1.0:1789760778.095507:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716322645824 time 716347423929 state 0x2 ref 0 00000100:00100000:0.0:1789760778.102384:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.102500:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453056 00000100:00100000:2.0:1789760778.102510:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453056 00000100:00100000:2.0:1789760778.102633:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716322645824 time 716347423929 state 0x0 ref 1 00000100:00100000:2.0:1789760778.102650:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716347684345 time 716347423929 state 0x1 ref 1 00000100:00100000:2.0:1789760778.102789:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716347684345 time 716363079823 state 0x0 ref 1 00000100:00100000:2.0:1789760778.102803:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.102848:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71135232, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ed0 00010000:00010000:2.0:1789760778.102858:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.102873:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.102877:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.102884:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.102899:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.109002:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984675 is committed 00002000:00010000:3.0:1789760778.109177:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71135232 -> 71139328 00002000:00010000:3.0:1789760778.109183:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138960 -> 138968 00010000:00010000:3.0:1789760778.109195:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109208:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109216:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109223:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.109228:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109237:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109255:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.109262:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674d9f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71135232->71139327] (req 71135232->71139327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.109410:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6605us (7033us total) trans 4294984675 rc 0/0 00000100:00100000:3.0:1789760778.109425:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17378 00000100:00100000:3.0:1789760778.109435:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716347684345 time 716363079823 state 0x2 ref 0 00000100:00100000:1.0:1789760778.115277:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.115867:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453184 00000100:00100000:0.0:1789760778.115877:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453184 00000100:00100000:0.0:1789760778.115936:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716347684345 time 716363079823 state 0x0 ref 1 00000100:00100000:0.0:1789760778.115952:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716363340239 time 716363079823 state 0x1 ref 1 00000100:00100000:0.0:1789760778.115983:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716363340239 time 716376275681 state 0x0 ref 1 00000100:00100000:0.0:1789760778.115997:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.116042:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71139328, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ed8 00010000:00010000:0.0:1789760778.116052:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.116068:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.116073:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.116079:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.116214:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.123181:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984676 is committed 00002000:00010000:0.0:1789760778.123300:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71139328 -> 71143424 00002000:00010000:0.0:1789760778.123306:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138968 -> 138976 00010000:00010000:0.0:1789760778.123320:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123333:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123342:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123348:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.123353:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123361:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123379:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.123464:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674d9f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71139328->71143423] (req 71139328->71143423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.123628:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7628us (8355us total) trans 4294984676 rc 0/0 00000100:00100000:0.0:1789760778.123640:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17379 00000100:00100000:0.0:1789760778.123649:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716363340239 time 716376275681 state 0x2 ref 0 00000100:00100000:2.0:1789760778.130052:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.130323:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453312 00000100:00100000:1.0:1789760778.130334:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453312 00000100:00100000:1.0:1789760778.130391:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716363340239 time 716376275681 state 0x0 ref 1 00000100:00100000:1.0:1789760778.130407:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716376536097 time 716376275681 state 0x1 ref 1 00000100:00100000:1.0:1789760778.130441:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716376536097 time 716390732387 state 0x0 ref 1 00000100:00100000:1.0:1789760778.130454:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565453312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.130500:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71143424, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ee0 00010000:00010000:1.0:1789760778.130509:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.130530:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.130535:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.130541:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.130555:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.139224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984677 is committed 00002000:00010000:1.0:1789760778.139331:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71143424 -> 71147520 00002000:00010000:1.0:1789760778.139337:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138976 -> 138984 00010000:00010000:1.0:1789760778.139351:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139363:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139373:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139390:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.139396:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139406:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139432:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.139440:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674d9ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71143424->71147519] (req 71143424->71147519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.139533:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565453312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9078us (9488us total) trans 4294984677 rc 0/0 00000100:00100000:1.0:1789760778.139541:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17380 00000100:00100000:1.0:1789760778.139548:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716376536097 time 716390732387 state 0x2 ref 0 00000100:00100000:2.0:1789760778.144126:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.144210:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453440 00000100:00100000:3.0:1789760778.144222:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453440 00000100:00100000:3.0:1789760778.144285:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716376536097 time 716390732387 state 0x0 ref 1 00000100:00100000:3.0:1789760778.144311:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716390992803 time 716390732387 state 0x1 ref 1 00000100:00100000:3.0:1789760778.144342:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716390992803 time 716404634343 state 0x0 ref 1 00000100:00100000:3.0:1789760778.144355:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565453440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.144402:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71147520, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ee8 00010000:00010000:3.0:1789760778.144411:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.144426:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.144430:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.144435:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.144449:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.151684:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984678 is committed 00002000:00010000:3.0:1789760778.151992:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71147520 -> 71151616 00002000:00010000:3.0:1789760778.151998:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138984 -> 138992 00010000:00010000:3.0:1789760778.152012:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152025:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152035:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152042:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.152048:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152057:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152078:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.152086:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71147520->71151615] (req 71147520->71151615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.152182:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565453440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7824us (8061us total) trans 4294984678 rc 0/0 00000100:00100000:3.0:1789760778.152192:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17381 00000100:00100000:3.0:1789760778.152202:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716390992803 time 716404634343 state 0x2 ref 0 00000100:00100000:2.0:1789760778.160956:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.161193:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453568 00000100:00100000:0.0:1789760778.161203:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453568 00000100:00100000:0.0:1789760778.161261:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716390992803 time 716404634343 state 0x0 ref 1 00000100:00100000:0.0:1789760778.161275:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716404894759 time 716404634343 state 0x1 ref 1 00000100:00100000:0.0:1789760778.161309:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716404894759 time 716421601525 state 0x0 ref 1 00000100:00100000:0.0:1789760778.161323:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.161370:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71151616, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ef0 00010000:00010000:0.0:1789760778.161380:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.161396:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.161400:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.161407:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.161419:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.168671:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984679 is committed 00002000:00010000:0.0:1789760778.168857:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71151616 -> 71155712 00002000:00010000:0.0:1789760778.168863:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 138992 -> 139000 00010000:00010000:0.0:1789760778.168876:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.168888:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.168974:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.168982:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.168986:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.168995:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.169016:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.169023:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71151616->71155711] (req 71151616->71155711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.169114:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7789us (8165us total) trans 4294984679 rc 0/0 00000100:00100000:0.0:1789760778.169125:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17382 00000100:00100000:0.0:1789760778.169135:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716404894759 time 716421601525 state 0x2 ref 0 00000100:00100000:2.0:1789760778.173144:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.173776:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453696 00000100:00100000:1.0:1789760778.173786:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453696 00000100:00100000:1.0:1789760778.173840:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716404894759 time 716421601525 state 0x0 ref 1 00000100:00100000:1.0:1789760778.173856:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716421861941 time 716421601525 state 0x1 ref 1 00000100:00100000:1.0:1789760778.173884:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716421861941 time 716434175845 state 0x0 ref 1 00000100:00100000:1.0:1789760778.173896:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.173942:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71155712, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ef8 00010000:00010000:1.0:1789760778.173952:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.173966:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.173972:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.173977:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.173991:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.181297:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984680 is committed 00002000:00010000:1.0:1789760778.181595:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71155712 -> 71159808 00002000:00010000:1.0:1789760778.181600:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139000 -> 139008 00010000:00010000:1.0:1789760778.181613:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181626:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181634:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181642:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.181647:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181656:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181677:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.181690:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71155712->71159807] (req 71155712->71159807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.182052:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8153us (8912us total) trans 4294984680 rc 0/0 00000100:00100000:1.0:1789760778.182063:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17383 00000100:00100000:1.0:1789760778.182072:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716421861941 time 716434175845 state 0x2 ref 0 00000100:00100000:2.0:1789760778.186545:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.187251:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453824 00000100:00100000:3.0:1789760778.187262:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453824 00000100:00100000:3.0:1789760778.187317:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716421861941 time 716434175845 state 0x0 ref 1 00000100:00100000:3.0:1789760778.187333:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716434436261 time 716434175845 state 0x1 ref 1 00000100:00100000:3.0:1789760778.187401:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716434436261 time 716447692739 state 0x0 ref 1 00000100:00100000:3.0:1789760778.187415:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.187459:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71159808, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f00 00010000:00010000:3.0:1789760778.187470:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.187486:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.187491:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.187498:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.187513:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.195495:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984681 is committed 00002000:00010000:3.0:1789760778.195625:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71159808 -> 71163904 00002000:00010000:3.0:1789760778.195630:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139008 -> 139016 00010000:00010000:3.0:1789760778.195643:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195661:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195670:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195678:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.195683:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195692:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195979:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.195990:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71159808->71163903] (req 71159808->71163903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.196088:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565453824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8671us (9548us total) trans 4294984681 rc 0/0 00000100:00100000:3.0:1789760778.196098:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17384 00000100:00100000:3.0:1789760778.196107:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716434436261 time 716447692739 state 0x2 ref 0 00000100:00100000:2.0:1789760778.200663:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.201653:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565453952 00000100:00100000:0.0:1789760778.201998:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565453952 00000100:00100000:0.0:1789760778.202071:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716434436261 time 716447692739 state 0x0 ref 1 00000100:00100000:0.0:1789760778.202150:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716447953155 time 716447692739 state 0x1 ref 1 00000100:00100000:0.0:1789760778.202188:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716447953155 time 716462479855 state 0x0 ref 1 00000100:00100000:0.0:1789760778.202201:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.202250:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71163904, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f08 00010000:00010000:0.0:1789760778.202260:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.202274:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.202279:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.202284:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.202299:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.208317:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984682 is committed 00002000:00010000:0.0:1789760778.208502:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71163904 -> 71168000 00002000:00010000:0.0:1789760778.208507:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139016 -> 139024 00010000:00010000:0.0:1789760778.208519:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208531:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208541:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208549:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.208555:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208567:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208591:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.208600:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674da22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71163904->71167999] (req 71163904->71167999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.209086:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565453952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6881us (8426us total) trans 4294984682 rc 0/0 00000100:00100000:0.0:1789760778.209097:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17385 00000100:00100000:0.0:1789760778.209106:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716447953155 time 716462479855 state 0x2 ref 0 00000100:00100000:2.0:1789760778.215570:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.219279:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454080 00000100:00100000:1.0:1789760778.219293:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454080 00000100:00100000:1.0:1789760778.219357:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716447953155 time 716462479855 state 0x0 ref 1 00000100:00100000:1.0:1789760778.219372:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716462740271 time 716462479855 state 0x1 ref 1 00000100:00100000:1.0:1789760778.219407:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716462740271 time 716479698760 state 0x0 ref 1 00000100:00100000:1.0:1789760778.219419:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.219464:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71168000, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f10 00010000:00010000:1.0:1789760778.219473:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.219489:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.219493:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.219499:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.219520:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.224824:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984683 is committed 00002000:00010000:1.0:1789760778.225183:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71168000 -> 71172096 00002000:00010000:1.0:1789760778.225187:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139024 -> 139032 00010000:00010000:1.0:1789760778.225197:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225211:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225217:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225221:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.225225:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225231:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225245:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.225249:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71168000->71172095] (req 71168000->71172095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.225329:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5908us (9765us total) trans 4294984683 rc 0/0 00000100:00100000:1.0:1789760778.225340:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17386 00000100:00100000:1.0:1789760778.225349:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716462740271 time 716479698760 state 0x2 ref 0 00000100:00100000:2.0:1789760778.233271:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.233366:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454208 00000100:00100000:3.0:1789760778.233377:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454208 00000100:00100000:3.0:1789760778.233431:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716462740271 time 716479698760 state 0x0 ref 1 00000100:00100000:3.0:1789760778.233446:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716479959176 time 716479698760 state 0x1 ref 1 00000100:00100000:3.0:1789760778.233479:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716479959176 time 716493771655 state 0x0 ref 1 00000100:00100000:3.0:1789760778.233491:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.233538:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71172096, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f18 00010000:00010000:3.0:1789760778.233548:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.233564:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.233569:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.233576:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.233589:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.242221:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984684 is committed 00002000:00010000:2.0:1789760778.242336:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71172096 -> 71176192 00002000:00010000:2.0:1789760778.242341:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139032 -> 139040 00010000:00010000:2.0:1789760778.242354:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242367:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242376:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242409:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.242414:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242423:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242441:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.242452:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674da30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71172096->71176191] (req 71172096->71176191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.243154:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9658us (9887us total) trans 4294984684 rc 0/0 00000100:00100000:2.0:1789760778.243166:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17387 00000100:00100000:2.0:1789760778.243176:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716479959176 time 716493771655 state 0x2 ref 0 00000100:00100000:2.0:1789760778.246971:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.247390:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454336 00000100:00100000:0.0:1789760778.247399:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454336 00000100:00100000:0.0:1789760778.247457:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716479959176 time 716493771655 state 0x0 ref 1 00000100:00100000:0.0:1789760778.247474:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716494032071 time 716493771655 state 0x1 ref 1 00000100:00100000:0.0:1789760778.247549:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716494032071 time 716507840046 state 0x0 ref 1 00000100:00100000:0.0:1789760778.247565:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.247613:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71176192, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f20 00010000:00010000:0.0:1789760778.247624:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.247640:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.247644:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.247655:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.247669:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.254256:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984685 is committed 00002000:00010000:0.0:1789760778.254369:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71176192 -> 71180288 00002000:00010000:0.0:1789760778.254375:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139040 -> 139048 00010000:00010000:0.0:1789760778.254388:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254405:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254414:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254421:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.254426:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254436:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254455:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.254463:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71176192->71180287] (req 71176192->71180287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.254556:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6990us (7590us total) trans 4294984685 rc 0/0 00000100:00100000:0.0:1789760778.254567:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17388 00000100:00100000:0.0:1789760778.254576:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716494032071 time 716507840046 state 0x2 ref 0 00000100:00100000:0.0:1789760778.258615:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.258800:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454464 00000100:00100000:1.0:1789760778.258810:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454464 00000100:00100000:1.0:1789760778.258874:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716494032071 time 716507840046 state 0x0 ref 1 00000100:00100000:1.0:1789760778.258890:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716508100462 time 716507840046 state 0x1 ref 1 00000100:00100000:1.0:1789760778.258915:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716508100462 time 716519207083 state 0x0 ref 1 00000100:00100000:1.0:1789760778.258927:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.258978:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71180288, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f28 00010000:00010000:1.0:1789760778.258989:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.259006:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.259011:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.259018:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.259032:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.265278:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984686 is committed 00002000:00010000:1.0:1789760778.265937:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71180288 -> 71184384 00002000:00010000:1.0:1789760778.265943:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139048 -> 139056 00010000:00010000:1.0:1789760778.265956:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.265968:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.265977:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.265984:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.265989:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.265999:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.266025:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.266033:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71180288->71184383] (req 71180288->71184383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.266146:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7217us (7602us total) trans 4294984686 rc 0/0 00000100:00100000:1.0:1789760778.266156:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17389 00000100:00100000:1.0:1789760778.266165:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716508100462 time 716519207083 state 0x2 ref 0 00000100:00100000:2.0:1789760778.277372:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.277767:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454592 00000100:00100000:0.0:1789760778.277776:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454592 00000100:00100000:0.0:1789760778.277836:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716508100462 time 716519207083 state 0x0 ref 1 00000100:00100000:0.0:1789760778.277906:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716519467499 time 716519207083 state 0x1 ref 1 00000100:00100000:0.0:1789760778.277999:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716519467499 time 716538288734 state 0x0 ref 1 00000100:00100000:0.0:1789760778.278016:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.278071:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71184384, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f30 00010000:00010000:0.0:1789760778.278083:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.278099:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.278104:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.278112:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.278124:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.282516:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984687 is committed 00002000:00010000:2.0:1789760778.282689:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71184384 -> 71188480 00002000:00010000:2.0:1789760778.282694:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139056 -> 139064 00010000:00010000:2.0:1789760778.282810:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.282823:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.282832:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.282840:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.283524:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.283544:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.283564:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.283572:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674da45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71184384->71188479] (req 71184384->71188479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.283843:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5827us (6475us total) trans 4294984687 rc 0/0 00000100:00100000:2.0:1789760778.283854:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17390 00000100:00100000:2.0:1789760778.283863:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716519467499 time 716538288734 state 0x2 ref 0 00000100:00100000:2.0:1789760778.290839:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.290995:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454720 00000100:00100000:0.0:1789760778.291005:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454720 00000100:00100000:0.0:1789760778.291062:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716519467499 time 716538288734 state 0x0 ref 1 00000100:00100000:0.0:1789760778.291078:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716538549150 time 716538288734 state 0x1 ref 1 00000100:00100000:0.0:1789760778.291122:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716538549150 time 716551414124 state 0x0 ref 1 00000100:00100000:0.0:1789760778.291134:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.291195:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71188480, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f38 00010000:00010000:0.0:1789760778.291205:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.291220:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.291225:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.291231:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.291245:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.301301:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984688 is committed 00002000:00010000:0.0:1789760778.301819:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71188480 -> 71192576 00002000:00010000:0.0:1789760778.301825:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139064 -> 139072 00010000:00010000:0.0:1789760778.301839:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301852:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301861:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301873:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.301878:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301887:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301906:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.301913:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71188480->71192575] (req 71188480->71192575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.302018:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565454720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10880us (11185us total) trans 4294984688 rc 0/0 00000100:00100000:0.0:1789760778.302029:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17391 00000100:00100000:0.0:1789760778.302039:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716538549150 time 716551414124 state 0x2 ref 0 00000100:00100000:0.0:1789760778.307057:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.307529:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454848 00000100:00100000:1.0:1789760778.307539:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454848 00000100:00100000:1.0:1789760778.307595:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716538549150 time 716551414124 state 0x0 ref 1 00000100:00100000:1.0:1789760778.307609:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716551674540 time 716551414124 state 0x1 ref 1 00000100:00100000:1.0:1789760778.307645:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716551674540 time 716567936261 state 0x0 ref 1 00000100:00100000:1.0:1789760778.307657:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565454848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.307750:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71192576, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f40 00010000:00010000:1.0:1789760778.307761:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.307779:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.307785:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.307791:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.307807:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.314017:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984689 is committed 00002000:00010000:1.0:1789760778.315799:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71192576 -> 71196672 00002000:00010000:1.0:1789760778.315809:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139072 -> 139080 00010000:00010000:1.0:1789760778.315825:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315909:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315918:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315926:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.315930:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315939:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315960:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.315968:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71192576->71196671] (req 71192576->71196671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.316253:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565454848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8593us (9200us total) trans 4294984689 rc 0/0 00000100:00100000:1.0:1789760778.316264:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17392 00000100:00100000:1.0:1789760778.316275:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716551674540 time 716567936261 state 0x2 ref 0 00000100:00100000:2.0:1789760778.320909:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.322211:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565454976 00000100:00100000:0.0:1789760778.322225:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565454976 00000100:00100000:0.0:1789760778.322296:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716551674540 time 716567936261 state 0x0 ref 1 00000100:00100000:0.0:1789760778.322311:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716568196677 time 716567936261 state 0x1 ref 1 00000100:00100000:0.0:1789760778.322373:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716568196677 time 716582664517 state 0x0 ref 1 00000100:00100000:0.0:1789760778.322386:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.322430:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71196672, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f48 00010000:00010000:0.0:1789760778.322440:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.322456:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.322460:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.322467:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.322481:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.331758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984690 is committed 00002000:00010000:2.0:1789760778.331988:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71196672 -> 71200768 00002000:00010000:2.0:1789760778.331994:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139080 -> 139088 00010000:00010000:2.0:1789760778.332008:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332021:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332035:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332042:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.332047:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332056:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332130:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.332140:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674da5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71196672->71200767] (req 71196672->71200767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.332268:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565454976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9881us (11568us total) trans 4294984690 rc 0/0 00000100:00100000:2.0:1789760778.332279:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17393 00000100:00100000:2.0:1789760778.332288:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716568196677 time 716582664517 state 0x2 ref 0 00000100:00100000:2.0:1789760778.341494:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.341836:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455104 00000100:00100000:0.0:1789760778.341846:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455104 00000100:00100000:0.0:1789760778.341970:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716568196677 time 716582664517 state 0x0 ref 1 00000100:00100000:0.0:1789760778.341987:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716582924933 time 716582664517 state 0x1 ref 1 00000100:00100000:0.0:1789760778.342017:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716582924933 time 716602309431 state 0x0 ref 1 00000100:00100000:0.0:1789760778.342030:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565455104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.343184:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71200768, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f50 00010000:00010000:0.0:1789760778.343199:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.343215:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.343219:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.343226:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.343240:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.350490:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984691 is committed 00002000:00010000:2.0:1789760778.350614:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71200768 -> 71204864 00002000:00010000:2.0:1789760778.350619:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139088 -> 139096 00010000:00010000:2.0:1789760778.350633:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351785:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351795:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351802:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.351807:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351817:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351836:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.351843:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674da61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71200768->71204863] (req 71200768->71204863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.351960:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565455104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9927us (10471us total) trans 4294984691 rc 0/0 00000100:00100000:2.0:1789760778.351971:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17394 00000100:00100000:2.0:1789760778.351980:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716582924933 time 716602309431 state 0x2 ref 0 00000100:00100000:0.0:1789760778.357871:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.358083:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455232 00000100:00100000:1.0:1789760778.358093:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455232 00000100:00100000:1.0:1789760778.358142:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716582924933 time 716602309431 state 0x0 ref 1 00000100:00100000:1.0:1789760778.358157:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716602569847 time 716602309431 state 0x1 ref 1 00000100:00100000:1.0:1789760778.358190:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716602569847 time 716618481867 state 0x0 ref 1 00000100:00100000:1.0:1789760778.358201:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.358245:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71204864, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f58 00010000:00010000:1.0:1789760778.358254:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.358270:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.358275:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.358281:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.358295:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.363019:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984692 is committed 00002000:00010000:3.0:1789760778.363213:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71204864 -> 71208960 00002000:00010000:3.0:1789760778.363218:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139096 -> 139104 00010000:00010000:3.0:1789760778.363232:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363245:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363254:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363261:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.363265:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363274:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363294:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.363301:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674da68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71204864->71208959] (req 71204864->71208959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.363469:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5263us (5601us total) trans 4294984692 rc 0/0 00000100:00100000:3.0:1789760778.363480:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17395 00000100:00100000:3.0:1789760778.363490:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716602569847 time 716618481867 state 0x2 ref 0 00000100:00100000:0.0:1789760778.369382:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.369510:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455360 00000100:00100000:2.0:1789760778.369520:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455360 00000100:00100000:2.0:1789760778.369566:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716602569847 time 716618481867 state 0x0 ref 1 00000100:00100000:2.0:1789760778.369578:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716618742283 time 716618481867 state 0x1 ref 1 00000100:00100000:2.0:1789760778.369685:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716618742283 time 716629977201 state 0x0 ref 1 00000100:00100000:2.0:1789760778.369695:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565455360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.369765:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71208960, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f60 00010000:00010000:2.0:1789760778.369776:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.369791:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.369796:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.369803:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.369817:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.377806:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984693 is committed 00002000:00010000:2.0:1789760778.378779:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71208960 -> 71213056 00002000:00010000:2.0:1789760778.378789:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139104 -> 139112 00010000:00010000:2.0:1789760778.378804:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378817:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378833:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378841:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.378846:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378855:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378875:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.378883:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71208960->71213055] (req 71208960->71213055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.378983:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565455360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9283us (9605us total) trans 4294984693 rc 0/0 00000100:00100000:2.0:1789760778.378994:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17396 00000100:00100000:2.0:1789760778.379003:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716618742283 time 716629977201 state 0x2 ref 0 00000100:00100000:1.0:1789760778.384917:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.384999:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455488 00000100:00100000:2.0:1789760778.385009:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455488 00000100:00100000:2.0:1789760778.385061:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716618742283 time 716629977201 state 0x0 ref 1 00000100:00100000:2.0:1789760778.385077:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716630237617 time 716629977201 state 0x1 ref 1 00000100:00100000:2.0:1789760778.385109:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716630237617 time 716645400421 state 0x0 ref 1 00000100:00100000:2.0:1789760778.385122:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.385168:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71213056, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f68 00010000:00010000:2.0:1789760778.385177:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.385192:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.385197:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.385203:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.385216:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.389576:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984694 is committed 00002000:00010000:2.0:1789760778.389792:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71213056 -> 71217152 00002000:00010000:2.0:1789760778.389797:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139112 -> 139120 00010000:00010000:2.0:1789760778.389810:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389821:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389829:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389840:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.389845:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389853:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389872:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.389880:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71213056->71217151] (req 71213056->71217151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.390009:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4885us (5097us total) trans 4294984694 rc 0/0 00000100:00100000:2.0:1789760778.390019:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17397 00000100:00100000:2.0:1789760778.390028:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716630237617 time 716645400421 state 0x2 ref 0 00000100:00100000:0.0:1789760778.394477:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.394558:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455616 00000100:00100000:3.0:1789760778.394569:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455616 00000100:00100000:3.0:1789760778.394625:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716630237617 time 716645400421 state 0x0 ref 1 00000100:00100000:3.0:1789760778.394640:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716645660837 time 716645400421 state 0x1 ref 1 00000100:00100000:3.0:1789760778.394675:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716645660837 time 716654959757 state 0x0 ref 1 00000100:00100000:3.0:1789760778.394687:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.394871:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71217152, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f70 00010000:00010000:3.0:1789760778.394882:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.394898:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.394902:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.394908:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.394923:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.402049:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984695 is committed 00002000:00010000:3.0:1789760778.402361:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71217152 -> 71221248 00002000:00010000:3.0:1789760778.402597:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139120 -> 139128 00010000:00010000:3.0:1789760778.402613:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402626:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402641:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402649:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.402653:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402661:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402690:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.402698:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71217152->71221247] (req 71217152->71221247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.402833:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8142us (8360us total) trans 4294984695 rc 0/0 00000100:00100000:3.0:1789760778.402844:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17398 00000100:00100000:3.0:1789760778.402855:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716645660837 time 716654959757 state 0x2 ref 0 00000100:00100000:0.0:1789760778.407289:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.407641:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455744 00000100:00100000:2.0:1789760778.407652:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455744 00000100:00100000:2.0:1789760778.407855:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716645660837 time 716654959757 state 0x0 ref 1 00000100:00100000:2.0:1789760778.407872:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716655220173 time 716654959757 state 0x1 ref 1 00000100:00100000:2.0:1789760778.407937:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716655220173 time 716668228136 state 0x0 ref 1 00000100:00100000:2.0:1789760778.407964:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.408014:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71221248, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f78 00010000:00010000:2.0:1789760778.408024:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.408040:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.408045:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.408052:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.408066:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.413061:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984696 is committed 00002000:00010000:2.0:1789760778.413696:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71221248 -> 71225344 00002000:00010000:2.0:1789760778.413771:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139128 -> 139136 00010000:00010000:2.0:1789760778.413793:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413806:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413815:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413823:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.413828:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413837:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413854:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.413861:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71221248->71225343] (req 71221248->71225343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.413990:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6024us (6706us total) trans 4294984696 rc 0/0 00000100:00100000:2.0:1789760778.414002:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17399 00000100:00100000:2.0:1789760778.414013:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716655220173 time 716668228136 state 0x2 ref 0 00000100:00100000:1.0:1789760778.419333:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.419578:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565455872 00000100:00100000:2.0:1789760778.419587:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565455872 00000100:00100000:2.0:1789760778.419641:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716655220173 time 716668228136 state 0x0 ref 1 00000100:00100000:2.0:1789760778.419658:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716668488552 time 716668228136 state 0x1 ref 1 00000100:00100000:2.0:1789760778.419949:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716668488552 time 716680239505 state 0x0 ref 1 00000100:00100000:2.0:1789760778.419962:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.420005:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71225344, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f80 00010000:00010000:2.0:1789760778.420016:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.420032:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.420036:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.420043:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.420056:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.426661:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984697 is committed 00002000:00010000:2.0:1789760778.427916:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71225344 -> 71229440 00002000:00010000:2.0:1789760778.427923:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139136 -> 139144 00010000:00010000:2.0:1789760778.427936:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.427948:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.427958:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.427965:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.427971:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.427980:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.428000:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.428009:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71225344->71229439] (req 71225344->71229439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.428337:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565455872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8372us (9008us total) trans 4294984697 rc 0/0 00000100:00100000:2.0:1789760778.428349:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17400 00000100:00100000:2.0:1789760778.428360:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716668488552 time 716680239505 state 0x2 ref 0 00000100:00100000:0.0:1789760778.439032:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.439147:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456000 00000100:00100000:3.0:1789760778.439158:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456000 00000100:00100000:3.0:1789760778.439217:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716668488552 time 716680239505 state 0x0 ref 1 00000100:00100000:3.0:1789760778.439234:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716680499921 time 716680239505 state 0x1 ref 1 00000100:00100000:3.0:1789760778.439303:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716680499921 time 716699594436 state 0x0 ref 1 00000100:00100000:3.0:1789760778.439316:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565456000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.439362:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71229440, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f88 00010000:00010000:3.0:1789760778.439371:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.439386:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.439390:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.439396:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.439410:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.445163:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984698 is committed 00002000:00010000:3.0:1789760778.445288:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71229440 -> 71233536 00002000:00010000:3.0:1789760778.445294:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139144 -> 139152 00010000:00010000:3.0:1789760778.445308:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445322:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445331:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445343:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.445348:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445358:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445376:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.445383:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674da92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71229440->71233535] (req 71229440->71233535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.445466:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565456000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6147us (6439us total) trans 4294984698 rc 0/0 00000100:00100000:3.0:1789760778.445476:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17401 00000100:00100000:3.0:1789760778.445485:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716680499921 time 716699594436 state 0x2 ref 0 00010000:00010000:2.0:1789760778.446019:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760778.451623:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.452396:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456128 00000100:00100000:2.0:1789760778.452409:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456128 00000100:00100000:2.0:1789760778.452465:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716680499921 time 716699594436 state 0x0 ref 1 00000100:00100000:2.0:1789760778.452481:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716699854852 time 716699594436 state 0x1 ref 1 00000100:00100000:2.0:1789760778.452554:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716699854852 time 716712845929 state 0x0 ref 1 00000100:00100000:2.0:1789760778.452567:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.452616:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71233536, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f90 00010000:00010000:2.0:1789760778.452625:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.452644:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.452648:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.452654:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.452668:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.457738:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984699 is committed 00002000:00010000:2.0:1789760778.459776:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71233536 -> 71237632 00002000:00010000:2.0:1789760778.459785:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139152 -> 139160 00010000:00010000:2.0:1789760778.459805:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459817:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459826:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459833:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.459838:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459847:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459871:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.459879:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674da99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71233536->71237631] (req 71233536->71237631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.459975:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7406us (8357us total) trans 4294984699 rc 0/0 00000100:00100000:2.0:1789760778.459985:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17402 00000100:00100000:2.0:1789760778.459994:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716699854852 time 716712845929 state 0x2 ref 0 00000100:00100000:1.0:1789760778.468062:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.468333:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456256 00000100:00100000:2.0:1789760778.468342:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456256 00000100:00100000:2.0:1789760778.468396:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716699854852 time 716712845929 state 0x0 ref 1 00000100:00100000:2.0:1789760778.468413:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716713106345 time 716712845929 state 0x1 ref 1 00000100:00100000:2.0:1789760778.468457:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716713106345 time 716728748443 state 0x0 ref 1 00000100:00100000:2.0:1789760778.468471:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.468518:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71237632, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21f98 00010000:00010000:2.0:1789760778.468527:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.468543:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.468548:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.468555:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.468568:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.474306:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984700 is committed 00002000:00010000:2.0:1789760778.474492:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71237632 -> 71241728 00002000:00010000:2.0:1789760778.474497:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139160 -> 139168 00010000:00010000:2.0:1789760778.474511:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474523:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474531:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474540:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.474544:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474553:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474572:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.474586:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71237632->71241727] (req 71237632->71241727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.474833:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6360us (6776us total) trans 4294984700 rc 0/0 00000100:00100000:2.0:1789760778.474844:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17403 00000100:00100000:2.0:1789760778.474854:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716713106345 time 716728748443 state 0x2 ref 0 00000100:00100000:0.0:1789760778.480873:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.480958:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456384 00000100:00100000:3.0:1789760778.480968:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456384 00000100:00100000:3.0:1789760778.481023:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716713106345 time 716728748443 state 0x0 ref 1 00000100:00100000:3.0:1789760778.481038:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716729008859 time 716728748443 state 0x1 ref 1 00000100:00100000:3.0:1789760778.481364:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716729008859 time 716741654929 state 0x0 ref 1 00000100:00100000:3.0:1789760778.481383:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.481428:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71241728, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fa0 00010000:00010000:3.0:1789760778.481436:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.481452:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:3.0:1789760778.481456:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.481463:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.481476:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.489395:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984701 is committed 00002000:00010000:2.0:1789760778.489817:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71241728 -> 71245824 00002000:00010000:2.0:1789760778.489822:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139168 -> 139176 00010000:00010000:2.0:1789760778.489836:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489849:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489858:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489866:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.489872:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489879:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489904:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.489912:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674daa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71241728->71245823] (req 71241728->71245823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.490009:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8624us (9140us total) trans 4294984701 rc 0/0 00000100:00100000:2.0:1789760778.490019:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17404 00000100:00100000:2.0:1789760778.490029:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716729008859 time 716741654929 state 0x2 ref 0 00000100:00100000:0.0:1789760778.496802:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.496888:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456512 00000100:00100000:2.0:1789760778.496898:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456512 00000100:00100000:2.0:1789760778.496951:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716729008859 time 716741654929 state 0x0 ref 1 00000100:00100000:2.0:1789760778.496968:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716741915345 time 716741654929 state 0x1 ref 1 00000100:00100000:2.0:1789760778.496999:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716741915345 time 716757291554 state 0x0 ref 1 00000100:00100000:2.0:1789760778.497012:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.497059:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71245824, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fa8 00010000:00010000:2.0:1789760778.497069:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.497084:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.497090:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.497097:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.497112:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.504875:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984702 is committed 00002000:00010000:2.0:1789760778.506814:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71245824 -> 71249920 00002000:00010000:2.0:1789760778.506822:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139176 -> 139184 00010000:00010000:2.0:1789760778.506836:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506849:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506859:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506867:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.506872:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506881:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506901:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.506915:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71245824->71249919] (req 71245824->71249919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.507272:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565456512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10256us (10472us total) trans 4294984702 rc 0/0 00000100:00100000:2.0:1789760778.507294:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17405 00000100:00100000:2.0:1789760778.507305:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716741915345 time 716757291554 state 0x2 ref 0 00000100:00100000:1.0:1789760778.511383:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.511460:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456640 00000100:00100000:2.0:1789760778.511470:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456640 00000100:00100000:2.0:1789760778.511520:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716741915345 time 716757291554 state 0x0 ref 1 00000100:00100000:2.0:1789760778.511535:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716757551970 time 716757291554 state 0x1 ref 1 00000100:00100000:2.0:1789760778.511567:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716757551970 time 716771859683 state 0x0 ref 1 00000100:00100000:2.0:1789760778.511580:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.511637:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71249920, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fb0 00010000:00010000:2.0:1789760778.511646:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.511662:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.511666:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.511673:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.511691:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.518544:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984703 is committed 00002000:00010000:2.0:1789760778.520336:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71249920 -> 71254016 00002000:00010000:2.0:1789760778.520344:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139184 -> 139192 00010000:00010000:2.0:1789760778.520357:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520370:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520380:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520387:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.520392:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520401:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520421:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.520428:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71249920->71254015] (req 71249920->71254015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.520586:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9002us (9293us total) trans 4294984703 rc 0/0 00000100:00100000:2.0:1789760778.520596:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17406 00000100:00100000:2.0:1789760778.520605:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716757551970 time 716771859683 state 0x2 ref 0 00000100:00100000:0.0:1789760778.528370:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.528786:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456768 00000100:00100000:2.0:1789760778.528798:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456768 00000100:00100000:2.0:1789760778.528854:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716757551970 time 716771859683 state 0x0 ref 1 00000100:00100000:2.0:1789760778.528871:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716772120099 time 716771859683 state 0x1 ref 1 00000100:00100000:2.0:1789760778.528906:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716772120099 time 716789198350 state 0x0 ref 1 00000100:00100000:2.0:1789760778.528919:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.528972:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71254016, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fb8 00010000:00010000:2.0:1789760778.528981:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.528997:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.529001:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.529007:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.529021:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.534351:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984704 is committed 00002000:00010000:2.0:1789760778.534660:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71254016 -> 71258112 00002000:00010000:2.0:1789760778.534665:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139192 -> 139200 00010000:00010000:2.0:1789760778.534679:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534691:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534700:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534795:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.534801:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534809:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534829:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.534837:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dabc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71254016->71258111] (req 71254016->71258111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.534957:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6036us (6593us total) trans 4294984704 rc 0/0 00000100:00100000:2.0:1789760778.534968:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17407 00000100:00100000:2.0:1789760778.534978:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716772120099 time 716789198350 state 0x2 ref 0 00000100:00100000:0.0:1789760778.546286:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.546380:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565456896 00000100:00100000:2.0:1789760778.546389:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565456896 00000100:00100000:2.0:1789760778.546439:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716772120099 time 716789198350 state 0x0 ref 1 00000100:00100000:2.0:1789760778.546454:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716789458766 time 716789198350 state 0x1 ref 1 00000100:00100000:2.0:1789760778.546484:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716789458766 time 716806775698 state 0x0 ref 1 00000100:00100000:2.0:1789760778.546496:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.546540:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71258112, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fc0 00010000:00010000:2.0:1789760778.546549:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.546564:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.546568:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.546573:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.546587:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.551807:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984705 is committed 00002000:00010000:2.0:1789760778.552148:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71258112 -> 71262208 00002000:00010000:2.0:1789760778.552153:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139200 -> 139208 00010000:00010000:2.0:1789760778.552167:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552179:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552188:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552195:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.552199:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552209:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552227:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.552236:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71258112->71262207] (req 71258112->71262207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.552327:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565456896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5829us (6047us total) trans 4294984705 rc 0/0 00000100:00100000:2.0:1789760778.552337:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17408 00000100:00100000:2.0:1789760778.552346:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716789458766 time 716806775698 state 0x2 ref 0 00000100:00100000:1.0:1789760778.558620:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.558848:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457024 00000100:00100000:2.0:1789760778.558859:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457024 00000100:00100000:2.0:1789760778.558913:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716789458766 time 716806775698 state 0x0 ref 1 00000100:00100000:2.0:1789760778.558929:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716807036114 time 716806775698 state 0x1 ref 1 00000100:00100000:2.0:1789760778.558994:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716807036114 time 716819286308 state 0x0 ref 1 00000100:00100000:2.0:1789760778.559006:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.559052:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71262208, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fc8 00010000:00010000:2.0:1789760778.559061:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.559087:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.559091:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.559097:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.559110:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.562988:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984706 is committed 00002000:00010000:2.0:1789760778.563291:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71262208 -> 71266304 00002000:00010000:2.0:1789760778.563296:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139208 -> 139216 00010000:00010000:2.0:1789760778.563311:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563331:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563340:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563347:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.563351:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563361:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563380:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.563388:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674daca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71262208->71266303] (req 71262208->71266303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.563485:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4476us (4870us total) trans 4294984706 rc 0/0 00000100:00100000:2.0:1789760778.563496:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17409 00000100:00100000:2.0:1789760778.563506:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716807036114 time 716819286308 state 0x2 ref 0 00000100:00100000:0.0:1789760778.567748:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.567804:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457152 00000100:00100000:2.0:1789760778.567814:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457152 00000100:00100000:2.0:1789760778.567867:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716807036114 time 716819286308 state 0x0 ref 1 00000100:00100000:2.0:1789760778.567882:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716819546724 time 716819286308 state 0x1 ref 1 00000100:00100000:2.0:1789760778.567914:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716819546724 time 716828205935 state 0x0 ref 1 00000100:00100000:2.0:1789760778.567926:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.567971:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71266304, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fd0 00010000:00010000:2.0:1789760778.567980:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.567994:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.567998:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.568005:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.568019:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.573131:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984707 is committed 00002000:00010000:2.0:1789760778.573248:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71266304 -> 71270400 00002000:00010000:2.0:1789760778.573254:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139216 -> 139224 00010000:00010000:2.0:1789760778.573267:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573280:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573294:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573302:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.573306:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573315:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573334:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.573341:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71266304->71270399] (req 71266304->71270399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.573449:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5520us (5785us total) trans 4294984707 rc 0/0 00000100:00100000:2.0:1789760778.573459:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17410 00000100:00100000:2.0:1789760778.573478:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716819546724 time 716828205935 state 0x2 ref 0 00000100:00100000:0.0:1789760778.585555:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.586211:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457280 00000100:00100000:2.0:1789760778.586221:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457280 00000100:00100000:2.0:1789760778.586275:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716819546724 time 716828205935 state 0x0 ref 1 00000100:00100000:2.0:1789760778.586289:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716828466351 time 716828205935 state 0x1 ref 1 00000100:00100000:2.0:1789760778.586361:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716828466351 time 716846652455 state 0x0 ref 1 00000100:00100000:2.0:1789760778.586385:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565457280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.586443:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71270400, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fd8 00010000:00010000:2.0:1789760778.586453:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.586469:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.586472:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.586478:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.586491:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.591894:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984708 is committed 00002000:00010000:2.0:1789760778.592259:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71270400 -> 71274496 00002000:00010000:2.0:1789760778.592264:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139224 -> 139232 00010000:00010000:2.0:1789760778.592278:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592291:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592300:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592313:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.592317:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592327:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592346:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.592354:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71270400->71274495] (req 71270400->71274495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.592452:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565457280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6066us (6902us total) trans 4294984708 rc 0/0 00000100:00100000:2.0:1789760778.592463:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17411 00000100:00100000:2.0:1789760778.592472:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716828466351 time 716846652455 state 0x2 ref 0 00000100:00100000:1.0:1789760778.596480:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.597776:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457408 00000100:00100000:2.0:1789760778.597788:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457408 00000100:00100000:2.0:1789760778.597853:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716828466351 time 716846652455 state 0x0 ref 1 00000100:00100000:2.0:1789760778.597868:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716846912871 time 716846652455 state 0x1 ref 1 00000100:00100000:2.0:1789760778.597888:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716846912871 time 716858180347 state 0x0 ref 1 00000100:00100000:2.0:1789760778.597902:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565457408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.597950:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71274496, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fe0 00010000:00010000:2.0:1789760778.597959:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.597973:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.597977:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.597983:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.597997:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.604525:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984709 is committed 00002000:00010000:2.0:1789760778.604768:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71274496 -> 71278592 00002000:00010000:2.0:1789760778.604773:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139232 -> 139240 00010000:00010000:2.0:1789760778.604785:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604797:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604806:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604813:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.604819:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604895:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604917:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.604934:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dadf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71274496->71278591] (req 71274496->71278591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.605135:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565457408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7230us (8661us total) trans 4294984709 rc 0/0 00000100:00100000:2.0:1789760778.605146:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17412 00000100:00100000:2.0:1789760778.605155:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716846912871 time 716858180347 state 0x2 ref 0 00000100:00100000:0.0:1789760778.613619:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.613750:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457536 00000100:00100000:2.0:1789760778.613760:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457536 00000100:00100000:2.0:1789760778.613812:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716846912871 time 716858180347 state 0x0 ref 1 00000100:00100000:2.0:1789760778.613828:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716858440763 time 716858180347 state 0x1 ref 1 00000100:00100000:2.0:1789760778.613849:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716858440763 time 716874141445 state 0x0 ref 1 00000100:00100000:2.0:1789760778.613862:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.613909:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71278592, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21fe8 00010000:00010000:2.0:1789760778.613919:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.613935:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.613939:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.613945:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.613959:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.617941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984710 is committed 00002000:00010000:1.0:1789760778.618607:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71278592 -> 71282688 00002000:00010000:1.0:1789760778.618613:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139240 -> 139248 00010000:00010000:1.0:1789760778.618627:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618639:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618647:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618655:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.618660:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618674:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618694:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.618701:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674dae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71278592->71282687] (req 71278592->71282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.618946:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565457536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5080us (5330us total) trans 4294984710 rc 0/0 00000100:00100000:1.0:1789760778.618957:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17413 00000100:00100000:1.0:1789760778.618968:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716858440763 time 716874141445 state 0x2 ref 0 00000100:00100000:0.0:1789760778.634325:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.634425:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457664 00000100:00100000:2.0:1789760778.634434:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457664 00000100:00100000:2.0:1789760778.634491:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716858440763 time 716874141445 state 0x0 ref 1 00000100:00100000:2.0:1789760778.634507:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716874401861 time 716874141445 state 0x1 ref 1 00000100:00100000:2.0:1789760778.634537:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716874401861 time 716894829082 state 0x0 ref 1 00000100:00100000:2.0:1789760778.634549:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565457664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.634595:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71282688, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ff0 00010000:00010000:2.0:1789760778.634604:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.634620:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.634624:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.634631:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.634643:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.645010:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984711 is committed 00002000:00010000:2.0:1789760778.645344:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71282688 -> 71286784 00002000:00010000:2.0:1789760778.645350:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139248 -> 139256 00010000:00010000:2.0:1789760778.645363:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645375:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645385:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645392:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.645397:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645406:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645425:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.645438:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674daed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71282688->71286783] (req 71282688->71286783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.645633:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565457664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11079us (11312us total) trans 4294984711 rc 0/0 00000100:00100000:2.0:1789760778.645643:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17414 00000100:00100000:2.0:1789760778.645653:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716874401861 time 716894829082 state 0x2 ref 0 00000100:00100000:1.0:1789760778.653058:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.653220:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457792 00000100:00100000:2.0:1789760778.653229:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457792 00000100:00100000:2.0:1789760778.653343:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716874401861 time 716894829082 state 0x0 ref 1 00000100:00100000:2.0:1789760778.653357:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716895089498 time 716894829082 state 0x1 ref 1 00000100:00100000:2.0:1789760778.653416:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716895089498 time 716913708090 state 0x0 ref 1 00000100:00100000:2.0:1789760778.653427:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565457792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.653481:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71286784, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x21ff8 00010000:00010000:2.0:1789760778.653490:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.653504:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.653509:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.653515:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.653534:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.658914:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984712 is committed 00002000:00010000:2.0:1789760778.659062:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71286784 -> 71290880 00002000:00010000:2.0:1789760778.659067:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139256 -> 139264 00010000:00010000:2.0:1789760778.659139:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659151:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659161:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659168:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.659173:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659183:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659204:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.659212:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674daf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71286784->71290879] (req 71286784->71290879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.659354:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565457792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5924us (6300us total) trans 4294984712 rc 0/0 00000100:00100000:2.0:1789760778.659365:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17415 00000100:00100000:2.0:1789760778.659375:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716895089498 time 716913708090 state 0x2 ref 0 00000100:00100000:0.0:1789760778.663837:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.664004:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565457920 00000100:00100000:1.0:1789760778.664015:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565457920 00000100:00100000:1.0:1789760778.664069:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716895089498 time 716913708090 state 0x0 ref 1 00000100:00100000:1.0:1789760778.664095:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716913968506 time 716913708090 state 0x1 ref 1 00000100:00100000:1.0:1789760778.664125:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716913968506 time 716924416409 state 0x0 ref 1 00000100:00100000:1.0:1789760778.664137:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565457920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.664181:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71290880, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22000 00010000:00010000:1.0:1789760778.664190:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.664206:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1789760778.664211:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.664217:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.664230:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.668952:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984713 is committed 00002000:00010000:2.0:1789760778.669256:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71290880 -> 71294976 00002000:00010000:2.0:1789760778.669262:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139264 -> 139272 00010000:00010000:2.0:1789760778.669276:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669288:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669296:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669303:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.669308:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669317:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669336:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.669348:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dafb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71290880->71294975] (req 71290880->71294975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.669438:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565457920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5297us (5604us total) trans 4294984713 rc 0/0 00000100:00100000:2.0:1789760778.669448:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17416 00000100:00100000:2.0:1789760778.669468:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716913968506 time 716924416409 state 0x2 ref 0 00000100:00100000:1.0:1789760778.675374:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.676320:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458048 00000100:00100000:2.0:1789760778.676332:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458048 00000100:00100000:2.0:1789760778.676388:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716913968506 time 716924416409 state 0x0 ref 1 00000100:00100000:2.0:1789760778.676404:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716924676825 time 716924416409 state 0x1 ref 1 00000100:00100000:2.0:1789760778.676490:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716924676825 time 716936781822 state 0x0 ref 1 00000100:00100000:2.0:1789760778.676503:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.676550:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71294976, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22008 00010000:00010000:2.0:1789760778.676559:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.676575:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.676579:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.676585:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.676604:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.682391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984714 is committed 00002000:00010000:2.0:1789760778.682501:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71294976 -> 71299072 00002000:00010000:2.0:1789760778.682506:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139272 -> 139280 00010000:00010000:2.0:1789760778.682518:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682530:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682538:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682545:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.682549:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682557:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682576:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.682584:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71294976->71299071] (req 71294976->71299071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.682840:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6333us (7470us total) trans 4294984714 rc 0/0 00000100:00100000:2.0:1789760778.682852:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17417 00000100:00100000:2.0:1789760778.682862:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716924676825 time 716936781822 state 0x2 ref 0 00000100:00100000:1.0:1789760778.691079:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.693326:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458176 00000100:00100000:2.0:1789760778.693341:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458176 00000100:00100000:2.0:1789760778.693404:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716924676825 time 716936781822 state 0x0 ref 1 00000100:00100000:2.0:1789760778.693418:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716937042238 time 716936781822 state 0x1 ref 1 00000100:00100000:2.0:1789760778.693576:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716937042238 time 716953866057 state 0x0 ref 1 00000100:00100000:2.0:1789760778.693590:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.693647:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71299072, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22010 00010000:00010000:2.0:1789760778.693656:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.693671:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.693675:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.693681:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.693695:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.700292:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984715 is committed 00002000:00010000:2.0:1789760778.700488:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71299072 -> 71303168 00002000:00010000:2.0:1789760778.700493:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139280 -> 139288 00010000:00010000:2.0:1789760778.700506:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700518:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700526:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700532:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.700537:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700545:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700566:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.700574:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71299072->71303167] (req 71299072->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.700682:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7089us (9606us total) trans 4294984715 rc 0/0 00000100:00100000:2.0:1789760778.700693:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17418 00000100:00100000:2.0:1789760778.700745:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716937042238 time 716953866057 state 0x2 ref 0 00000100:00100000:1.0:1789760778.714265:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.714400:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458304 00000100:00100000:2.0:1789760778.714409:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458304 00000100:00100000:2.0:1789760778.714478:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716937042238 time 716953866057 state 0x0 ref 1 00000100:00100000:2.0:1789760778.714491:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716954126473 time 716953866057 state 0x1 ref 1 00000100:00100000:2.0:1789760778.714522:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716954126473 time 716974813963 state 0x0 ref 1 00000100:00100000:2.0:1789760778.714534:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.714581:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71303168, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22018 00010000:00010000:2.0:1789760778.714590:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.714615:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.714620:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.714626:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.714639:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.719025:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984716 is committed 00002000:00010000:2.0:1789760778.719172:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71303168 -> 71307264 00002000:00010000:2.0:1789760778.719177:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139288 -> 139296 00010000:00010000:2.0:1789760778.719190:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719202:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719211:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719218:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.719223:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719353:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719373:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.719381:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->71307263] (req 71303168->71307263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.719945:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5407us (5682us total) trans 4294984716 rc 0/0 00000100:00100000:2.0:1789760778.719955:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17419 00000100:00100000:2.0:1789760778.719966:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716954126473 time 716974813963 state 0x2 ref 0 00000100:00100000:1.0:1789760778.726310:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.726428:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458432 00000100:00100000:0.0:1789760778.726437:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458432 00000100:00100000:0.0:1789760778.726592:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716954126473 time 716974813963 state 0x0 ref 1 00000100:00100000:0.0:1789760778.726619:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716975074379 time 716974813963 state 0x1 ref 1 00000100:00100000:0.0:1789760778.726680:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716975074379 time 716986971343 state 0x0 ref 1 00000100:00100000:0.0:1789760778.726693:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.726771:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71307264, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22020 00010000:00010000:0.0:1789760778.726780:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.726796:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1789760778.726800:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.726807:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.726820:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.730552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984717 is committed 00002000:00010000:0.0:1789760778.730670:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71307264 -> 71311360 00002000:00010000:0.0:1789760778.730675:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139296 -> 139304 00010000:00010000:0.0:1789760778.730689:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730701:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730749:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730757:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.730761:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730770:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730790:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.730797:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71307264->71311359] (req 71307264->71311359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.730875:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4180us (4570us total) trans 4294984717 rc 0/0 00000100:00100000:0.0:1789760778.730886:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17420 00000100:00100000:0.0:1789760778.730895:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716975074379 time 716986971343 state 0x2 ref 0 00000100:00100000:1.0:1789760778.735182:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.735280:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458560 00000100:00100000:2.0:1789760778.735290:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458560 00000100:00100000:2.0:1789760778.735342:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716975074379 time 716986971343 state 0x0 ref 1 00000100:00100000:2.0:1789760778.735356:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716987231759 time 716986971343 state 0x1 ref 1 00000100:00100000:2.0:1789760778.735420:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716987231759 time 716995711247 state 0x0 ref 1 00000100:00100000:2.0:1789760778.735432:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.735478:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71311360, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22028 00010000:00010000:2.0:1789760778.735487:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.735501:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=716s v=(0 0) 00010000:00010000:2.0:1789760778.735505:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.735512:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.735526:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.739012:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984718 is committed 00002000:00010000:2.0:1789760778.739345:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71311360 -> 71315456 00002000:00010000:2.0:1789760778.739350:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139304 -> 139312 00010000:00010000:2.0:1789760778.739363:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739379:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739387:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739394:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.739398:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739406:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739424:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.739431:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71311360->71315455] (req 71311360->71315455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.739649:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4213us (4472us total) trans 4294984718 rc 0/0 00000100:00100000:2.0:1789760778.739660:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17421 00000100:00100000:2.0:1789760778.739670:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716987231759 time 716995711247 state 0x2 ref 0 00000100:00100000:1.0:1789760778.749499:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.749603:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458688 00000100:00100000:2.0:1789760778.749613:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458688 00000100:00100000:2.0:1789760778.749677:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716987231759 time 716995711247 state 0x0 ref 1 00000100:00100000:2.0:1789760778.749694:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716995971663 time 716995711247 state 0x1 ref 1 00000100:00100000:2.0:1789760778.749769:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716995971663 time 717010060482 state 0x0 ref 1 00000100:00100000:2.0:1789760778.749782:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565458688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.749841:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71315456, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22030 00010000:00010000:2.0:1789760778.749850:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.749866:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.749871:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.749877:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.749894:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.754149:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984719 is committed 00002000:00010000:1.0:1789760778.754439:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71315456 -> 71319552 00002000:00010000:1.0:1789760778.754445:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139312 -> 139320 00010000:00010000:1.0:1789760778.754579:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754593:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754802:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754811:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.754815:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754825:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754844:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.754853:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674db25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71315456->71319551] (req 71315456->71319551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.754974:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565458688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5190us (5479us total) trans 4294984719 rc 0/0 00000100:00100000:1.0:1789760778.754984:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17422 00000100:00100000:1.0:1789760778.754994:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716995971663 time 717010060482 state 0x2 ref 0 00000100:00100000:1.0:1789760778.760392:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.760488:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458816 00000100:00100000:0.0:1789760778.760499:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458816 00000100:00100000:0.0:1789760778.760556:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 716995971663 time 717010060482 state 0x0 ref 1 00000100:00100000:0.0:1789760778.760571:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717010320898 time 717010060482 state 0x1 ref 1 00000100:00100000:0.0:1789760778.760611:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717010320898 time 717020903007 state 0x0 ref 1 00000100:00100000:0.0:1789760778.760623:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.760675:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71319552, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22038 00010000:00010000:0.0:1789760778.760685:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.760700:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760778.760745:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.760751:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.760765:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.764874:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984720 is committed 00002000:00010000:2.0:1789760778.765383:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71319552 -> 71323648 00002000:00010000:2.0:1789760778.765389:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139320 -> 139328 00010000:00010000:2.0:1789760778.765403:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765416:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765429:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765437:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.765442:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765450:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765580:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.765588:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674db2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71319552->71323647] (req 71319552->71323647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.767005:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565458816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6372us (6611us total) trans 4294984720 rc 0/0 00000100:00100000:2.0:1789760778.767018:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17423 00000100:00100000:2.0:1789760778.767029:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717010320898 time 717020903007 state 0x2 ref 0 00000100:00100000:3.0:1789760778.771939:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.772120:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565458944 00000100:00100000:2.0:1789760778.772130:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565458944 00000100:00100000:2.0:1789760778.772184:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717010320898 time 717020903007 state 0x0 ref 1 00000100:00100000:2.0:1789760778.772200:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717021163423 time 717020903007 state 0x1 ref 1 00000100:00100000:2.0:1789760778.772232:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717021163423 time 717032524177 state 0x0 ref 1 00000100:00100000:2.0:1789760778.772244:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565458944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.772289:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71323648, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22040 00010000:00010000:2.0:1789760778.772298:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.772315:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.772319:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.772325:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.772339:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.775894:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984721 is committed 00002000:00010000:2.0:1789760778.776401:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71323648 -> 71327744 00002000:00010000:2.0:1789760778.776407:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139328 -> 139336 00010000:00010000:2.0:1789760778.776420:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776433:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776443:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776457:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.776462:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776470:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776490:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.776498:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71323648->71327743] (req 71323648->71327743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.776582:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565458944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4335us (4648us total) trans 4294984721 rc 0/0 00000100:00100000:2.0:1789760778.776904:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17424 00000100:00100000:2.0:1789760778.776916:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717021163423 time 717032524177 state 0x2 ref 0 00000100:00100000:3.0:1789760778.782478:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.782834:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459072 00000100:00100000:1.0:1789760778.782844:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459072 00000100:00100000:1.0:1789760778.782899:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717021163423 time 717032524177 state 0x0 ref 1 00000100:00100000:1.0:1789760778.782917:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717032784593 time 717032524177 state 0x1 ref 1 00000100:00100000:1.0:1789760778.782996:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717032784593 time 717043287404 state 0x0 ref 1 00000100:00100000:1.0:1789760778.783010:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565459072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.783058:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71327744, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22048 00010000:00010000:1.0:1789760778.783066:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.783082:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760778.783087:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.783094:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.783107:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.787443:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984722 is committed 00002000:00010000:1.0:1789760778.787866:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71327744 -> 71331840 00002000:00010000:1.0:1789760778.787872:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139336 -> 139344 00010000:00010000:1.0:1789760778.787884:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787896:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787905:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787913:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.787918:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787928:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787946:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.787954:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674db3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71327744->71331839] (req 71327744->71331839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.788048:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565459072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5036us (5576us total) trans 4294984722 rc 0/0 00000100:00100000:1.0:1789760778.788059:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17425 00000100:00100000:1.0:1789760778.788068:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717032784593 time 717043287404 state 0x2 ref 0 00000100:00100000:1.0:1789760778.792053:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.792162:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459200 00000100:00100000:2.0:1789760778.792171:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459200 00000100:00100000:2.0:1789760778.792218:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717032784593 time 717043287404 state 0x0 ref 1 00000100:00100000:2.0:1789760778.792241:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717043547820 time 717043287404 state 0x1 ref 1 00000100:00100000:2.0:1789760778.792271:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717043547820 time 717052563977 state 0x0 ref 1 00000100:00100000:2.0:1789760778.792286:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.792343:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71331840, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22050 00010000:00010000:2.0:1789760778.792353:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.792369:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.792373:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.792379:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.792393:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.797984:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984723 is committed 00002000:00010000:2.0:1789760778.798207:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71331840 -> 71335936 00002000:00010000:2.0:1789760778.798213:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139344 -> 139352 00010000:00010000:2.0:1789760778.798226:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798239:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798249:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798257:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.798263:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798272:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798292:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.798299:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71331840->71335935] (req 71331840->71335935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.798436:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6146us (6385us total) trans 4294984723 rc 0/0 00000100:00100000:2.0:1789760778.798446:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17426 00000100:00100000:2.0:1789760778.798455:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717043547820 time 717052563977 state 0x2 ref 0 00000100:00100000:3.0:1789760778.803016:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.807331:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459328 00000100:00100000:2.0:1789760778.807346:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459328 00000100:00100000:2.0:1789760778.807412:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717043547820 time 717052563977 state 0x0 ref 1 00000100:00100000:2.0:1789760778.807428:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717052824393 time 717052563977 state 0x1 ref 1 00000100:00100000:2.0:1789760778.807453:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717052824393 time 717067745284 state 0x0 ref 1 00000100:00100000:2.0:1789760778.807467:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565459328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.807514:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71335936, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22058 00010000:00010000:2.0:1789760778.807524:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.807539:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.807544:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.807550:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.807565:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760778.811552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984724 is committed 00002000:00010000:2.0:1789760778.811940:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71335936 -> 71340032 00002000:00010000:2.0:1789760778.811945:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139352 -> 139360 00010000:00010000:2.0:1789760778.811958:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.811971:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.811980:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.811988:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.811994:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.812002:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.812021:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.812029:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71335936->71340031] (req 71335936->71340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.812223:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565459328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4754us (9210us total) trans 4294984724 rc 0/0 00000100:00100000:2.0:1789760778.812234:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17427 00000100:00100000:2.0:1789760778.812242:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717052824393 time 717067745284 state 0x2 ref 0 00000100:00100000:3.0:1789760778.818052:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.818157:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459456 00000100:00100000:1.0:1789760778.818168:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459456 00000100:00100000:1.0:1789760778.818225:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717052824393 time 717067745284 state 0x0 ref 1 00000100:00100000:1.0:1789760778.818242:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717068005700 time 717067745284 state 0x1 ref 1 00000100:00100000:1.0:1789760778.818272:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717068005700 time 717078564621 state 0x0 ref 1 00000100:00100000:1.0:1789760778.818286:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565459456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.818338:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71340032, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22060 00010000:00010000:1.0:1789760778.818353:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.818372:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760778.818377:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.818383:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.818397:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.826574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984725 is committed 00002000:00010000:1.0:1789760778.827574:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71340032 -> 71344128 00002000:00010000:1.0:1789760778.827582:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139360 -> 139368 00010000:00010000:1.0:1789760778.827597:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827611:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827619:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827627:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.827632:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827641:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827661:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.827669:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674db4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71340032->71344127] (req 71340032->71344127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.827806:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565459456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9514us (10874us total) trans 4294984725 rc 0/0 00000100:00100000:1.0:1789760778.827819:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17428 00000100:00100000:1.0:1789760778.827836:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717068005700 time 717078564621 state 0x2 ref 0 00000100:00100000:1.0:1789760778.832752:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.833763:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459584 00000100:00100000:2.0:1789760778.833776:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459584 00000100:00100000:2.0:1789760778.833979:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717068005700 time 717078564621 state 0x0 ref 1 00000100:00100000:2.0:1789760778.833995:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717078825037 time 717078564621 state 0x1 ref 1 00000100:00100000:2.0:1789760778.834027:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717078825037 time 717094319597 state 0x0 ref 1 00000100:00100000:2.0:1789760778.834040:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.834086:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71344128, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22068 00010000:00010000:2.0:1789760778.834095:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.834110:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.834115:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.834121:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.834135:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.838342:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984726 is committed 00002000:00010000:0.0:1789760778.841766:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71344128 -> 71348224 00002000:00010000:0.0:1789760778.841776:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139368 -> 139376 00010000:00010000:0.0:1789760778.841788:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.841916:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.841926:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.841975:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.841980:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.841989:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.842009:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.842086:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674db56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71344128->71348223] (req 71344128->71348223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.842191:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8148us (9487us total) trans 4294984726 rc 0/0 00000100:00100000:0.0:1789760778.842202:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17429 00000100:00100000:0.0:1789760778.842214:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717078825037 time 717094319597 state 0x2 ref 0 00000100:00100000:3.0:1789760778.848801:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.848977:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459712 00000100:00100000:1.0:1789760778.848987:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459712 00000100:00100000:1.0:1789760778.849039:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717078825037 time 717094319597 state 0x0 ref 1 00000100:00100000:1.0:1789760778.849055:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717094580013 time 717094319597 state 0x1 ref 1 00000100:00100000:1.0:1789760778.849192:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717094580013 time 717109482196 state 0x0 ref 1 00000100:00100000:1.0:1789760778.849205:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565459712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.849255:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71348224, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22070 00010000:00010000:1.0:1789760778.849265:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.849281:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760778.849285:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.849292:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.849305:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.853083:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984727 is committed 00002000:00010000:1.0:1789760778.853203:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71348224 -> 71352320 00002000:00010000:1.0:1789760778.853209:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139376 -> 139384 00010000:00010000:1.0:1789760778.853221:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853233:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853240:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853247:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.853252:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853265:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853286:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.853294:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674db5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71348224->71352319] (req 71348224->71352319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.853382:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565459712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4174us (4586us total) trans 4294984727 rc 0/0 00000100:00100000:1.0:1789760778.853393:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17430 00000100:00100000:1.0:1789760778.853402:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717094580013 time 717109482196 state 0x2 ref 0 00000100:00100000:1.0:1789760778.857298:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.857568:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459840 00000100:00100000:2.0:1789760778.857578:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459840 00000100:00100000:2.0:1789760778.857631:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717094580013 time 717109482196 state 0x0 ref 1 00000100:00100000:2.0:1789760778.857647:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717109742612 time 717109482196 state 0x1 ref 1 00000100:00100000:2.0:1789760778.857858:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717109742612 time 717118148470 state 0x0 ref 1 00000100:00100000:2.0:1789760778.857872:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.857920:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71352320, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22078 00010000:00010000:2.0:1789760778.857930:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.857947:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.857951:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.857958:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.857971:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.864970:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984728 is committed 00002000:00010000:1.0:1789760778.867046:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71352320 -> 71356416 00002000:00010000:1.0:1789760778.867054:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139384 -> 139392 00010000:00010000:1.0:1789760778.867126:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867142:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867152:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867165:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.867170:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867180:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867200:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.867415:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674db64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71352320->71356415] (req 71352320->71356415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.867587:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565459840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9712us (10292us total) trans 4294984728 rc 0/0 00000100:00100000:1.0:1789760778.867598:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17431 00000100:00100000:1.0:1789760778.867607:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717109742612 time 717118148470 state 0x2 ref 0 00000100:00100000:2.0:1789760778.871952:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.872046:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565459968 00000100:00100000:0.0:1789760778.872056:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565459968 00000100:00100000:0.0:1789760778.872123:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717109742612 time 717118148470 state 0x0 ref 1 00000100:00100000:0.0:1789760778.872137:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717118408886 time 717118148470 state 0x1 ref 1 00000100:00100000:0.0:1789760778.872170:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717118408886 time 717132462086 state 0x0 ref 1 00000100:00100000:0.0:1789760778.872183:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565459968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.872233:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71356416, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22080 00010000:00010000:0.0:1789760778.872243:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.872259:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760778.872264:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.872271:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.872286:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.877889:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984729 is committed 00002000:00010000:0.0:1789760778.878058:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71356416 -> 71360512 00002000:00010000:0.0:1789760778.878063:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139392 -> 139400 00010000:00010000:0.0:1789760778.878086:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878104:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878114:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878120:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.878124:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878132:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878151:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.878158:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71356416->71360511] (req 71356416->71360511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.878252:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565459968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6066us (6304us total) trans 4294984729 rc 0/0 00000100:00100000:0.0:1789760778.878263:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17432 00000100:00100000:0.0:1789760778.878272:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717118408886 time 717132462086 state 0x2 ref 0 00000100:00100000:3.0:1789760778.885801:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760778.885994:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460096 00000100:00100000:1.0:1789760778.886004:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460096 00000100:00100000:1.0:1789760778.886058:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717118408886 time 717132462086 state 0x0 ref 1 00000100:00100000:1.0:1789760778.886077:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717132722502 time 717132462086 state 0x1 ref 1 00000100:00100000:1.0:1789760778.886107:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717132722502 time 717146399337 state 0x0 ref 1 00000100:00100000:1.0:1789760778.886122:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760778.886173:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71360512, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22088 00010000:00010000:1.0:1789760778.886183:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.886198:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760778.886202:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.886208:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.886222:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.891021:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984730 is committed 00002000:00010000:1.0:1789760778.891795:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71360512 -> 71364608 00002000:00010000:1.0:1789760778.891802:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139400 -> 139408 00010000:00010000:1.0:1789760778.891816:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891828:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891838:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891846:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.891867:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891876:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891896:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.891904:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674db72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71360512->71364607] (req 71360512->71364607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.892004:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5879us (6207us total) trans 4294984730 rc 0/0 00000100:00100000:1.0:1789760778.892015:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17433 00000100:00100000:1.0:1789760778.892025:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717132722502 time 717146399337 state 0x2 ref 0 00000100:00100000:1.0:1789760778.897153:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.897339:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460224 00000100:00100000:3.0:1789760778.897349:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460224 00000100:00100000:3.0:1789760778.897404:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717132722502 time 717146399337 state 0x0 ref 1 00000100:00100000:3.0:1789760778.897418:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717146659753 time 717146399337 state 0x1 ref 1 00000100:00100000:3.0:1789760778.897450:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717146659753 time 717157742396 state 0x0 ref 1 00000100:00100000:3.0:1789760778.897463:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.897512:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71364608, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22090 00010000:00010000:3.0:1789760778.897522:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.897538:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1789760778.897543:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.897550:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.897564:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.901590:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984731 is committed 00002000:00010000:3.0:1789760778.901807:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71364608 -> 71368704 00002000:00010000:3.0:1789760778.901813:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139408 -> 139416 00010000:00010000:3.0:1789760778.901827:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.901839:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.901990:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.902001:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.902006:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.902016:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.902036:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.902045:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71364608->71368703] (req 71364608->71368703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.902250:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4783us (5101us total) trans 4294984731 rc 0/0 00000100:00100000:3.0:1789760778.902260:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17434 00000100:00100000:3.0:1789760778.902270:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717146659753 time 717157742396 state 0x2 ref 0 00000100:00100000:2.0:1789760778.906441:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.906600:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460352 00000100:00100000:0.0:1789760778.906610:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460352 00000100:00100000:0.0:1789760778.906680:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717146659753 time 717157742396 state 0x0 ref 1 00000100:00100000:0.0:1789760778.906697:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717158002812 time 717157742396 state 0x1 ref 1 00000100:00100000:0.0:1789760778.906997:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717158002812 time 717167288153 state 0x0 ref 1 00000100:00100000:0.0:1789760778.907011:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.907060:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71368704, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x22098 00010000:00010000:0.0:1789760778.907184:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.907201:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760778.907206:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.907212:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.907227:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.913591:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984732 is committed 00002000:00010000:2.0:1789760778.913911:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71368704 -> 71372800 00002000:00010000:2.0:1789760778.913916:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139416 -> 139424 00010000:00010000:2.0:1789760778.913930:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.913943:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.913952:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.913959:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.913964:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.913973:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.913993:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.914006:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674db80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71368704->71372799] (req 71368704->71372799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.914243:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7229us (7807us total) trans 4294984732 rc 0/0 00000100:00100000:2.0:1789760778.914254:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17435 00000100:00100000:2.0:1789760778.914263:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717158002812 time 717167288153 state 0x2 ref 0 00000100:00100000:1.0:1789760778.918938:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.919170:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460480 00000100:00100000:3.0:1789760778.919181:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460480 00000100:00100000:3.0:1789760778.919236:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717158002812 time 717167288153 state 0x0 ref 1 00000100:00100000:3.0:1789760778.919252:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717167548569 time 717167288153 state 0x1 ref 1 00000100:00100000:3.0:1789760778.919274:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717167548569 time 717179565874 state 0x0 ref 1 00000100:00100000:3.0:1789760778.919287:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565460480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.919336:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71372800, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x220a0 00010000:00010000:3.0:1789760778.919345:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.919362:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1789760778.919366:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.919372:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.919387:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.924525:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984733 is committed 00002000:00010000:3.0:1789760778.924955:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71372800 -> 71376896 00002000:00010000:3.0:1789760778.924960:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139424 -> 139432 00010000:00010000:3.0:1789760778.924975:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.924988:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.924998:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.925011:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760778.925016:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.925025:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.925044:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.925052:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71372800->71376895] (req 71372800->71376895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760778.925266:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565460480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5976us (6332us total) trans 4294984733 rc 0/0 00000100:00100000:3.0:1789760778.925278:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17436 00000100:00100000:3.0:1789760778.925287:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717167548569 time 717179565874 state 0x2 ref 0 00000100:00100000:1.0:1789760778.929976:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.930159:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460608 00000100:00100000:3.0:1789760778.930169:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460608 00000100:00100000:3.0:1789760778.930222:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717167548569 time 717179565874 state 0x0 ref 1 00000100:00100000:3.0:1789760778.930237:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717179826290 time 717179565874 state 0x1 ref 1 00000100:00100000:3.0:1789760778.930300:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717179826290 time 717190591820 state 0x0 ref 1 00000100:00100000:3.0:1789760778.930317:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.930360:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71376896, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0x220a8 00010000:00010000:3.0:1789760778.930369:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.930384:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1789760778.930389:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.930394:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.930407:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.938051:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984734 is committed 00002000:00010000:2.0:1789760778.938265:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71376896 -> 71380992 00002000:00010000:2.0:1789760778.938270:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760778 -> 1789760779 00002000:00010000:2.0:1789760778.938272:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760778 -> 1789760779 00002000:00010000:2.0:1789760778.938274:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139432 -> 139440 00010000:00010000:2.0:1789760778.938287:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938299:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938309:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938316:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.938320:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938333:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938353:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.938361:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674db8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71376896->71380991] (req 71376896->71380991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.938488:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565460608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8168us (8517us total) trans 4294984734 rc 0/0 00000100:00100000:2.0:1789760778.938499:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17437 00000100:00100000:2.0:1789760778.938508:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717179826290 time 717190591820 state 0x2 ref 0 00000100:00100000:2.0:1789760778.942471:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.942580:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460736 00000100:00100000:0.0:1789760778.942590:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460736 00000100:00100000:0.0:1789760778.942647:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717179826290 time 717190591820 state 0x0 ref 1 00000100:00100000:0.0:1789760778.942824:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717190852236 time 717190591820 state 0x1 ref 1 00000100:00100000:0.0:1789760778.942894:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717190852236 time 717203185233 state 0x0 ref 1 00000100:00100000:0.0:1789760778.942908:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565460736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.942955:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71380992, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220b0 00010000:00010000:0.0:1789760778.942965:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.942980:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760778.942985:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.942990:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.943004:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760778.949537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984735 is committed 00002000:00010000:2.0:1789760778.949652:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71380992 -> 71385088 00002000:00010000:2.0:1789760778.949658:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139440 -> 139448 00010000:00010000:2.0:1789760778.949671:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949684:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949692:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949756:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.949761:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949771:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949789:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.949798:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674db95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71380992->71385087] (req 71380992->71385087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.949902:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565460736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6993us (7437us total) trans 4294984735 rc 0/0 00000100:00100000:2.0:1789760778.949912:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17438 00000100:00100000:2.0:1789760778.949921:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717190852236 time 717203185233 state 0x2 ref 0 00000100:00100000:1.0:1789760778.954998:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760778.955094:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460864 00000100:00100000:3.0:1789760778.955105:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460864 00000100:00100000:3.0:1789760778.955158:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717190852236 time 717203185233 state 0x0 ref 1 00000100:00100000:3.0:1789760778.955172:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717203445649 time 717203185233 state 0x1 ref 1 00000100:00100000:3.0:1789760778.955205:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717203445649 time 717215496953 state 0x0 ref 1 00000100:00100000:3.0:1789760778.955217:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565460864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760778.955276:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71385088, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220b8 00010000:00010000:3.0:1789760778.955286:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.955307:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1789760778.955316:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.955323:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.955337:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.959602:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984736 is committed 00002000:00010000:2.0:1789760778.960248:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71385088 -> 71389184 00002000:00010000:2.0:1789760778.960254:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139448 -> 139456 00010000:00010000:2.0:1789760778.960269:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960282:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960297:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960304:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.960309:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960318:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960335:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.960342:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674db9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71385088->71389183] (req 71385088->71389183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.960458:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565460864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5239us (5466us total) trans 4294984736 rc 0/0 00000100:00100000:2.0:1789760778.960468:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17439 00000100:00100000:2.0:1789760778.960477:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717203445649 time 717215496953 state 0x2 ref 0 00000100:00100000:1.0:1789760778.967193:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.967297:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565460992 00000100:00100000:2.0:1789760778.967307:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565460992 00000100:00100000:2.0:1789760778.967361:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717203445649 time 717215496953 state 0x0 ref 1 00000100:00100000:2.0:1789760778.967376:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717215757369 time 717215496953 state 0x1 ref 1 00000100:00100000:2.0:1789760778.967412:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717215757369 time 717227703874 state 0x0 ref 1 00000100:00100000:2.0:1789760778.967424:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565460992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.967472:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71389184, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220c0 00010000:00010000:2.0:1789760778.967481:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.967496:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.967501:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.967507:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.967530:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760778.973424:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984737 is committed 00002000:00010000:1.0:1789760778.973530:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71389184 -> 71393280 00002000:00010000:1.0:1789760778.973536:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139456 -> 139464 00010000:00010000:1.0:1789760778.973548:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973561:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973570:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973577:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760778.973582:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973802:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973826:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.973834:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71389184->71393279] (req 71389184->71393279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760778.973989:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565460992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6562us (6801us total) trans 4294984737 rc 0/0 00000100:00100000:1.0:1789760778.973999:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17440 00000100:00100000:1.0:1789760778.974010:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717215757369 time 717227703874 state 0x2 ref 0 00000100:00100000:1.0:1789760778.977556:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760778.977645:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461120 00000100:00100000:0.0:1789760778.977655:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461120 00000100:00100000:0.0:1789760778.977745:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717215757369 time 717227703874 state 0x0 ref 1 00000100:00100000:0.0:1789760778.977761:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717227964290 time 717227703874 state 0x1 ref 1 00000100:00100000:0.0:1789760778.977790:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717227964290 time 717238081338 state 0x0 ref 1 00000100:00100000:0.0:1789760778.977803:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760778.977853:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71393280, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220c8 00010000:00010000:0.0:1789760778.977863:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.977879:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760778.977884:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.977890:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.977903:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.982196:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984738 is committed 00002000:00010000:0.0:1789760778.983412:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71393280 -> 71397376 00002000:00010000:0.0:1789760778.983420:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139464 -> 139472 00010000:00010000:0.0:1789760778.983434:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983447:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983455:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983463:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760778.983468:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983481:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983499:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.983506:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71393280->71397375] (req 71393280->71397375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.983642:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5837us (6090us total) trans 4294984738 rc 0/0 00000100:00100000:0.0:1789760778.983651:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17441 00000100:00100000:0.0:1789760778.983661:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717227964290 time 717238081338 state 0x2 ref 0 00000100:00100000:3.0:1789760778.988583:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760778.991908:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461248 00000100:00100000:2.0:1789760778.991923:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461248 00000100:00100000:2.0:1789760778.991986:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717227964290 time 717238081338 state 0x0 ref 1 00000100:00100000:2.0:1789760778.992003:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717238341754 time 717238081338 state 0x1 ref 1 00000100:00100000:2.0:1789760778.992089:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717238341754 time 717252380081 state 0x0 ref 1 00000100:00100000:2.0:1789760778.992104:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565461248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760778.992155:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71397376, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220d0 00010000:00010000:2.0:1789760778.992164:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.992179:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760778.992183:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.992188:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.992202:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.997199:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984739 is committed 00002000:00010000:2.0:1789760778.997327:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71397376 -> 71401472 00002000:00010000:2.0:1789760778.997333:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139472 -> 139480 00010000:00010000:2.0:1789760778.997347:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997361:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997370:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997377:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760778.997382:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997397:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997416:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.997425:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674dbb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71397376->71401471] (req 71397376->71401471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.997526:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565461248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5421us (8947us total) trans 4294984739 rc 0/0 00000100:00100000:2.0:1789760778.997538:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17442 00000100:00100000:2.0:1789760778.997547:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717238341754 time 717252380081 state 0x2 ref 0 00000100:00100000:0.0:1789760779.000389:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.000622:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461376 00000100:00100000:1.0:1789760779.000631:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461376 00000100:00100000:1.0:1789760779.000692:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717238341754 time 717252380081 state 0x0 ref 1 00000100:00100000:1.0:1789760779.000933:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717252640497 time 717252380081 state 0x1 ref 1 00000100:00100000:1.0:1789760779.000998:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717252640497 time 717261289445 state 0x0 ref 1 00000100:00100000:1.0:1789760779.001013:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565461376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.001078:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71401472, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220d8 00010000:00010000:1.0:1789760779.001087:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.001102:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.001106:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.001112:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.001125:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.005488:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984740 is committed 00002000:00010000:1.0:1789760779.005607:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71401472 -> 71405568 00002000:00010000:1.0:1789760779.005612:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139480 -> 139488 00010000:00010000:1.0:1789760779.005629:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005656:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005667:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005674:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.005680:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005688:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005951:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.005962:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dbb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71401472->71405567] (req 71401472->71405567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.006144:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565461376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5129us (5757us total) trans 4294984740 rc 0/0 00000100:00100000:1.0:1789760779.006155:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17443 00000100:00100000:1.0:1789760779.006165:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717252640497 time 717261289445 state 0x2 ref 0 00000100:00100000:1.0:1789760779.011154:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.013119:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461504 00000100:00100000:0.0:1789760779.013134:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461504 00000100:00100000:0.0:1789760779.013299:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717252640497 time 717261289445 state 0x0 ref 1 00000100:00100000:0.0:1789760779.013318:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717261549861 time 717261289445 state 0x1 ref 1 00000100:00100000:0.0:1789760779.013412:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717261549861 time 717273703423 state 0x0 ref 1 00000100:00100000:0.0:1789760779.013427:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.013470:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71405568, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220e0 00010000:00010000:0.0:1789760779.013480:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.013496:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.013501:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.013507:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.013521:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.018046:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984741 is committed 00002000:00010000:0.0:1789760779.018601:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71405568 -> 71409664 00002000:00010000:0.0:1789760779.018609:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139488 -> 139496 00010000:00010000:0.0:1789760779.018627:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018644:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018655:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018904:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.018910:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018920:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018944:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.018952:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71405568->71409663] (req 71405568->71409663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.019182:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5751us (8147us total) trans 4294984741 rc 0/0 00000100:00100000:0.0:1789760779.019196:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17444 00000100:00100000:0.0:1789760779.019208:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717261549861 time 717273703423 state 0x2 ref 0 00000100:00100000:3.0:1789760779.025232:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.025357:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461632 00000100:00100000:2.0:1789760779.025371:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461632 00000100:00100000:2.0:1789760779.025449:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717261549861 time 717273703423 state 0x0 ref 1 00000100:00100000:2.0:1789760779.025517:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717273963839 time 717273703423 state 0x1 ref 1 00000100:00100000:2.0:1789760779.025555:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717273963839 time 717285846284 state 0x0 ref 1 00000100:00100000:2.0:1789760779.025569:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.025635:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71409664, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220e8 00010000:00010000:2.0:1789760779.025646:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.025665:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.025670:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.025678:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.025695:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.034010:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984742 is committed 00002000:00010000:2.0:1789760779.034220:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71409664 -> 71413760 00002000:00010000:2.0:1789760779.034227:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139496 -> 139504 00010000:00010000:2.0:1789760779.034245:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034256:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034263:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034268:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.034272:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034283:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034303:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.034307:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dbc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71409664->71413759] (req 71409664->71413759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.034440:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565461632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8866us (9217us total) trans 4294984742 rc 0/0 00000100:00100000:2.0:1789760779.034453:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17445 00000100:00100000:2.0:1789760779.034465:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717273963839 time 717285846284 state 0x2 ref 0 00000100:00100000:2.0:1789760779.037336:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.037483:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461760 00000100:00100000:1.0:1789760779.037497:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461760 00000100:00100000:1.0:1789760779.037568:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717273963839 time 717285846284 state 0x0 ref 1 00000100:00100000:1.0:1789760779.037587:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717286106700 time 717285846284 state 0x1 ref 1 00000100:00100000:1.0:1789760779.037648:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717286106700 time 717297938784 state 0x0 ref 1 00000100:00100000:1.0:1789760779.037663:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565461760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.037764:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71413760, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220f0 00010000:00010000:1.0:1789760779.037775:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.037794:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.037799:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.037806:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.037825:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.047619:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984743 is committed 00002000:00010000:2.0:1789760779.047948:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71413760 -> 71417856 00002000:00010000:2.0:1789760779.047955:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139504 -> 139512 00010000:00010000:2.0:1789760779.047976:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048122:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048136:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048151:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.048157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048168:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048193:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.048202:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674dbcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71413760->71417855] (req 71413760->71417855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.048377:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565461760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10710us (11047us total) trans 4294984743 rc 0/0 00000100:00100000:2.0:1789760779.048392:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17446 00000100:00100000:2.0:1789760779.048404:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717286106700 time 717297938784 state 0x2 ref 0 00000100:00100000:3.0:1789760779.054675:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.055287:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565461888 00000100:00100000:0.0:1789760779.055300:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565461888 00000100:00100000:0.0:1789760779.055377:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717286106700 time 717297938784 state 0x0 ref 1 00000100:00100000:0.0:1789760779.055573:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717298199200 time 717297938784 state 0x1 ref 1 00000100:00100000:0.0:1789760779.055653:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717298199200 time 717315944447 state 0x0 ref 1 00000100:00100000:0.0:1789760779.055680:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565461888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.055962:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71417856, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x220f8 00010000:00010000:0.0:1789760779.055975:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.056011:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.056017:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.056026:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.056041:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.069288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984744 is committed 00002000:00010000:0.0:1789760779.073693:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71417856 -> 71421952 00002000:00010000:0.0:1789760779.073791:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139512 -> 139520 00010000:00010000:0.0:1789760779.073812:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073828:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073838:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073845:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.073851:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073861:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073894:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.073902:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71417856->71421951] (req 71417856->71421951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.075111:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565461888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19420us (20444us total) trans 4294984744 rc 0/0 00000100:00100000:0.0:1789760779.075129:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17447 00000100:00100000:0.0:1789760779.075141:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717298199200 time 717315944447 state 0x2 ref 0 00000100:00100000:1.0:1789760779.081065:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.081227:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462016 00000100:00100000:2.0:1789760779.081240:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462016 00000100:00100000:2.0:1789760779.081312:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717298199200 time 717315944447 state 0x0 ref 1 00000100:00100000:2.0:1789760779.081331:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717316204863 time 717315944447 state 0x1 ref 1 00000100:00100000:2.0:1789760779.081418:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717316204863 time 717341708984 state 0x0 ref 1 00000100:00100000:2.0:1789760779.081434:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.081498:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71421952, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22100 00010000:00010000:2.0:1789760779.081511:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.081530:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.081535:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.081542:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.081559:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.089918:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984745 is committed 00002000:00010000:2.0:1789760779.090048:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71421952 -> 71426048 00002000:00010000:2.0:1789760779.090054:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139520 -> 139528 00010000:00010000:2.0:1789760779.090074:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090099:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090109:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090118:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.090125:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090136:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090162:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.090169:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dbdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71421952->71426047] (req 71421952->71426047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.090295:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8856us (9237us total) trans 4294984745 rc 0/0 00000100:00100000:2.0:1789760779.090308:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17448 00000100:00100000:2.0:1789760779.090320:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717316204863 time 717341708984 state 0x2 ref 0 00000100:00100000:2.0:1789760779.094950:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.095079:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462144 00000100:00100000:1.0:1789760779.095093:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462144 00000100:00100000:1.0:1789760779.095169:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717316204863 time 717341708984 state 0x0 ref 1 00000100:00100000:1.0:1789760779.095189:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717341969400 time 717341708984 state 0x1 ref 1 00000100:00100000:1.0:1789760779.095216:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717341969400 time 717355508123 state 0x0 ref 1 00000100:00100000:1.0:1789760779.095230:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.095294:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71426048, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22108 00010000:00010000:1.0:1789760779.095306:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.095326:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.095331:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.095338:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.095354:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.104486:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984746 is committed 00002000:00010000:1.0:1789760779.104617:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71426048 -> 71430144 00002000:00010000:1.0:1789760779.104624:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139528 -> 139536 00010000:00010000:1.0:1789760779.104643:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104877:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104891:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104901:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.104907:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104918:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104945:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.104953:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674dbe2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71426048->71430143] (req 71426048->71430143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.105331:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10093us (10388us total) trans 4294984746 rc 0/0 00000100:00100000:0.0:1789760779.105346:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17449 00000100:00100000:0.0:1789760779.105358:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717341969400 time 717355508123 state 0x2 ref 0 00000100:00100000:3.0:1789760779.109602:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.109767:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462272 00000100:00100000:0.0:1789760779.109780:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462272 00000100:00100000:0.0:1789760779.109856:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717341969400 time 717355508123 state 0x0 ref 1 00000100:00100000:0.0:1789760779.109875:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717355768539 time 717355508123 state 0x1 ref 1 00000100:00100000:0.0:1789760779.109904:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717355768539 time 717370196512 state 0x0 ref 1 00000100:00100000:0.0:1789760779.109919:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.109989:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71430144, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22110 00010000:00010000:0.0:1789760779.110001:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.110022:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.110028:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.110036:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.110053:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.121993:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984747 is committed 00002000:00010000:0.0:1789760779.122147:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71430144 -> 71434240 00002000:00010000:0.0:1789760779.122153:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139536 -> 139544 00010000:00010000:0.0:1789760779.122172:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122188:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122198:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122207:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.122213:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122228:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122252:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.122260:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbe9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71430144->71434239] (req 71430144->71434239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.122383:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12458us (12787us total) trans 4294984747 rc 0/0 00000100:00100000:0.0:1789760779.122395:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17450 00000100:00100000:0.0:1789760779.122406:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717355768539 time 717370196512 state 0x2 ref 0 00000100:00100000:1.0:1789760779.127048:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.127697:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462400 00000100:00100000:2.0:1789760779.127755:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462400 00000100:00100000:2.0:1789760779.127831:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717355768539 time 717370196512 state 0x0 ref 1 00000100:00100000:2.0:1789760779.127850:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717370456928 time 717370196512 state 0x1 ref 1 00000100:00100000:2.0:1789760779.127877:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717370456928 time 717388169255 state 0x0 ref 1 00000100:00100000:2.0:1789760779.127895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.127962:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71434240, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22118 00010000:00010000:2.0:1789760779.127974:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.127993:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.127998:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.128005:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.128022:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.135628:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984748 is committed 00002000:00010000:2.0:1789760779.135803:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71434240 -> 71438336 00002000:00010000:2.0:1789760779.135812:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139544 -> 139552 00010000:00010000:2.0:1789760779.135825:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135838:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135851:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135860:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.135865:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135875:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135898:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.135906:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dbf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71434240->71438335] (req 71434240->71438335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.136077:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8180us (9040us total) trans 4294984748 rc 0/0 00000100:00100000:2.0:1789760779.136089:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17451 00000100:00100000:2.0:1789760779.136098:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717370456928 time 717388169255 state 0x2 ref 0 00000100:00100000:2.0:1789760779.142573:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.143361:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462528 00000100:00100000:0.0:1789760779.143371:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462528 00000100:00100000:0.0:1789760779.143425:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717370456928 time 717388169255 state 0x0 ref 1 00000100:00100000:0.0:1789760779.143629:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717388429671 time 717388169255 state 0x1 ref 1 00000100:00100000:0.0:1789760779.143701:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717388429671 time 717403992634 state 0x0 ref 1 00000100:00100000:0.0:1789760779.143750:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.143810:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71438336, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22120 00010000:00010000:0.0:1789760779.143819:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.143834:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.143838:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.143844:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.143857:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.152373:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984749 is committed 00002000:00010000:0.0:1789760779.152586:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71438336 -> 71442432 00002000:00010000:0.0:1789760779.152592:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139552 -> 139560 00010000:00010000:0.0:1789760779.152607:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152619:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152627:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152634:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.152639:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152647:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152671:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.152678:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71438336->71442431] (req 71438336->71442431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.153170:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9063us (10244us total) trans 4294984749 rc 0/0 00000100:00100000:0.0:1789760779.153182:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17452 00000100:00100000:0.0:1789760779.153192:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717388429671 time 717403992634 state 0x2 ref 0 00000100:00100000:2.0:1789760779.157638:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.157903:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462656 00000100:00100000:0.0:1789760779.157913:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462656 00000100:00100000:0.0:1789760779.157974:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717388429671 time 717403992634 state 0x0 ref 1 00000100:00100000:0.0:1789760779.157988:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717404253050 time 717403992634 state 0x1 ref 1 00000100:00100000:0.0:1789760779.158059:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717404253050 time 717418350918 state 0x0 ref 1 00000100:00100000:0.0:1789760779.158071:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.158127:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71442432, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22128 00010000:00010000:0.0:1789760779.158136:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.158150:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.158154:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.158160:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.158172:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.165557:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984750 is committed 00002000:00010000:0.0:1789760779.165824:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71442432 -> 71446528 00002000:00010000:0.0:1789760779.165831:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139560 -> 139568 00010000:00010000:0.0:1789760779.165849:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165863:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165873:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165882:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.165887:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165898:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165923:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.165937:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dbfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71442432->71446527] (req 71442432->71446527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.166073:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7996us (8436us total) trans 4294984750 rc 0/0 00000100:00100000:0.0:1789760779.166086:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17453 00000100:00100000:0.0:1789760779.166098:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717404253050 time 717418350918 state 0x2 ref 0 00000100:00100000:1.0:1789760779.171297:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.171665:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462784 00000100:00100000:2.0:1789760779.171680:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462784 00000100:00100000:2.0:1789760779.171787:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717404253050 time 717418350918 state 0x0 ref 1 00000100:00100000:2.0:1789760779.171806:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717418611334 time 717418350918 state 0x1 ref 1 00000100:00100000:2.0:1789760779.171840:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717418611334 time 717432131555 state 0x0 ref 1 00000100:00100000:2.0:1789760779.171857:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.171923:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71446528, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22130 00010000:00010000:2.0:1789760779.171935:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.171957:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.171962:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.171971:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.171989:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.179224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984751 is committed 00002000:00010000:2.0:1789760779.179607:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71446528 -> 71450624 00002000:00010000:2.0:1789760779.179612:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139568 -> 139576 00010000:00010000:2.0:1789760779.179626:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179696:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179809:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179819:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.179825:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179836:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179857:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.179865:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71446528->71450623] (req 71446528->71450623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.179983:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565462784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8126us (8698us total) trans 4294984751 rc 0/0 00000100:00100000:2.0:1789760779.179991:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17454 00000100:00100000:2.0:1789760779.180000:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717418611334 time 717432131555 state 0x2 ref 0 00000100:00100000:2.0:1789760779.185970:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.186476:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565462912 00000100:00100000:0.0:1789760779.186487:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565462912 00000100:00100000:0.0:1789760779.186541:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717418611334 time 717432131555 state 0x0 ref 1 00000100:00100000:0.0:1789760779.186555:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717432391971 time 717432131555 state 0x1 ref 1 00000100:00100000:0.0:1789760779.186587:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717432391971 time 717446878807 state 0x0 ref 1 00000100:00100000:0.0:1789760779.186600:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.186644:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71450624, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22138 00010000:00010000:0.0:1789760779.186653:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.186679:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.186684:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.186690:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.186746:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.193163:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984752 is committed 00002000:00010000:0.0:1789760779.194542:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71450624 -> 71454720 00002000:00010000:0.0:1789760779.194551:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139576 -> 139584 00010000:00010000:0.0:1789760779.194565:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194577:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194585:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194591:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.194595:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194603:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194622:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.194629:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674dc0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71450624->71454719] (req 71450624->71454719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.194943:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565462912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8339us (8975us total) trans 4294984752 rc 0/0 00000100:00100000:0.0:1789760779.194955:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17455 00000100:00100000:0.0:1789760779.194964:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717432391971 time 717446878807 state 0x2 ref 0 00000100:00100000:1.0:1789760779.199225:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.199945:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463040 00000100:00100000:0.0:1789760779.199960:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463040 00000100:00100000:0.0:1789760779.200024:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717432391971 time 717446878807 state 0x0 ref 1 00000100:00100000:0.0:1789760779.200039:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717447139223 time 717446878807 state 0x1 ref 1 00000100:00100000:0.0:1789760779.200078:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717447139223 time 717460369575 state 0x0 ref 1 00000100:00100000:0.0:1789760779.200091:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565463040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.200141:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71454720, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22140 00010000:00010000:0.0:1789760779.200150:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.200168:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.200172:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.200178:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.200193:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.205348:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984753 is committed 00002000:00010000:2.0:1789760779.205505:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71454720 -> 71458816 00002000:00010000:2.0:1789760779.205510:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139584 -> 139592 00010000:00010000:2.0:1789760779.205523:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205536:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205545:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205555:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.205559:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205569:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205589:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.205596:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674dc13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71454720->71458815] (req 71454720->71458815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.205794:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565463040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5702us (6581us total) trans 4294984753 rc 0/0 00000100:00100000:2.0:1789760779.205805:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17456 00000100:00100000:2.0:1789760779.205814:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717447139223 time 717460369575 state 0x2 ref 0 00000100:00100000:1.0:1789760779.210392:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.210481:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463168 00000100:00100000:2.0:1789760779.210491:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463168 00000100:00100000:2.0:1789760779.210546:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717447139223 time 717460369575 state 0x0 ref 1 00000100:00100000:2.0:1789760779.210560:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717460629991 time 717460369575 state 0x1 ref 1 00000100:00100000:2.0:1789760779.210622:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717460629991 time 717470913757 state 0x0 ref 1 00000100:00100000:2.0:1789760779.210640:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565463168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.210697:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71458816, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22148 00010000:00010000:2.0:1789760779.210743:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.210759:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.210764:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.210771:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.210785:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.215988:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984754 is committed 00002000:00010000:2.0:1789760779.216319:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71458816 -> 71462912 00002000:00010000:2.0:1789760779.216324:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139592 -> 139600 00010000:00010000:2.0:1789760779.216338:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216352:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216360:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216367:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.216373:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216382:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216403:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.216410:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71458816->71462911] (req 71458816->71462911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.217648:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565463168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7000us (7254us total) trans 4294984754 rc 0/0 00000100:00100000:2.0:1789760779.217662:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17457 00000100:00100000:2.0:1789760779.217672:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717460629991 time 717470913757 state 0x2 ref 0 00000100:00100000:0.0:1789760779.225211:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.225308:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463296 00000100:00100000:2.0:1789760779.225318:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463296 00000100:00100000:2.0:1789760779.225369:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717460629991 time 717470913757 state 0x0 ref 1 00000100:00100000:2.0:1789760779.225384:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717471174173 time 717470913757 state 0x1 ref 1 00000100:00100000:2.0:1789760779.225413:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717471174173 time 717485704741 state 0x0 ref 1 00000100:00100000:2.0:1789760779.225425:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565463296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.225487:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71462912, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22150 00010000:00010000:2.0:1789760779.225497:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.225578:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.225584:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.225590:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.225614:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.236074:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984755 is committed 00002000:00010000:0.0:1789760779.236401:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71462912 -> 71467008 00002000:00010000:0.0:1789760779.236406:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139600 -> 139608 00010000:00010000:0.0:1789760779.236419:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236430:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236439:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236446:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.236450:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236458:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236475:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.236483:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674dc21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71462912->71467007] (req 71462912->71467007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.236593:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565463296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11166us (11387us total) trans 4294984755 rc 0/0 00000100:00100000:0.0:1789760779.236605:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17458 00000100:00100000:0.0:1789760779.236615:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717471174173 time 717485704741 state 0x2 ref 0 00000100:00100000:1.0:1789760779.246175:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.246497:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463424 00000100:00100000:2.0:1789760779.246508:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463424 00000100:00100000:2.0:1789760779.246571:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717471174173 time 717485704741 state 0x0 ref 1 00000100:00100000:2.0:1789760779.246587:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717485965157 time 717485704741 state 0x1 ref 1 00000100:00100000:2.0:1789760779.246667:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717485965157 time 717506957097 state 0x0 ref 1 00000100:00100000:2.0:1789760779.246681:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565463424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.246764:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71467008, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22158 00010000:00010000:2.0:1789760779.246773:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.246789:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.246794:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.246811:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.246825:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.254512:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984756 is committed 00002000:00010000:0.0:1789760779.254734:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71467008 -> 71471104 00002000:00010000:0.0:1789760779.254740:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139608 -> 139616 00010000:00010000:0.0:1789760779.254758:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254774:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254783:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254791:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.254797:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254807:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254832:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.254845:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dc28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71467008->71471103] (req 71467008->71471103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.254982:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565463424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8295us (8808us total) trans 4294984756 rc 0/0 00000100:00100000:0.0:1789760779.254997:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17459 00000100:00100000:0.0:1789760779.255840:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717485965157 time 717506957097 state 0x2 ref 0 00000100:00100000:1.0:1789760779.266275:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.266524:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463552 00000100:00100000:2.0:1789760779.266534:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463552 00000100:00100000:2.0:1789760779.266591:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717485965157 time 717506957097 state 0x0 ref 1 00000100:00100000:2.0:1789760779.266605:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717507217513 time 717506957097 state 0x1 ref 1 00000100:00100000:2.0:1789760779.266767:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717507217513 time 717527057420 state 0x0 ref 1 00000100:00100000:2.0:1789760779.266792:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.266842:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71471104, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22160 00010000:00010000:2.0:1789760779.266850:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.266867:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.266871:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.266877:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.266891:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.272758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984757 is committed 00002000:00010000:2.0:1789760779.272880:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71471104 -> 71475200 00002000:00010000:2.0:1789760779.272884:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139616 -> 139624 00010000:00010000:2.0:1789760779.272898:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272911:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272921:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272929:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.272934:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272955:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272976:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.272985:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674dc2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71471104->71475199] (req 71471104->71475199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.273085:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6303us (6815us total) trans 4294984757 rc 0/0 00000100:00100000:2.0:1789760779.273098:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17460 00000100:00100000:2.0:1789760779.273112:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717507217513 time 717527057420 state 0x2 ref 0 00000100:00100000:2.0:1789760779.279830:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.280107:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463680 00000100:00100000:0.0:1789760779.280119:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463680 00000100:00100000:0.0:1789760779.280182:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717507217513 time 717527057420 state 0x0 ref 1 00000100:00100000:0.0:1789760779.280196:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717527317836 time 717527057420 state 0x1 ref 1 00000100:00100000:0.0:1789760779.280235:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717527317836 time 717540526571 state 0x0 ref 1 00000100:00100000:0.0:1789760779.280249:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.280303:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71475200, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22168 00010000:00010000:0.0:1789760779.280312:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.280332:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.280336:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.280343:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.280360:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.289528:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984758 is committed 00002000:00010000:0.0:1789760779.289653:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71475200 -> 71479296 00002000:00010000:0.0:1789760779.289658:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139624 -> 139632 00010000:00010000:0.0:1789760779.289670:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289683:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289692:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289700:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.289749:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289759:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289778:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.289786:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71475200->71479295] (req 71475200->71479295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.289883:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9633us (10060us total) trans 4294984758 rc 0/0 00000100:00100000:0.0:1789760779.289894:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17461 00000100:00100000:0.0:1789760779.289903:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717527317836 time 717540526571 state 0x2 ref 0 00000100:00100000:1.0:1789760779.301805:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.302002:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463808 00000100:00100000:0.0:1789760779.302011:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463808 00000100:00100000:0.0:1789760779.302068:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717527317836 time 717540526571 state 0x0 ref 1 00000100:00100000:0.0:1789760779.302084:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717540786987 time 717540526571 state 0x1 ref 1 00000100:00100000:0.0:1789760779.302119:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717540786987 time 717562411773 state 0x0 ref 1 00000100:00100000:0.0:1789760779.302132:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.302302:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71479296, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22170 00010000:00010000:0.0:1789760779.302313:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.302329:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.302334:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.302340:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.302368:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.307699:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984759 is committed 00002000:00010000:1.0:1789760779.307961:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71479296 -> 71483392 00002000:00010000:1.0:1789760779.307967:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139632 -> 139640 00010000:00010000:1.0:1789760779.307982:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.307994:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.308001:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.308008:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.308012:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.308020:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.308038:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.308046:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dc3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71479296->71483391] (req 71479296->71483391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.308143:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565463808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6007us (6343us total) trans 4294984759 rc 0/0 00000100:00100000:1.0:1789760779.308154:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17462 00000100:00100000:1.0:1789760779.308163:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717540786987 time 717562411773 state 0x2 ref 0 00000100:00100000:3.0:1789760779.319475:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.319620:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565463936 00000100:00100000:2.0:1789760779.319630:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565463936 00000100:00100000:2.0:1789760779.319695:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717540786987 time 717562411773 state 0x0 ref 1 00000100:00100000:2.0:1789760779.319760:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717562672189 time 717562411773 state 0x1 ref 1 00000100:00100000:2.0:1789760779.319794:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717562672189 time 717580085707 state 0x0 ref 1 00000100:00100000:2.0:1789760779.319808:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565463936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.319855:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71483392, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22178 00010000:00010000:2.0:1789760779.319865:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.319879:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.319883:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.319889:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.319902:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.326048:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984760 is committed 00002000:00010000:1.0:1789760779.326215:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71483392 -> 71487488 00002000:00010000:1.0:1789760779.326220:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139640 -> 139648 00010000:00010000:1.0:1789760779.326235:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326247:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326256:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326264:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.326269:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326278:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326299:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.326307:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674dc44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71483392->71487487] (req 71483392->71487487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.326434:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565463936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6625us (6963us total) trans 4294984760 rc 0/0 00000100:00100000:1.0:1789760779.326449:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17463 00000100:00100000:1.0:1789760779.326459:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717562672189 time 717580085707 state 0x2 ref 0 00000100:00100000:2.0:1789760779.331248:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.331319:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464064 00000100:00100000:0.0:1789760779.331329:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464064 00000100:00100000:0.0:1789760779.331381:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717562672189 time 717580085707 state 0x0 ref 1 00000100:00100000:0.0:1789760779.331395:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717580346123 time 717580085707 state 0x1 ref 1 00000100:00100000:0.0:1789760779.331427:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717580346123 time 717591719107 state 0x0 ref 1 00000100:00100000:0.0:1789760779.331441:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565464064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.331490:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71487488, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22180 00010000:00010000:0.0:1789760779.331499:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.331527:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.331532:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.331538:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.331559:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.338973:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984761 is committed 00002000:00010000:0.0:1789760779.339389:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71487488 -> 71491584 00002000:00010000:0.0:1789760779.339395:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139648 -> 139656 00010000:00010000:0.0:1789760779.339408:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339426:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339435:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339443:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.339447:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339456:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339475:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.339483:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71487488->71491583] (req 71487488->71491583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.339867:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565464064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8424us (8622us total) trans 4294984761 rc 0/0 00000100:00100000:0.0:1789760779.339878:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17464 00000100:00100000:0.0:1789760779.339888:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717580346123 time 717591719107 state 0x2 ref 0 00000100:00100000:2.0:1789760779.350476:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.355139:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464192 00000100:00100000:1.0:1789760779.355154:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464192 00000100:00100000:1.0:1789760779.355225:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717580346123 time 717591719107 state 0x0 ref 1 00000100:00100000:1.0:1789760779.355240:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717591979523 time 717591719107 state 0x1 ref 1 00000100:00100000:1.0:1789760779.355331:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717591979523 time 717615621874 state 0x0 ref 1 00000100:00100000:1.0:1789760779.355346:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.355392:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71491584, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22188 00010000:00010000:1.0:1789760779.355402:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.355433:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.355438:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.355444:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.355458:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.361008:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984762 is committed 00002000:00010000:1.0:1789760779.361141:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71491584 -> 71495680 00002000:00010000:1.0:1789760779.361147:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139656 -> 139664 00010000:00010000:1.0:1789760779.361161:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361175:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361184:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361191:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.361195:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361203:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361223:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.361232:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71491584->71495679] (req 71491584->71495679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.361326:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5979us (10854us total) trans 4294984762 rc 0/0 00000100:00100000:1.0:1789760779.361337:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17465 00000100:00100000:1.0:1789760779.361346:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717591979523 time 717615621874 state 0x2 ref 0 00000100:00100000:3.0:1789760779.364397:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.364540:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464320 00000100:00100000:1.0:1789760779.364551:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464320 00000100:00100000:1.0:1789760779.364607:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717591979523 time 717615621874 state 0x0 ref 1 00000100:00100000:1.0:1789760779.364622:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717615882290 time 717615621874 state 0x1 ref 1 00000100:00100000:1.0:1789760779.364650:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717615882290 time 717624941426 state 0x0 ref 1 00000100:00100000:1.0:1789760779.364662:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565464320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.364741:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71495680, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22190 00010000:00010000:1.0:1789760779.364751:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.364767:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.364772:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.364779:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.364792:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.370349:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984763 is committed 00002000:00010000:1.0:1789760779.370486:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71495680 -> 71499776 00002000:00010000:1.0:1789760779.370491:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139664 -> 139672 00010000:00010000:1.0:1789760779.370504:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370524:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370535:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370543:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.370548:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370558:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370577:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.370592:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71495680->71499775] (req 71495680->71499775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.370683:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565464320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6018us (6289us total) trans 4294984763 rc 0/0 00000100:00100000:1.0:1789760779.370694:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17466 00000100:00100000:1.0:1789760779.370987:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717615882290 time 717624941426 state 0x2 ref 0 00000100:00100000:2.0:1789760779.375574:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.375777:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464448 00000100:00100000:0.0:1789760779.375788:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464448 00000100:00100000:0.0:1789760779.375844:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717615882290 time 717624941426 state 0x0 ref 1 00000100:00100000:0.0:1789760779.375859:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717625201842 time 717624941426 state 0x1 ref 1 00000100:00100000:0.0:1789760779.375888:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717625201842 time 717636180255 state 0x0 ref 1 00000100:00100000:0.0:1789760779.375900:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.375948:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71499776, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22198 00010000:00010000:0.0:1789760779.375957:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.375973:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.375978:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.375984:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.375997:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.381160:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984764 is committed 00002000:00010000:0.0:1789760779.381284:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71499776 -> 71503872 00002000:00010000:0.0:1789760779.381289:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139672 -> 139680 00010000:00010000:0.0:1789760779.381302:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381314:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381328:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381336:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.381341:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381350:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381370:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.381378:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674dc60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71499776->71503871] (req 71499776->71503871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.381485:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5582us (5914us total) trans 4294984764 rc 0/0 00000100:00100000:0.0:1789760779.381496:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17467 00000100:00100000:0.0:1789760779.381506:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717625201842 time 717636180255 state 0x2 ref 0 00000100:00100000:2.0:1789760779.385441:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.385650:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464576 00000100:00100000:1.0:1789760779.385658:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464576 00000100:00100000:1.0:1789760779.385843:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717625201842 time 717636180255 state 0x0 ref 1 00000100:00100000:1.0:1789760779.385861:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717636440671 time 717636180255 state 0x1 ref 1 00000100:00100000:1.0:1789760779.385926:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717636440671 time 717646217390 state 0x0 ref 1 00000100:00100000:1.0:1789760779.385939:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.385988:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71503872, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221a0 00010000:00010000:1.0:1789760779.385997:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.386013:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.386017:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.386022:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.386036:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.390588:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984765 is committed 00002000:00010000:2.0:1789760779.390935:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71503872 -> 71507968 00002000:00010000:2.0:1789760779.390940:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139680 -> 139688 00010000:00010000:2.0:1789760779.390953:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.390967:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.390976:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.390983:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.390988:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.390997:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.391024:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.391032:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dc67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71503872->71507967] (req 71503872->71507967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.391178:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5235us (5740us total) trans 4294984765 rc 0/0 00000100:00100000:2.0:1789760779.391189:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17468 00000100:00100000:2.0:1789760779.391199:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717636440671 time 717646217390 state 0x2 ref 0 00000100:00100000:3.0:1789760779.396351:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.396537:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464704 00000100:00100000:1.0:1789760779.396548:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464704 00000100:00100000:1.0:1789760779.396607:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717636440671 time 717646217390 state 0x0 ref 1 00000100:00100000:1.0:1789760779.396624:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717646477806 time 717646217390 state 0x1 ref 1 00000100:00100000:1.0:1789760779.396974:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717646477806 time 717656949125 state 0x0 ref 1 00000100:00100000:1.0:1789760779.396992:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565464704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.397042:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71507968, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221a8 00010000:00010000:1.0:1789760779.397051:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.397077:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.397081:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.397087:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.397101:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.402437:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984766 is committed 00002000:00010000:1.0:1789760779.402639:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71507968 -> 71512064 00002000:00010000:1.0:1789760779.402645:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139688 -> 139696 00010000:00010000:1.0:1789760779.402657:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402670:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402680:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402687:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.402692:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402740:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402762:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.402770:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71507968->71512063] (req 71507968->71512063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.402865:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565464704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5872us (6580us total) trans 4294984766 rc 0/0 00000100:00100000:1.0:1789760779.402875:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17469 00000100:00100000:1.0:1789760779.402885:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717646477806 time 717656949125 state 0x2 ref 0 00000100:00100000:0.0:1789760779.407582:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.407673:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464832 00000100:00100000:2.0:1789760779.407683:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464832 00000100:00100000:2.0:1789760779.407893:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717646477806 time 717656949125 state 0x0 ref 1 00000100:00100000:2.0:1789760779.407909:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717657209541 time 717656949125 state 0x1 ref 1 00000100:00100000:2.0:1789760779.407931:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717657209541 time 717668223532 state 0x0 ref 1 00000100:00100000:2.0:1789760779.407943:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.407989:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71512064, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221b0 00010000:00010000:2.0:1789760779.407998:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.408020:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.408024:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.408036:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.408053:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.412625:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984767 is committed 00002000:00010000:0.0:1789760779.412815:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71512064 -> 71516160 00002000:00010000:0.0:1789760779.412821:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139696 -> 139704 00010000:00010000:0.0:1789760779.412835:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412848:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412857:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412865:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.412870:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412879:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412899:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.412907:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71512064->71516159] (req 71512064->71516159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.413000:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565464832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5054us (5423us total) trans 4294984767 rc 0/0 00000100:00100000:0.0:1789760779.413011:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17470 00000100:00100000:0.0:1789760779.413021:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717657209541 time 717668223532 state 0x2 ref 0 00000100:00100000:2.0:1789760779.419182:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.419576:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565464960 00000100:00100000:1.0:1789760779.419586:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565464960 00000100:00100000:1.0:1789760779.419933:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717657209541 time 717668223532 state 0x0 ref 1 00000100:00100000:1.0:1789760779.419950:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717668483948 time 717668223532 state 0x1 ref 1 00000100:00100000:1.0:1789760779.419984:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717668483948 time 717680276141 state 0x0 ref 1 00000100:00100000:1.0:1789760779.419998:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565464960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.420044:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71516160, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221b8 00010000:00010000:1.0:1789760779.420053:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.420172:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.420178:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.420185:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.420201:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.426758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984768 is committed 00002000:00010000:1.0:1789760779.427258:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71516160 -> 71520256 00002000:00010000:1.0:1789760779.427264:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139704 -> 139712 00010000:00010000:1.0:1789760779.427278:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427290:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427299:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427306:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.427311:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427320:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427340:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.427348:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71516160->71520255] (req 71516160->71520255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.427497:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565464960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7498us (8432us total) trans 4294984768 rc 0/0 00000100:00100000:1.0:1789760779.427508:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17471 00000100:00100000:1.0:1789760779.427517:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717668483948 time 717680276141 state 0x2 ref 0 00000100:00100000:3.0:1789760779.434457:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.434760:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465088 00000100:00100000:1.0:1789760779.434770:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465088 00000100:00100000:1.0:1789760779.434844:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717668483948 time 717680276141 state 0x0 ref 1 00000100:00100000:1.0:1789760779.434860:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717680536557 time 717680276141 state 0x1 ref 1 00000100:00100000:1.0:1789760779.434880:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717680536557 time 717695172768 state 0x0 ref 1 00000100:00100000:1.0:1789760779.434895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.434942:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71520256, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221c0 00010000:00010000:1.0:1789760779.434951:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.434966:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.434972:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.434978:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.434991:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.440334:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984769 is committed 00002000:00010000:1.0:1789760779.440645:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71520256 -> 71524352 00002000:00010000:1.0:1789760779.440650:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139712 -> 139720 00010000:00010000:1.0:1789760779.440663:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440675:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440684:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440691:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.440695:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440742:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440762:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.440775:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71520256->71524351] (req 71520256->71524351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.440944:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6045us (6491us total) trans 4294984769 rc 0/0 00000100:00100000:1.0:1789760779.440955:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17472 00000100:00100000:1.0:1789760779.440964:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717680536557 time 717695172768 state 0x2 ref 0 00000100:00100000:0.0:1789760779.448097:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.448675:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465216 00000100:00100000:2.0:1789760779.448686:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465216 00000100:00100000:2.0:1789760779.448962:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717680536557 time 717695172768 state 0x0 ref 1 00000100:00100000:2.0:1789760779.448978:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717695433184 time 717695172768 state 0x1 ref 1 00000100:00100000:2.0:1789760779.449046:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717695433184 time 717709337776 state 0x0 ref 1 00000100:00100000:2.0:1789760779.449060:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565465216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.449127:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71524352, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221c8 00010000:00010000:2.0:1789760779.449137:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.449153:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.449159:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.449166:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.449179:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.453899:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984770 is committed 00002000:00010000:2.0:1789760779.455157:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71524352 -> 71528448 00002000:00010000:2.0:1789760779.455166:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139720 -> 139728 00010000:00010000:2.0:1789760779.455179:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455191:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455199:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455206:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.455211:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455219:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455239:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.455252:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dc8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71524352->71528447] (req 71524352->71528447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.455403:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565465216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6341us (7311us total) trans 4294984770 rc 0/0 00000100:00100000:2.0:1789760779.455414:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17473 00000100:00100000:2.0:1789760779.455423:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717695433184 time 717709337776 state 0x2 ref 0 00000100:00100000:2.0:1789760779.461064:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.461155:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465344 00000100:00100000:1.0:1789760779.461165:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465344 00000100:00100000:1.0:1789760779.461214:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717695433184 time 717709337776 state 0x0 ref 1 00000100:00100000:1.0:1789760779.461228:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717709598192 time 717709337776 state 0x1 ref 1 00000100:00100000:1.0:1789760779.461255:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717709598192 time 717721547849 state 0x0 ref 1 00000100:00100000:1.0:1789760779.461268:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.461317:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71528448, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221d0 00010000:00010000:1.0:1789760779.461326:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.461344:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.461348:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.461355:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.461371:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.467297:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984771 is committed 00002000:00010000:1.0:1789760779.467488:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71528448 -> 71532544 00002000:00010000:1.0:1789760779.467493:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139728 -> 139736 00010000:00010000:1.0:1789760779.467508:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467521:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467530:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467537:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.467542:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467550:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467570:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.467577:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71528448->71532543] (req 71528448->71532543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.468095:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6821us (7033us total) trans 4294984771 rc 0/0 00000100:00100000:1.0:1789760779.468109:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17474 00000100:00100000:1.0:1789760779.468118:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717709598192 time 717721547849 state 0x2 ref 0 00010000:00010000:0.0:1789760779.468667:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760779.473144:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.473651:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465472 00000100:00100000:1.0:1789760779.473672:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465472 00000100:00100000:1.0:1789760779.473758:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717709598192 time 717721547849 state 0x0 ref 1 00000100:00100000:1.0:1789760779.473774:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717721808265 time 717721547849 state 0x1 ref 1 00000100:00100000:1.0:1789760779.473796:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717721808265 time 717734087887 state 0x0 ref 1 00000100:00100000:1.0:1789760779.473809:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565465472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.473880:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71532544, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221d8 00010000:00010000:1.0:1789760779.473891:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.473908:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.473912:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.473918:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.473933:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.478382:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984772 is committed 00002000:00010000:2.0:1789760779.478654:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71532544 -> 71536640 00002000:00010000:2.0:1789760779.478750:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139736 -> 139744 00010000:00010000:2.0:1789760779.478764:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478777:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478786:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478794:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.478799:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478807:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478937:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.478946:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674dc98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71532544->71536639] (req 71532544->71536639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.479083:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565465472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5271us (5943us total) trans 4294984772 rc 0/0 00000100:00100000:2.0:1789760779.479094:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17475 00000100:00100000:2.0:1789760779.479103:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717721808265 time 717734087887 state 0x2 ref 0 00000100:00100000:3.0:1789760779.484745:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.484776:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465600 00000100:00100000:2.0:1789760779.484785:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465600 00000100:00100000:2.0:1789760779.484840:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717721808265 time 717734087887 state 0x0 ref 1 00000100:00100000:2.0:1789760779.484855:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717734348303 time 717734087887 state 0x1 ref 1 00000100:00100000:0.0:1789760779.484937:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717734348303 time 717745226794 state 0x0 ref 1 00000100:00100000:0.0:1789760779.484963:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565465600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.485014:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71536640, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221e0 00010000:00010000:0.0:1789760779.485023:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.485038:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.485042:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.485049:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.485063:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.489521:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984773 is committed 00002000:00010000:0.0:1789760779.489633:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71536640 -> 71540736 00002000:00010000:0.0:1789760779.489638:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139744 -> 139752 00010000:00010000:0.0:1789760779.489652:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489665:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489674:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489687:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.489692:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489701:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489768:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.489777:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dc9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71536640->71540735] (req 71536640->71540735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.490093:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565465600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5130us (5394us total) trans 4294984773 rc 0/0 00000100:00100000:0.0:1789760779.490105:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17476 00000100:00100000:0.0:1789760779.490114:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717734348303 time 717745226794 state 0x2 ref 0 00000100:00100000:1.0:1789760779.497033:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.497312:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465728 00000100:00100000:2.0:1789760779.497322:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465728 00000100:00100000:2.0:1789760779.497378:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717734348303 time 717745226794 state 0x0 ref 1 00000100:00100000:2.0:1789760779.497392:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717745487210 time 717745226794 state 0x1 ref 1 00000100:00100000:2.0:1789760779.497433:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717745487210 time 717757724652 state 0x0 ref 1 00000100:00100000:2.0:1789760779.497445:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565465728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.497493:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71540736, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221e8 00010000:00010000:2.0:1789760779.497502:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.497684:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.497688:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.497694:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.497758:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.505249:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984774 is committed 00002000:00010000:2.0:1789760779.505879:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71540736 -> 71544832 00002000:00010000:2.0:1789760779.505886:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139752 -> 139760 00010000:00010000:2.0:1789760779.505900:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.505913:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.505923:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.506225:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.506233:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.506249:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.506268:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.506276:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71540736->71544831] (req 71540736->71544831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.506521:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565465728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9073us (9492us total) trans 4294984774 rc 0/0 00000100:00100000:2.0:1789760779.506532:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17477 00000100:00100000:2.0:1789760779.506540:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717745487210 time 717757724652 state 0x2 ref 0 00000100:00100000:3.0:1789760779.510301:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.510410:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465856 00000100:00100000:2.0:1789760779.510418:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465856 00000100:00100000:2.0:1789760779.510461:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717745487210 time 717757724652 state 0x0 ref 1 00000100:00100000:2.0:1789760779.510473:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717757985068 time 717757724652 state 0x1 ref 1 00000100:00100000:2.0:1789760779.510578:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717757985068 time 717770870937 state 0x0 ref 1 00000100:00100000:2.0:1789760779.510588:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.510628:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71544832, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221f0 00010000:00010000:2.0:1789760779.510634:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.510646:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.510650:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.510654:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.510674:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.517788:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984775 is committed 00002000:00010000:2.0:1789760779.517891:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71544832 -> 71548928 00002000:00010000:2.0:1789760779.517896:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139760 -> 139768 00010000:00010000:2.0:1789760779.517908:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517920:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517928:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517935:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.517940:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517949:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517973:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.517981:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71544832->71548927] (req 71544832->71548927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.518084:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565465856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7491us (7788us total) trans 4294984775 rc 0/0 00000100:00100000:2.0:1789760779.518095:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17478 00000100:00100000:2.0:1789760779.518104:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717757985068 time 717770870937 state 0x2 ref 0 00000100:00100000:3.0:1789760779.525513:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.528521:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565465984 00000100:00100000:0.0:1789760779.528537:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565465984 00000100:00100000:0.0:1789760779.528602:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717757985068 time 717770870937 state 0x0 ref 1 00000100:00100000:0.0:1789760779.528617:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717771131353 time 717770870937 state 0x1 ref 1 00000100:00100000:0.0:1789760779.528696:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717771131353 time 717788986730 state 0x0 ref 1 00000100:00100000:0.0:1789760779.528741:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565465984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.528795:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71548928, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x221f8 00010000:00010000:0.0:1789760779.528805:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.528821:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.528826:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.528832:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.528845:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.533350:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984776 is committed 00002000:00010000:0.0:1789760779.533919:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71548928 -> 71553024 00002000:00010000:0.0:1789760779.533925:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139768 -> 139776 00010000:00010000:0.0:1789760779.533938:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.533950:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.533959:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.533967:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.533973:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.533982:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.534002:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.534010:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71548928->71553023] (req 71548928->71553023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.534241:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565465984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5434us (8667us total) trans 4294984776 rc 0/0 00000100:00100000:0.0:1789760779.534252:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17479 00000100:00100000:0.0:1789760779.534261:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717771131353 time 717788986730 state 0x2 ref 0 00000100:00100000:1.0:1789760779.542614:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.542882:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466112 00000100:00100000:2.0:1789760779.542891:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466112 00000100:00100000:2.0:1789760779.542943:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717771131353 time 717788986730 state 0x0 ref 1 00000100:00100000:2.0:1789760779.542959:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717789247146 time 717788986730 state 0x1 ref 1 00000100:00100000:2.0:1789760779.543031:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717789247146 time 717803321821 state 0x0 ref 1 00000100:00100000:2.0:1789760779.543045:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.543100:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71553024, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22200 00010000:00010000:2.0:1789760779.543110:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.543126:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.543131:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.543137:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.543152:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.547551:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984777 is committed 00002000:00010000:2.0:1789760779.547665:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71553024 -> 71557120 00002000:00010000:2.0:1789760779.547670:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139776 -> 139784 00010000:00010000:2.0:1789760779.547685:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547698:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547762:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547771:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.547776:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547785:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547803:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.547817:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674dcbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71553024->71557119] (req 71553024->71557119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.547911:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4864us (5302us total) trans 4294984777 rc 0/0 00000100:00100000:2.0:1789760779.547922:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17480 00000100:00100000:2.0:1789760779.547931:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717789247146 time 717803321821 state 0x2 ref 0 00000100:00100000:2.0:1789760779.554827:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.555205:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466240 00000100:00100000:1.0:1789760779.555215:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466240 00000100:00100000:1.0:1789760779.555271:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717789247146 time 717803321821 state 0x0 ref 1 00000100:00100000:1.0:1789760779.555286:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717803582237 time 717803321821 state 0x1 ref 1 00000100:00100000:1.0:1789760779.555396:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717803582237 time 717815686276 state 0x0 ref 1 00000100:00100000:1.0:1789760779.555410:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.555459:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71557120, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22208 00010000:00010000:1.0:1789760779.555469:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.555484:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.555488:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.555495:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.555515:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.560364:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984778 is committed 00002000:00010000:1.0:1789760779.560499:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71557120 -> 71561216 00002000:00010000:1.0:1789760779.560505:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139784 -> 139792 00010000:00010000:1.0:1789760779.560518:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560530:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560539:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560546:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.560551:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560560:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560577:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.560584:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71557120->71561215] (req 71557120->71561215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.560679:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5267us (5857us total) trans 4294984778 rc 0/0 00000100:00100000:1.0:1789760779.560690:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17481 00000100:00100000:1.0:1789760779.560700:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717803582237 time 717815686276 state 0x2 ref 0 00000100:00100000:3.0:1789760779.564168:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.564249:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466368 00000100:00100000:0.0:1789760779.564260:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466368 00000100:00100000:0.0:1789760779.566514:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717803582237 time 717815686276 state 0x0 ref 1 00000100:00100000:0.0:1789760779.566533:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717815946692 time 717815686276 state 0x1 ref 1 00000100:00100000:0.0:1789760779.566649:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717815946692 time 717826940150 state 0x0 ref 1 00000100:00100000:0.0:1789760779.566666:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.567055:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71561216, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22210 00010000:00010000:0.0:1789760779.567067:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.567084:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.567088:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.567095:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.567108:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.574435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984779 is committed 00002000:00010000:0.0:1789760779.574562:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71561216 -> 71565312 00002000:00010000:0.0:1789760779.574567:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139792 -> 139800 00010000:00010000:0.0:1789760779.574580:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574592:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574601:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574609:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.574614:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574623:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574642:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.574651:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71561216->71565311] (req 71561216->71565311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.574799:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565466368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8132us (10633us total) trans 4294984779 rc 0/0 00000100:00100000:0.0:1789760779.574810:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17482 00000100:00100000:0.0:1789760779.574820:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717815946692 time 717826940150 state 0x2 ref 0 00000100:00100000:2.0:1789760779.579338:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.579437:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466496 00000100:00100000:1.0:1789760779.579448:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466496 00000100:00100000:1.0:1789760779.579503:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717815946692 time 717826940150 state 0x0 ref 1 00000100:00100000:1.0:1789760779.579519:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717827200566 time 717826940150 state 0x1 ref 1 00000100:00100000:1.0:1789760779.579547:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717827200566 time 717839838688 state 0x0 ref 1 00000100:00100000:1.0:1789760779.579561:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565466496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.579608:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71565312, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22218 00010000:00010000:1.0:1789760779.579617:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.579634:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.579638:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.579645:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.579658:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.590623:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984780 is committed 00002000:00010000:1.0:1789760779.590847:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71565312 -> 71569408 00002000:00010000:1.0:1789760779.590852:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139800 -> 139808 00010000:00010000:1.0:1789760779.590866:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590880:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590890:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590898:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.590902:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590911:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590932:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.590940:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71565312->71569407] (req 71565312->71569407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.591036:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565466496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11473us (11702us total) trans 4294984780 rc 0/0 00000100:00100000:1.0:1789760779.591047:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17483 00000100:00100000:1.0:1789760779.591057:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717827200566 time 717839838688 state 0x2 ref 0 00000100:00100000:3.0:1789760779.600408:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.600502:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466624 00000100:00100000:1.0:1789760779.600512:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466624 00000100:00100000:1.0:1789760779.600562:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717827200566 time 717839838688 state 0x0 ref 1 00000100:00100000:1.0:1789760779.600577:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717840099104 time 717839838688 state 0x1 ref 1 00000100:00100000:1.0:1789760779.600615:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717840099104 time 717860907379 state 0x0 ref 1 00000100:00100000:1.0:1789760779.600628:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565466624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.600671:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71569408, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22220 00010000:00010000:1.0:1789760779.600681:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.600697:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.601216:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.601227:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.601244:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.608008:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984781 is committed 00002000:00010000:1.0:1789760779.608229:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71569408 -> 71573504 00002000:00010000:1.0:1789760779.608235:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139808 -> 139816 00010000:00010000:1.0:1789760779.608248:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608260:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608270:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608278:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.608282:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608291:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608366:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.608376:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71569408->71573503] (req 71569408->71573503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.608504:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565466624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7872us (8099us total) trans 4294984781 rc 0/0 00000100:00100000:1.0:1789760779.608515:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17484 00000100:00100000:1.0:1789760779.608536:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717840099104 time 717860907379 state 0x2 ref 0 00000100:00100000:3.0:1789760779.613259:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.613976:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466752 00000100:00100000:0.0:1789760779.613987:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466752 00000100:00100000:0.0:1789760779.614044:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717840099104 time 717860907379 state 0x0 ref 1 00000100:00100000:0.0:1789760779.614059:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717861167795 time 717860907379 state 0x1 ref 1 00000100:00100000:0.0:1789760779.614119:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717861167795 time 717874410502 state 0x0 ref 1 00000100:00100000:0.0:1789760779.614133:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565466752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.614177:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71573504, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22228 00010000:00010000:0.0:1789760779.614186:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.614201:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.614206:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.614212:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.614226:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.619925:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984782 is committed 00002000:00010000:0.0:1789760779.620143:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71573504 -> 71577600 00002000:00010000:0.0:1789760779.620149:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139816 -> 139824 00010000:00010000:0.0:1789760779.620162:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620175:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620183:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620190:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.620195:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620204:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620223:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.620235:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71573504->71577599] (req 71573504->71577599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.620435:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565466752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6300us (7179us total) trans 4294984782 rc 0/0 00000100:00100000:0.0:1789760779.620445:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17485 00000100:00100000:0.0:1789760779.620454:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717861167795 time 717874410502 state 0x2 ref 0 00000100:00100000:2.0:1789760779.625240:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.625435:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565466880 00000100:00100000:1.0:1789760779.625445:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565466880 00000100:00100000:1.0:1789760779.625499:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717861167795 time 717874410502 state 0x0 ref 1 00000100:00100000:1.0:1789760779.625513:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717874670918 time 717874410502 state 0x1 ref 1 00000100:00100000:1.0:1789760779.625576:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717874670918 time 717885867403 state 0x0 ref 1 00000100:00100000:1.0:1789760779.625590:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565466880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.625636:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71577600, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22230 00010000:00010000:1.0:1789760779.625644:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.625659:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.625663:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.625669:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.625682:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.630992:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984783 is committed 00002000:00010000:1.0:1789760779.631105:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71577600 -> 71581696 00002000:00010000:1.0:1789760779.631110:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139824 -> 139832 00010000:00010000:1.0:1789760779.631123:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631140:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631149:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631156:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.631161:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631170:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631189:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.631197:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71577600->71581695] (req 71577600->71581695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.631289:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565466880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5697us (6053us total) trans 4294984783 rc 0/0 00000100:00100000:1.0:1789760779.631300:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17486 00000100:00100000:1.0:1789760779.631309:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717874670918 time 717885867403 state 0x2 ref 0 00000100:00100000:3.0:1789760779.636964:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.637470:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467008 00000100:00100000:1.0:1789760779.637480:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467008 00000100:00100000:1.0:1789760779.637536:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717874670918 time 717885867403 state 0x0 ref 1 00000100:00100000:1.0:1789760779.637551:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717886127819 time 717885867403 state 0x1 ref 1 00000100:00100000:1.0:1789760779.637584:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717886127819 time 717897876199 state 0x0 ref 1 00000100:00100000:1.0:1789760779.637598:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.637644:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71581696, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22238 00010000:00010000:1.0:1789760779.637654:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.637678:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.637683:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.637689:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.637742:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.643011:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984784 is committed 00002000:00010000:1.0:1789760779.643162:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71581696 -> 71585792 00002000:00010000:1.0:1789760779.643167:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139832 -> 139840 00010000:00010000:1.0:1789760779.643180:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643194:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643207:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643214:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.643219:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643233:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643253:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.643261:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71581696->71585791] (req 71581696->71585791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.643410:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5810us (6453us total) trans 4294984784 rc 0/0 00000100:00100000:1.0:1789760779.643421:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17487 00000100:00100000:1.0:1789760779.643430:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717886127819 time 717897876199 state 0x2 ref 0 00000100:00100000:3.0:1789760779.647144:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.647493:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467136 00000100:00100000:0.0:1789760779.647502:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467136 00000100:00100000:0.0:1789760779.647559:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717886127819 time 717897876199 state 0x0 ref 1 00000100:00100000:0.0:1789760779.647574:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717898136615 time 717897876199 state 0x1 ref 1 00000100:00100000:0.0:1789760779.647641:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717898136615 time 717907933182 state 0x0 ref 1 00000100:00100000:0.0:1789760779.647661:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565467136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.647755:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71585792, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22240 00010000:00010000:0.0:1789760779.647765:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.647781:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.647785:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.647791:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.647810:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.651603:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984785 is committed 00002000:00010000:0.0:1789760779.651753:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71585792 -> 71589888 00002000:00010000:0.0:1789760779.651758:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139840 -> 139848 00010000:00010000:0.0:1789760779.651771:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651782:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651790:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651797:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.651802:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651810:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651830:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.651837:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dcf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71585792->71589887] (req 71585792->71589887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.651928:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565467136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4272us (4790us total) trans 4294984785 rc 0/0 00000100:00100000:0.0:1789760779.651939:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17488 00000100:00100000:0.0:1789760779.651948:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717898136615 time 717907933182 state 0x2 ref 0 00000100:00100000:2.0:1789760779.656028:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.656198:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467264 00000100:00100000:1.0:1789760779.656207:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467264 00000100:00100000:1.0:1789760779.656262:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717898136615 time 717907933182 state 0x0 ref 1 00000100:00100000:1.0:1789760779.656278:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717908193598 time 717907933182 state 0x1 ref 1 00000100:00100000:1.0:1789760779.656517:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717908193598 time 717916807722 state 0x0 ref 1 00000100:00100000:1.0:1789760779.656531:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565467264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.656580:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71589888, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22248 00010000:00010000:1.0:1789760779.656588:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.656603:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.656607:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.656613:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.656626:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.661589:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984786 is committed 00002000:00010000:1.0:1789760779.661782:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71589888 -> 71593984 00002000:00010000:1.0:1789760779.661787:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139848 -> 139856 00010000:00010000:1.0:1789760779.661799:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661812:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661821:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661834:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.661838:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661847:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661864:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.661872:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dcfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71589888->71593983] (req 71589888->71593983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.662056:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565467264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5523us (6035us total) trans 4294984786 rc 0/0 00000100:00100000:1.0:1789760779.662078:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17489 00000100:00100000:1.0:1789760779.662088:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717908193598 time 717916807722 state 0x2 ref 0 00000100:00100000:3.0:1789760779.668115:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.668167:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467392 00000100:00100000:1.0:1789760779.668176:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467392 00000100:00100000:1.0:1789760779.668242:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717908193598 time 717916807722 state 0x0 ref 1 00000100:00100000:1.0:1789760779.668257:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717917068138 time 717916807722 state 0x1 ref 1 00000100:00100000:1.0:1789760779.668285:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717917068138 time 717928577130 state 0x0 ref 1 00000100:00100000:1.0:1789760779.668302:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.668346:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71593984, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22250 00010000:00010000:1.0:1789760779.668355:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.668372:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.668376:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.668382:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.668396:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.673350:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984787 is committed 00002000:00010000:0.0:1789760779.673521:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71593984 -> 71598080 00002000:00010000:0.0:1789760779.673526:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139856 -> 139864 00010000:00010000:0.0:1789760779.673540:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673552:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673560:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673568:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.673573:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673582:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673601:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.673615:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674dd01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71593984->71598079] (req 71593984->71598079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.673768:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5460us (5651us total) trans 4294984787 rc 0/0 00000100:00100000:0.0:1789760779.673779:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17490 00000100:00100000:0.0:1789760779.673789:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717917068138 time 717928577130 state 0x2 ref 0 00000100:00100000:3.0:1789760779.676994:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.677125:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467520 00000100:00100000:0.0:1789760779.677135:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467520 00000100:00100000:0.0:1789760779.677193:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717917068138 time 717928577130 state 0x0 ref 1 00000100:00100000:0.0:1789760779.677208:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717928837546 time 717928577130 state 0x1 ref 1 00000100:00100000:0.0:1789760779.677232:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717928837546 time 717937524821 state 0x0 ref 1 00000100:00100000:0.0:1789760779.677245:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.677296:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71598080, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22258 00010000:00010000:0.0:1789760779.677305:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.677320:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.677324:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.677330:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.677349:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.684257:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984788 is committed 00002000:00010000:0.0:1789760779.684426:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71598080 -> 71602176 00002000:00010000:0.0:1789760779.684431:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139864 -> 139872 00010000:00010000:0.0:1789760779.684444:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684457:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684466:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684474:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.684479:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684487:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684508:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.684515:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71598080->71602175] (req 71598080->71602175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.684605:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7357us (7616us total) trans 4294984788 rc 0/0 00000100:00100000:0.0:1789760779.684615:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17491 00000100:00100000:0.0:1789760779.684625:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717928837546 time 717937524821 state 0x2 ref 0 00000100:00100000:2.0:1789760779.691440:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.691669:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467648 00000100:00100000:1.0:1789760779.691679:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467648 00000100:00100000:1.0:1789760779.691836:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717928837546 time 717937524821 state 0x0 ref 1 00000100:00100000:1.0:1789760779.691861:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717937785237 time 717937524821 state 0x1 ref 1 00000100:00100000:1.0:1789760779.691931:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717937785237 time 717952222865 state 0x0 ref 1 00000100:00100000:1.0:1789760779.691946:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.692109:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71602176, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22260 00010000:00010000:1.0:1789760779.692120:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.692135:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.692139:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.692146:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.692159:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.698259:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984789 is committed 00002000:00010000:1.0:1789760779.698371:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71602176 -> 71606272 00002000:00010000:1.0:1789760779.698376:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139872 -> 139880 00010000:00010000:1.0:1789760779.698389:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698401:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698411:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698419:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.698424:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698433:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698452:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.698460:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71602176->71606271] (req 71602176->71606271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.698545:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565467648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6598us (7111us total) trans 4294984789 rc 0/0 00000100:00100000:1.0:1789760779.698554:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17492 00000100:00100000:1.0:1789760779.698564:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717937785237 time 717952222865 state 0x2 ref 0 00000100:00100000:3.0:1789760779.705317:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.706544:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467776 00000100:00100000:0.0:1789760779.706556:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467776 00000100:00100000:0.0:1789760779.706614:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717937785237 time 717952222865 state 0x0 ref 1 00000100:00100000:0.0:1789760779.706631:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717952483281 time 717952222865 state 0x1 ref 1 00000100:00100000:0.0:1789760779.706652:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717952483281 time 717966945151 state 0x0 ref 1 00000100:00100000:0.0:1789760779.706824:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565467776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.706872:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71606272, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22268 00010000:00010000:0.0:1789760779.706881:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.707019:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789760779.707024:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.707030:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.707045:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.713042:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984790 is committed 00002000:00010000:0.0:1789760779.713169:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71606272 -> 71610368 00002000:00010000:0.0:1789760779.713174:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139880 -> 139888 00010000:00010000:0.0:1789760779.713187:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713199:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713208:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713216:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.713221:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713229:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713248:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.713256:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71606272->71610367] (req 71606272->71610367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.713354:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565467776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6530us (8042us total) trans 4294984790 rc 0/0 00000100:00100000:0.0:1789760779.713373:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17493 00000100:00100000:0.0:1789760779.713383:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717952483281 time 717966945151 state 0x2 ref 0 00000100:00100000:0.0:1789760779.719292:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.719434:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565467904 00000100:00100000:2.0:1789760779.719444:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565467904 00000100:00100000:2.0:1789760779.719497:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717952483281 time 717966945151 state 0x0 ref 1 00000100:00100000:2.0:1789760779.719513:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717967205567 time 717966945151 state 0x1 ref 1 00000100:00100000:2.0:1789760779.719548:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717967205567 time 717979840888 state 0x0 ref 1 00000100:00100000:2.0:1789760779.719562:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565467904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.719610:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71610368, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22270 00010000:00010000:2.0:1789760779.719620:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.719636:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1789760779.719640:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.719647:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.719670:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.725525:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984791 is committed 00002000:00010000:2.0:1789760779.726057:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71610368 -> 71614464 00002000:00010000:2.0:1789760779.726062:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139888 -> 139896 00010000:00010000:2.0:1789760779.726076:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726087:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726095:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726112:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.726117:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726126:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726144:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.726151:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674dd1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71610368->71614463] (req 71610368->71614463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.726559:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565467904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6995us (7517us total) trans 4294984791 rc 0/0 00000100:00100000:2.0:1789760779.726571:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17494 00000100:00100000:2.0:1789760779.726580:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717967205567 time 717979840888 state 0x2 ref 0 00000100:00100000:2.0:1789760779.732508:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.732683:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468032 00000100:00100000:1.0:1789760779.732694:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468032 00000100:00100000:1.0:1789760779.732792:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717967205567 time 717979840888 state 0x0 ref 1 00000100:00100000:1.0:1789760779.732807:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717980101304 time 717979840888 state 0x1 ref 1 00000100:00100000:1.0:1789760779.732943:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717980101304 time 717993234089 state 0x0 ref 1 00000100:00100000:1.0:1789760779.732957:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.733003:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71614464, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22278 00010000:00010000:1.0:1789760779.733013:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.733033:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789760779.733038:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.733056:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.733226:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.742268:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984792 is committed 00002000:00010000:1.0:1789760779.742504:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71614464 -> 71618560 00002000:00010000:1.0:1789760779.742510:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139896 -> 139904 00010000:00010000:1.0:1789760779.742523:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742536:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742546:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742553:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.742558:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742567:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742592:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.742599:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71614464->71618559] (req 71614464->71618559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.742691:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9732us (10190us total) trans 4294984792 rc 0/0 00000100:00100000:1.0:1789760779.742996:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17495 00000100:00100000:1.0:1789760779.743005:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717980101304 time 717993234089 state 0x2 ref 0 00000100:00100000:2.0:1789760779.745615:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.746003:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468160 00000100:00100000:0.0:1789760779.746014:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468160 00000100:00100000:0.0:1789760779.746146:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717980101304 time 717993234089 state 0x0 ref 1 00000100:00100000:0.0:1789760779.746162:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717993494505 time 717993234089 state 0x1 ref 1 00000100:00100000:0.0:1789760779.746194:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717993494505 time 718006485848 state 0x0 ref 1 00000100:00100000:0.0:1789760779.746207:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565468160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.746252:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71618560, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22280 00010000:00010000:0.0:1789760779.746262:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.746278:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760779.746283:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.746289:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.746303:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.754148:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984793 is committed 00002000:00010000:0.0:1789760779.754392:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71618560 -> 71622656 00002000:00010000:0.0:1789760779.754397:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139904 -> 139912 00010000:00010000:0.0:1789760779.754409:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754422:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754431:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754438:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.754443:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754452:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754472:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.754479:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674dd2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71618560->71622655] (req 71618560->71622655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.754569:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565468160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8361us (8958us total) trans 4294984793 rc 0/0 00000100:00100000:0.0:1789760779.754580:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17496 00000100:00100000:0.0:1789760779.754590:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717993494505 time 718006485848 state 0x2 ref 0 00000100:00100000:0.0:1789760779.764414:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.765221:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468288 00000100:00100000:2.0:1789760779.765233:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468288 00000100:00100000:2.0:1789760779.765290:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 717993494505 time 718006485848 state 0x0 ref 1 00000100:00100000:2.0:1789760779.765310:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718006746264 time 718006485848 state 0x1 ref 1 00000100:00100000:2.0:1789760779.765346:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718006746264 time 718025634518 state 0x0 ref 1 00000100:00100000:2.0:1789760779.765363:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.765414:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71622656, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22288 00010000:00010000:2.0:1789760779.765423:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.765438:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.765447:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.765453:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.765471:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.776838:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984794 is committed 00002000:00010000:0.0:1789760779.777074:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71622656 -> 71626752 00002000:00010000:0.0:1789760779.777079:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139912 -> 139920 00010000:00010000:0.0:1789760779.777091:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777104:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777113:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777120:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.777124:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777133:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777152:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.777159:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674dd32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71622656->71626751] (req 71622656->71626751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.777245:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11881us (12839us total) trans 4294984794 rc 0/0 00000100:00100000:0.0:1789760779.777255:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17497 00000100:00100000:0.0:1789760779.777265:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718006746264 time 718025634518 state 0x2 ref 0 00000100:00100000:2.0:1789760779.782366:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.782530:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468416 00000100:00100000:1.0:1789760779.782542:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468416 00000100:00100000:1.0:1789760779.782596:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718006746264 time 718025634518 state 0x0 ref 1 00000100:00100000:1.0:1789760779.782611:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718025894934 time 718025634518 state 0x1 ref 1 00000100:00100000:1.0:1789760779.782942:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718025894934 time 718043231801 state 0x0 ref 1 00000100:00100000:1.0:1789760779.782958:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.783008:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71626752, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22290 00010000:00010000:1.0:1789760779.783017:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.783033:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760779.783037:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.783056:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.783231:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.790541:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984795 is committed 00002000:00010000:1.0:1789760779.790852:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71626752 -> 71630848 00002000:00010000:1.0:1789760779.790858:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139920 -> 139928 00010000:00010000:1.0:1789760779.790872:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790883:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790892:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790899:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.790904:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790913:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790932:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.790944:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71626752->71630847] (req 71626752->71630847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.791035:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8076us (8673us total) trans 4294984795 rc 0/0 00000100:00100000:1.0:1789760779.791045:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17498 00000100:00100000:1.0:1789760779.791056:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718025894934 time 718043231801 state 0x2 ref 0 00000100:00100000:2.0:1789760779.794801:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.795351:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468544 00000100:00100000:0.0:1789760779.795362:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468544 00000100:00100000:0.0:1789760779.795419:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718025894934 time 718043231801 state 0x0 ref 1 00000100:00100000:0.0:1789760779.795434:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718043492217 time 718043231801 state 0x1 ref 1 00000100:00100000:0.0:1789760779.795512:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718043492217 time 718055802201 state 0x0 ref 1 00000100:00100000:0.0:1789760779.795525:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565468544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.795573:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71630848, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x22298 00010000:00010000:0.0:1789760779.795585:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.795600:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760779.795606:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.795612:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.795626:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.800758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984796 is committed 00002000:00010000:0.0:1789760779.800948:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71630848 -> 71634944 00002000:00010000:0.0:1789760779.800954:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139928 -> 139936 00010000:00010000:0.0:1789760779.800968:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.800981:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.800989:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.800996:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.801000:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.801008:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.801027:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.801039:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674dd40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71630848->71634943] (req 71630848->71634943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.801635:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565468544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6106us (6836us total) trans 4294984796 rc 0/0 00000100:00100000:0.0:1789760779.801647:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17499 00000100:00100000:0.0:1789760779.801656:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718043492217 time 718055802201 state 0x2 ref 0 00000100:00100000:0.0:1789760779.809458:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.809554:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468672 00000100:00100000:2.0:1789760779.809563:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468672 00000100:00100000:2.0:1789760779.809614:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718043492217 time 718055802201 state 0x0 ref 1 00000100:00100000:2.0:1789760779.809629:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718056062617 time 718055802201 state 0x1 ref 1 00000100:00100000:2.0:1789760779.809696:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718056062617 time 718069987459 state 0x0 ref 1 00000100:00100000:2.0:1789760779.809754:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565468672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.809798:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71634944, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222a0 00010000:00010000:2.0:1789760779.809808:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.809823:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.809828:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.809835:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.809849:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.816471:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984797 is committed 00002000:00010000:2.0:1789760779.816594:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71634944 -> 71639040 00002000:00010000:2.0:1789760779.816599:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139936 -> 139944 00010000:00010000:2.0:1789760779.816614:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816627:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816636:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816649:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.816654:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816663:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816684:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.816692:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71634944->71639039] (req 71634944->71639039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.816859:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565468672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7104us (7405us total) trans 4294984797 rc 0/0 00000100:00100000:2.0:1789760779.816870:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17500 00000100:00100000:2.0:1789760779.816878:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718056062617 time 718069987459 state 0x2 ref 0 00000100:00100000:2.0:1789760779.821509:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.821574:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468800 00000100:00100000:1.0:1789760779.821582:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468800 00000100:00100000:1.0:1789760779.821633:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718056062617 time 718069987459 state 0x0 ref 1 00000100:00100000:1.0:1789760779.821645:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718070247875 time 718069987459 state 0x1 ref 1 00000100:00100000:1.0:1789760779.821680:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718070247875 time 718081972069 state 0x0 ref 1 00000100:00100000:1.0:1789760779.821693:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.821794:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71639040, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222a8 00010000:00010000:1.0:1789760779.821803:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.821817:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760779.821821:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.821827:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.821845:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.826523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984798 is committed 00002000:00010000:1.0:1789760779.827320:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71639040 -> 71643136 00002000:00010000:1.0:1789760779.827326:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139944 -> 139952 00010000:00010000:1.0:1789760779.827340:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827353:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827363:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827370:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.827375:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827385:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827404:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.827412:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674dd4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71639040->71643135] (req 71639040->71643135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.827539:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565468800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5843us (6034us total) trans 4294984798 rc 0/0 00000100:00100000:1.0:1789760779.827550:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17501 00000100:00100000:1.0:1789760779.827560:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718070247875 time 718081972069 state 0x2 ref 0 00000100:00100000:0.0:1789760779.834510:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.834774:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565468928 00000100:00100000:2.0:1789760779.834784:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565468928 00000100:00100000:2.0:1789760779.834836:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718070247875 time 718081972069 state 0x0 ref 1 00000100:00100000:2.0:1789760779.834851:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718082232485 time 718081972069 state 0x1 ref 1 00000100:00100000:2.0:1789760779.834886:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718082232485 time 718095177227 state 0x0 ref 1 00000100:00100000:2.0:1789760779.834900:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565468928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.834946:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71643136, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222b0 00010000:00010000:2.0:1789760779.834954:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.834969:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.834973:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.834979:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.834993:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.841849:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984799 is committed 00002000:00010000:2.0:1789760779.841993:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71643136 -> 71647232 00002000:00010000:2.0:1789760779.841998:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139952 -> 139960 00010000:00010000:2.0:1789760779.842010:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842023:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842032:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842039:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.842045:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842055:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842085:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.842093:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71643136->71647231] (req 71643136->71647231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.842190:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565468928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7288us (7686us total) trans 4294984799 rc 0/0 00000100:00100000:2.0:1789760779.842211:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17502 00000100:00100000:2.0:1789760779.842222:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718082232485 time 718095177227 state 0x2 ref 0 00000100:00100000:0.0:1789760779.848602:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.848695:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469056 00000100:00100000:2.0:1789760779.848744:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469056 00000100:00100000:2.0:1789760779.848799:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718082232485 time 718095177227 state 0x0 ref 1 00000100:00100000:2.0:1789760779.848815:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718095437643 time 718095177227 state 0x1 ref 1 00000100:00100000:2.0:1789760779.848837:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718095437643 time 718109129591 state 0x0 ref 1 00000100:00100000:2.0:1789760779.848849:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.848895:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71647232, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222b8 00010000:00010000:2.0:1789760779.848905:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.848920:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.848924:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.848930:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.848944:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.853542:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984800 is committed 00002000:00010000:2.0:1789760779.853654:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71647232 -> 71651328 00002000:00010000:2.0:1789760779.853659:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139960 -> 139968 00010000:00010000:2.0:1789760779.853671:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853683:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853691:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853699:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.853732:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853741:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853761:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.853777:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71647232->71651327] (req 71647232->71651327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.854015:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5162us (5417us total) trans 4294984800 rc 0/0 00000100:00100000:2.0:1789760779.854025:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17503 00000100:00100000:2.0:1789760779.854035:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718095437643 time 718109129591 state 0x2 ref 0 00000100:00100000:1.0:1789760779.861905:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.862393:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469184 00000100:00100000:2.0:1789760779.862402:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469184 00000100:00100000:2.0:1789760779.862600:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718095437643 time 718109129591 state 0x0 ref 1 00000100:00100000:2.0:1789760779.862618:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718109390007 time 718109129591 state 0x1 ref 1 00000100:00100000:2.0:1789760779.862680:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718109390007 time 718122972274 state 0x0 ref 1 00000100:00100000:2.0:1789760779.862692:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565469184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.862767:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71651328, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222c0 00010000:00010000:2.0:1789760779.862777:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.862791:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.862796:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.862802:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.862815:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760779.868084:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984801 is committed 00002000:00010000:2.0:1789760779.868191:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71651328 -> 71655424 00002000:00010000:2.0:1789760779.868197:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139968 -> 139976 00010000:00010000:2.0:1789760779.868215:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868227:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868239:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868245:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760779.868248:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868254:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868273:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.868289:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71651328->71655423] (req 71651328->71655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.868398:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565469184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5703us (6497us total) trans 4294984801 rc 0/0 00000100:00100000:2.0:1789760779.868409:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17504 00000100:00100000:2.0:1789760779.868417:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718109390007 time 718122972274 state 0x2 ref 0 00000100:00100000:0.0:1789760779.878239:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.878463:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469312 00000100:00100000:2.0:1789760779.878472:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469312 00000100:00100000:2.0:1789760779.878525:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718109390007 time 718122972274 state 0x0 ref 1 00000100:00100000:2.0:1789760779.878541:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718123232690 time 718122972274 state 0x1 ref 1 00000100:00100000:2.0:1789760779.878572:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718123232690 time 718138864381 state 0x0 ref 1 00000100:00100000:2.0:1789760779.878584:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.878633:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71655424, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222c8 00010000:00010000:2.0:1789760779.878642:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.878657:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.878661:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.878667:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.878685:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.882795:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984802 is committed 00002000:00010000:0.0:1789760779.882941:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71655424 -> 71659520 00002000:00010000:0.0:1789760779.882947:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139976 -> 139984 00010000:00010000:0.0:1789760779.882959:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.882972:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.882982:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.882989:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.882994:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.883003:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.883029:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.883037:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674dd6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71655424->71659519] (req 71655424->71659519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.883188:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4601us (4954us total) trans 4294984802 rc 0/0 00000100:00100000:0.0:1789760779.883198:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17505 00000100:00100000:0.0:1789760779.883208:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718123232690 time 718138864381 state 0x2 ref 0 00000100:00100000:0.0:1789760779.887452:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.889440:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469440 00000100:00100000:2.0:1789760779.889454:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469440 00000100:00100000:2.0:1789760779.889635:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718123232690 time 718138864381 state 0x0 ref 1 00000100:00100000:2.0:1789760779.889651:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718139124797 time 718138864381 state 0x1 ref 1 00000100:00100000:2.0:1789760779.889752:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718139124797 time 718150043025 state 0x0 ref 1 00000100:00100000:2.0:1789760779.889765:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565469440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760779.890037:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71659520, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222d0 00010000:00010000:2.0:1789760779.890045:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.890057:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760779.890060:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.890066:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.890080:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.894087:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984803 is committed 00002000:00010000:0.0:1789760779.894275:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71659520 -> 71663616 00002000:00010000:0.0:1789760779.894280:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139984 -> 139992 00010000:00010000:0.0:1789760779.894294:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894306:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894316:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894323:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.894329:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894339:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894358:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.894367:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674dd71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71659520->71663615] (req 71659520->71663615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.894492:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565469440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4725us (7043us total) trans 4294984803 rc 0/0 00000100:00100000:0.0:1789760779.894510:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17506 00000100:00100000:0.0:1789760779.894519:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718139124797 time 718150043025 state 0x2 ref 0 00000100:00100000:1.0:1789760779.902461:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760779.902684:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469568 00000100:00100000:2.0:1789760779.902694:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469568 00000100:00100000:3.0:1789760779.903265:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718139124797 time 718150043025 state 0x0 ref 1 00000100:00100000:3.0:1789760779.903280:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718150303441 time 718150043025 state 0x1 ref 1 00000100:00100000:3.0:1789760779.903313:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718150303441 time 718163604581 state 0x0 ref 1 00000100:00100000:3.0:1789760779.903325:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760779.903371:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71663616, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222d8 00010000:00010000:3.0:1789760779.903380:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.903393:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1789760779.903457:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760779.903465:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.903480:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.909810:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984804 is committed 00002000:00010000:1.0:1789760779.910069:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71663616 -> 71667712 00002000:00010000:1.0:1789760779.910075:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139992 -> 140000 00010000:00010000:1.0:1789760779.910088:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910101:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910110:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910117:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.910122:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910132:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910155:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.910163:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674dd78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71663616->71667711] (req 71663616->71667711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.910416:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7087us (7959us total) trans 4294984804 rc 0/0 00000100:00100000:1.0:1789760779.910426:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17507 00000100:00100000:1.0:1789760779.910435:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718150303441 time 718163604581 state 0x2 ref 0 00000100:00100000:2.0:1789760779.924279:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.924335:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469696 00000100:00100000:0.0:1789760779.924344:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469696 00000100:00100000:0.0:1789760779.924389:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718150303441 time 718163604581 state 0x0 ref 1 00000100:00100000:0.0:1789760779.924410:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718163864997 time 718163604581 state 0x1 ref 1 00000100:00100000:0.0:1789760779.924429:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718163864997 time 718184722105 state 0x0 ref 1 00000100:00100000:0.0:1789760779.924437:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.924493:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71667712, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222e0 00010000:00010000:0.0:1789760779.924623:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.924640:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760779.924645:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.924651:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.924665:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760779.929767:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984805 is committed 00002000:00010000:1.0:1789760779.929950:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71667712 -> 71671808 00002000:00010000:1.0:1789760779.929956:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140000 -> 140008 00010000:00010000:1.0:1789760779.929970:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.929983:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.929991:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.929998:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.930003:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.930018:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.930036:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.930044:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674dd7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71667712->71671807] (req 71667712->71671807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.930772:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6327us (6494us total) trans 4294984805 rc 0/0 00000100:00100000:1.0:1789760779.930785:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17508 00000100:00100000:1.0:1789760779.930795:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718163864997 time 718184722105 state 0x2 ref 0 00000100:00100000:1.0:1789760779.940907:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760779.941494:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469824 00000100:00100000:0.0:1789760779.941504:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469824 00000100:00100000:0.0:1789760779.941562:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718163864997 time 718184722105 state 0x0 ref 1 00000100:00100000:0.0:1789760779.941577:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718184982521 time 718184722105 state 0x1 ref 1 00000100:00100000:0.0:1789760779.941614:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718184982521 time 718201905714 state 0x0 ref 1 00000100:00100000:0.0:1789760779.941699:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760779.941847:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71671808, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0x222e8 00010000:00010000:0.0:1789760779.941857:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.941872:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760779.941876:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.941883:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.941903:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.954688:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984806 is committed 00002000:00010000:0.0:1789760779.954920:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71671808 -> 71675904 00002000:00010000:0.0:1789760779.954924:0:6957:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760779 -> 1789760780 00002000:00010000:0.0:1789760779.954927:0:6957:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760779 -> 1789760780 00002000:00010000:0.0:1789760779.954929:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140008 -> 140016 00010000:00010000:0.0:1789760779.954943:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.954955:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.954963:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.954970:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760779.954975:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.954983:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.955003:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.955016:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71671808->71675903] (req 71671808->71675903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.955212:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565469824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13575us (14301us total) trans 4294984806 rc 0/0 00000100:00100000:0.0:1789760779.955223:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17509 00000100:00100000:0.0:1789760779.955232:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718184982521 time 718201905714 state 0x2 ref 0 00000100:00100000:2.0:1789760779.963027:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.963204:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565469952 00000100:00100000:1.0:1789760779.963214:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565469952 00000100:00100000:1.0:1789760779.963267:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718184982521 time 718201905714 state 0x0 ref 1 00000100:00100000:1.0:1789760779.963282:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718202166130 time 718201905714 state 0x1 ref 1 00000100:00100000:1.0:1789760779.963314:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718202166130 time 718223606370 state 0x0 ref 1 00000100:00100000:1.0:1789760779.963327:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565469952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.963375:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71675904, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x222f0 00010000:00010000:1.0:1789760779.963391:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.963407:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760779.963412:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.963418:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.963432:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760779.976059:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984807 is committed 00002000:00010000:3.0:1789760779.976291:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71675904 -> 71680000 00002000:00010000:3.0:1789760779.976296:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140016 -> 140024 00010000:00010000:3.0:1789760779.976309:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976320:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976328:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976335:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760779.976339:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976346:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976365:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760779.976372:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674dd8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71675904->71679999] (req 71675904->71679999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760779.976628:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565469952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13297us (13603us total) trans 4294984807 rc 0/0 00000100:00100000:3.0:1789760779.976639:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17510 00000100:00100000:3.0:1789760779.976649:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718202166130 time 718223606370 state 0x2 ref 0 00000100:00100000:2.0:1789760779.983603:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760779.983697:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470080 00000100:00100000:1.0:1789760779.983890:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470080 00000100:00100000:1.0:1789760779.983955:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718202166130 time 718223606370 state 0x0 ref 1 00000100:00100000:1.0:1789760779.983969:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718223866786 time 718223606370 state 0x1 ref 1 00000100:00100000:1.0:1789760779.984033:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718223866786 time 718244324719 state 0x0 ref 1 00000100:00100000:1.0:1789760779.984045:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565470080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760779.984106:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71680000, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x222f8 00010000:00010000:1.0:1789760779.984115:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.984131:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760779.984135:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760779.984141:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.984154:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760779.991252:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984808 is committed 00002000:00010000:1.0:1789760779.991430:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71680000 -> 71684096 00002000:00010000:1.0:1789760779.991435:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140024 -> 140032 00010000:00010000:1.0:1789760779.991450:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991463:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991472:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991481:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760779.991486:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991495:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991515:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.991526:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674dd94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71680000->71684095] (req 71680000->71684095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.991613:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565470080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7564us (8013us total) trans 4294984808 rc 0/0 00000100:00100000:1.0:1789760779.991626:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17511 00000100:00100000:1.0:1789760779.991636:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718223866786 time 718244324719 state 0x2 ref 0 00000100:00100000:1.0:1789760780.001036:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.001212:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470208 00000100:00100000:0.0:1789760780.001222:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470208 00000100:00100000:0.0:1789760780.001299:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718223866786 time 718244324719 state 0x0 ref 1 00000100:00100000:0.0:1789760780.001316:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718244585135 time 718244324719 state 0x1 ref 1 00000100:00100000:0.0:1789760780.001350:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718244585135 time 718261642404 state 0x0 ref 1 00000100:00100000:0.0:1789760780.001364:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.001424:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71684096, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22300 00010000:00010000:0.0:1789760780.001434:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.001451:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.001455:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.001461:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.001481:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760780.002111:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789760780.010026:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984809 is committed 00002000:00010000:0.0:1789760780.010267:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71684096 -> 71688192 00002000:00010000:0.0:1789760780.010272:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140032 -> 140040 00010000:00010000:0.0:1789760780.010286:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010299:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010309:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010317:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.010322:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010331:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010351:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.010359:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dd9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71684096->71688191] (req 71684096->71688191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.010498:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9131us (9467us total) trans 4294984809 rc 0/0 00000100:00100000:0.0:1789760780.010509:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17512 00000100:00100000:0.0:1789760780.010517:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718244585135 time 718261642404 state 0x2 ref 0 00000100:00100000:2.0:1789760780.020583:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760780.021498:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470336 00000100:00100000:3.0:1789760780.021510:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470336 00000100:00100000:2.0:1789760780.021634:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718244585135 time 718261642404 state 0x0 ref 1 00000100:00100000:2.0:1789760780.021659:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718261902820 time 718261642404 state 0x1 ref 1 00000100:00100000:2.0:1789760780.021688:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718261902820 time 718281980299 state 0x0 ref 1 00000100:00100000:2.0:1789760780.021700:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565470336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.021778:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71688192, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22308 00010000:00010000:2.0:1789760780.021788:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.021802:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.021807:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.021813:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.021833:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.028785:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984810 is committed 00002000:00010000:2.0:1789760780.028958:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71688192 -> 71692288 00002000:00010000:2.0:1789760780.028964:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140040 -> 140048 00010000:00010000:2.0:1789760780.028979:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.028993:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.029003:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.029010:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.029015:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.029024:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.029047:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.029056:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674dda2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71688192->71692287] (req 71688192->71692287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.029222:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565470336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7518us (8642us total) trans 4294984810 rc 0/0 00000100:00100000:2.0:1789760780.029234:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17513 00000100:00100000:2.0:1789760780.029244:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718261902820 time 718281980299 state 0x2 ref 0 00000100:00100000:2.0:1789760780.041426:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.041682:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470464 00000100:00100000:1.0:1789760780.041691:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470464 00000100:00100000:0.0:1789760780.042036:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718261902820 time 718281980299 state 0x0 ref 1 00000100:00100000:0.0:1789760780.042053:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718282240715 time 718281980299 state 0x1 ref 1 00000100:00100000:0.0:1789760780.042088:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718282240715 time 718302379670 state 0x0 ref 1 00000100:00100000:0.0:1789760780.042104:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.042157:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71692288, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22310 00010000:00010000:0.0:1789760780.042166:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.042182:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.042187:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.042193:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.042322:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.043866:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:769fd61a-9f51-46fc-af80-467e2ca172bc:3458:1876699580066304:0@lo:400:kworker.0 00000100:00100000:3.0:1789760780.043890:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580066432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760780.043970:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760780.044023:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699580066560:0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.044191:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760780.044246:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3458:1876699580066816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.044275:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760780.044310:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066304 00000100:00100000:1.0:1789760780.044320:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066304 00000100:00100000:1.0:1789760780.044360:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789760780.044367:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3458:x1876699580066304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.044421:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3458:x1876699580066304:12345-0@lo:400:kworker.0 Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760780.044427:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789760780.044454:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066816 00000100:00100000:1.0:1789760780.044458:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066816 00000100:00100000:1.0:1789760780.044486:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1789760780.046190:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1876699580066816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.046280:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1876699580066816:12345-0@lo:400:kworker.0 Request processed in 1787us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760780.046290:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:1.0:1789760780.046332:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760780.046383:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3458:1876699580066816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.046396:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:769fd61a-9f51-46fc-af80-467e2ca172bc:3458:1876699580066304:0@lo:400:kworker.0 00000100:00100000:2.0:1789760780.046576:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760780.046606:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6cce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066688:0@lo:400:kworker.0 00000100:00100000:2.0:1789760780.046632:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760780.046670:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066688 00000100:00100000:2.0:1789760780.046675:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066688 00000100:00100000:2.0:1789760780.046745:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760780.046753:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760780.046792:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066688:12345-0@lo:400:kworker.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760780.046798:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760780.046829:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6cce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066688:0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.047030:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066176 00000100:00100000:1.0:1789760780.047034:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066176 00000100:00100000:1.0:1789760780.047074:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789760780.047082:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760780.047105:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760780.047146:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580066176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760780.047152:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1789760780.047167:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760780.047170:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760780.047192:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580066176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760780.047859:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760780.047892:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580066944:0@lo:400:kworker.0 00000100:00100000:3.0:1789760780.047982:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760780.048016:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066944 00000100:00100000:3.0:1789760780.048020:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066944 00000100:00100000:3.0:1789760780.048045:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789760780.048051:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580066944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760780.048153:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580066944:12345-0@lo:400:kworker.0 Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760780.048160:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789760780.048187:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580066944:0@lo:400:kworker.0 00000100:00100000:0.0:1789760780.048378:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760780.048451:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066432 00000100:00100000:3.0:1789760780.048456:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066432 00000100:00100000:3.0:1789760780.048485:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580066560 00000100:00100000:3.0:1789760780.048488:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580066560 00000100:00100000:3.0:1789760780.048513:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789760780.048520:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580066432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760780.048557:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580066432:12345-0@lo:400:kworker.0 Request processed in 38us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760780.048562:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789760780.048576:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.048616:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580066560:12345-0@lo:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760780.048633:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699580066560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760780.048691:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789760780.048778:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580066432:0@lo:400:kworker.0 00000100:00100000:1.0:1789760780.048823:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:1.0:1789760780.048841:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789760780.050136:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984811 is committed 00002000:00010000:2.0:1789760780.050339:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71692288 -> 71696384 00002000:00010000:2.0:1789760780.050344:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140048 -> 140056 00010000:00010000:2.0:1789760780.050356:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050378:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050388:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050396:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.050401:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050409:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050428:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.050436:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674dda9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71692288->71696383] (req 71692288->71696383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.050518:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8416us (9107us total) trans 4294984811 rc 0/0 00000100:00100000:2.0:1789760780.050528:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17514 00000100:00100000:2.0:1789760780.050537:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718282240715 time 718302379670 state 0x2 ref 0 00000100:00100000:0.0:1789760780.054238:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.055054:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470592 00000100:00100000:2.0:1789760780.055064:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470592 00000100:00100000:2.0:1789760780.055118:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718282240715 time 718302379670 state 0x0 ref 1 00000100:00100000:2.0:1789760780.055132:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718302640086 time 718302379670 state 0x1 ref 1 00000100:00100000:2.0:1789760780.055196:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718302640086 time 718315487736 state 0x0 ref 1 00000100:00100000:2.0:1789760780.055210:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.055256:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71696384, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22318 00010000:00010000:2.0:1789760780.055265:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.055279:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.055283:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.055290:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.055303:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.061093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984812 is committed 00002000:00010000:2.0:1789760780.061190:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71696384 -> 71700480 00002000:00010000:2.0:1789760780.061195:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140056 -> 140064 00010000:00010000:2.0:1789760780.061208:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061221:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061234:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061241:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.061246:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061254:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061274:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.061281:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71696384->71700479] (req 71696384->71700479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.061376:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6164us (7143us total) trans 4294984812 rc 0/0 00000100:00100000:2.0:1789760780.061386:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17515 00000100:00100000:2.0:1789760780.061396:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718302640086 time 718315487736 state 0x2 ref 0 00000100:00100000:1.0:1789760780.069236:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.069339:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470720 00000100:00100000:2.0:1789760780.069349:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470720 00000100:00100000:2.0:1789760780.069400:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718302640086 time 718315487736 state 0x0 ref 1 00000100:00100000:2.0:1789760780.069415:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718315748152 time 718315487736 state 0x1 ref 1 00000100:00100000:2.0:1789760780.069451:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718315748152 time 718329742875 state 0x0 ref 1 00000100:00100000:2.0:1789760780.069464:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.069510:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71700480, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22320 00010000:00010000:2.0:1789760780.069520:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.069536:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.069541:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.069547:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.069562:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.077206:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984813 is committed 00002000:00010000:2.0:1789760780.077329:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71700480 -> 71704576 00002000:00010000:2.0:1789760780.077334:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140064 -> 140072 00010000:00010000:2.0:1789760780.077347:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077358:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077366:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077377:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.077381:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077389:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077407:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.077415:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71700480->71704575] (req 71700480->71704575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.077623:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565470720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8156us (8393us total) trans 4294984813 rc 0/0 00000100:00100000:2.0:1789760780.077634:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17516 00000100:00100000:2.0:1789760780.077645:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718315748152 time 718329742875 state 0x2 ref 0 00000100:00100000:3.0:1789760780.086596:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.087032:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470848 00000100:00100000:2.0:1789760780.087041:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470848 00000100:00100000:2.0:1789760780.087093:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718315748152 time 718329742875 state 0x0 ref 1 00000100:00100000:2.0:1789760780.087108:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718330003291 time 718329742875 state 0x1 ref 1 00000100:00100000:2.0:1789760780.087138:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718330003291 time 718347430439 state 0x0 ref 1 00000100:00100000:2.0:1789760780.087153:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565470848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.087204:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71704576, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22328 00010000:00010000:2.0:1789760780.087214:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.087228:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.087232:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.087238:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.087252:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.092376:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984814 is committed 00002000:00010000:2.0:1789760780.093603:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71704576 -> 71708672 00002000:00010000:2.0:1789760780.093610:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140072 -> 140080 00010000:00010000:2.0:1789760780.093622:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093634:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093642:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093649:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.093655:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093664:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093684:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.093692:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71704576->71708671] (req 71704576->71708671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.093813:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565470848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6657us (7222us total) trans 4294984814 rc 0/0 00000100:00100000:2.0:1789760780.093824:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17517 00000100:00100000:2.0:1789760780.093833:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718330003291 time 718347430439 state 0x2 ref 0 00000100:00100000:1.0:1789760780.101187:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.101356:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565470976 00000100:00100000:2.0:1789760780.101364:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565470976 00000100:00100000:2.0:1789760780.101487:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718330003291 time 718347430439 state 0x0 ref 1 00000100:00100000:2.0:1789760780.101909:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718347690855 time 718347430439 state 0x1 ref 1 00000100:00100000:1.0:1789760780.102005:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718347690855 time 718362295249 state 0x0 ref 1 00000100:00100000:1.0:1789760780.102021:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565470976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.102070:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71708672, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22330 00010000:00010000:1.0:1789760780.102079:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.102094:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.102098:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.102104:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.102119:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.109890:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984815 is committed 00002000:00010000:1.0:1789760780.110264:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71708672 -> 71712768 00002000:00010000:1.0:1789760780.110269:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140080 -> 140088 00010000:00010000:1.0:1789760780.110283:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110294:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110302:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110315:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.110320:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110329:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110348:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.110357:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ddc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71708672->71712767] (req 71708672->71712767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.112249:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565470976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10227us (11066us total) trans 4294984815 rc 0/0 00000100:00100000:1.0:1789760780.112262:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17518 00000100:00100000:1.0:1789760780.112271:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718347690855 time 718362295249 state 0x2 ref 0 00000100:00100000:3.0:1789760780.118159:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.118449:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471104 00000100:00100000:2.0:1789760780.118459:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471104 00000100:00100000:2.0:1789760780.118516:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718347690855 time 718362295249 state 0x0 ref 1 00000100:00100000:2.0:1789760780.118531:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718362555665 time 718362295249 state 0x1 ref 1 00000100:00100000:2.0:1789760780.118569:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718362555665 time 718378858812 state 0x0 ref 1 00000100:00100000:2.0:1789760780.118580:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.118624:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71712768, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22338 00010000:00010000:2.0:1789760780.118633:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.118649:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.118660:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.118667:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.118682:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.127026:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984816 is committed 00002000:00010000:3.0:1789760780.128631:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71712768 -> 71716864 00002000:00010000:3.0:1789760780.128640:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140088 -> 140096 00010000:00010000:3.0:1789760780.128654:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.128667:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.128677:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.128685:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.128689:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.129339:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.129363:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.129371:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674ddcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71712768->71716863] (req 71712768->71716863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.129545:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10961us (11482us total) trans 4294984816 rc 0/0 00000100:00100000:3.0:1789760780.129556:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17519 00000100:00100000:3.0:1789760780.129566:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718362555665 time 718378858812 state 0x2 ref 0 00000100:00100000:3.0:1789760780.141985:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.142390:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471232 00000100:00100000:2.0:1789760780.142400:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471232 00000100:00100000:2.0:1789760780.142452:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718362555665 time 718378858812 state 0x0 ref 1 00000100:00100000:2.0:1789760780.142469:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718379119228 time 718378858812 state 0x1 ref 1 00000100:00100000:2.0:1789760780.142551:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718379119228 time 718402842312 state 0x0 ref 1 00000100:00100000:2.0:1789760780.142564:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.142612:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71716864, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22340 00010000:00010000:2.0:1789760780.142622:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.142638:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.142642:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.142649:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.142672:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.148884:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984817 is committed 00002000:00010000:2.0:1789760780.153383:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71716864 -> 71720960 00002000:00010000:2.0:1789760780.153393:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140096 -> 140104 00010000:00010000:2.0:1789760780.153408:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153422:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153433:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153441:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.153446:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153456:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153476:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.153485:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ddd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71716864->71720959] (req 71716864->71720959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.153589:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11022us (11610us total) trans 4294984817 rc 0/0 00000100:00100000:2.0:1789760780.153600:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17520 00000100:00100000:2.0:1789760780.153611:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718379119228 time 718402842312 state 0x2 ref 0 00000100:00100000:1.0:1789760780.161968:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760780.168295:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471360 00000100:00100000:3.0:1789760780.168310:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471360 00000100:00100000:3.0:1789760780.168373:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718379119228 time 718402842312 state 0x0 ref 1 00000100:00100000:3.0:1789760780.168388:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718403102728 time 718402842312 state 0x1 ref 1 00000100:00100000:3.0:1789760780.168469:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718403102728 time 718428761359 state 0x0 ref 1 00000100:00100000:3.0:1789760780.168483:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565471360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760780.168527:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71720960, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22348 00010000:00010000:3.0:1789760780.168537:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.168554:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1789760780.168558:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760780.168564:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.168578:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.174303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984818 is committed 00002000:00010000:3.0:1789760780.174413:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71720960 -> 71725056 00002000:00010000:3.0:1789760780.174418:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140104 -> 140112 00010000:00010000:3.0:1789760780.174431:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174444:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174454:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174462:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.174467:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174477:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174497:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.174506:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71720960->71725055] (req 71720960->71725055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.174601:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565471360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6116us (12638us total) trans 4294984818 rc 0/0 00000100:00100000:3.0:1789760780.174611:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17521 00000100:00100000:3.0:1789760780.174621:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718403102728 time 718428761359 state 0x2 ref 0 00000100:00100000:3.0:1789760780.181477:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.181948:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471488 00000100:00100000:1.0:1789760780.181958:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471488 00000100:00100000:1.0:1789760780.182014:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718403102728 time 718428761359 state 0x0 ref 1 00000100:00100000:1.0:1789760780.182030:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718429021775 time 718428761359 state 0x1 ref 1 00000100:00100000:3.0:1789760780.182156:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718429021775 time 718442444121 state 0x0 ref 1 00000100:00100000:3.0:1789760780.182190:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760780.182245:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71725056, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22350 00010000:00010000:3.0:1789760780.182255:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.182272:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1789760780.182276:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760780.182283:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.182296:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.187696:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984819 is committed 00002000:00010000:3.0:1789760780.188735:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71725056 -> 71729152 00002000:00010000:3.0:1789760780.188742:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140112 -> 140120 00010000:00010000:3.0:1789760780.188756:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188768:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188777:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188784:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.188789:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188797:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188815:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.188822:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674dde1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71725056->71729151] (req 71725056->71729151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.188919:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565471488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6736us (7446us total) trans 4294984819 rc 0/0 00000100:00100000:3.0:1789760780.188930:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17522 00000100:00100000:3.0:1789760780.188938:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718429021775 time 718442444121 state 0x2 ref 0 00000100:00100000:2.0:1789760780.192066:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.192211:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471616 00000100:00100000:0.0:1789760780.192221:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471616 00000100:00100000:0.0:1789760780.192281:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718429021775 time 718442444121 state 0x0 ref 1 00000100:00100000:0.0:1789760780.192296:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718442704537 time 718442444121 state 0x1 ref 1 00000100:00100000:0.0:1789760780.192330:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718442704537 time 718452622131 state 0x0 ref 1 00000100:00100000:0.0:1789760780.192343:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565471616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.192394:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71729152, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22358 00010000:00010000:0.0:1789760780.192403:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.192419:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.192424:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.192431:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.192451:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.198831:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984820 is committed 00002000:00010000:0.0:1789760780.199005:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71729152 -> 71733248 00002000:00010000:0.0:1789760780.199010:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140120 -> 140128 00010000:00010000:0.0:1789760780.199024:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199038:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199047:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199055:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.199060:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199070:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199094:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.199102:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674dde8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71729152->71733247] (req 71729152->71733247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.199254:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565471616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6908us (7192us total) trans 4294984820 rc 0/0 00000100:00100000:0.0:1789760780.199270:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17523 00000100:00100000:0.0:1789760780.199280:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718442704537 time 718452622131 state 0x2 ref 0 00000100:00100000:1.0:1789760780.206496:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760780.206583:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471744 00000100:00100000:3.0:1789760780.206592:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471744 00000100:00100000:3.0:1789760780.206643:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718442704537 time 718452622131 state 0x0 ref 1 00000100:00100000:3.0:1789760780.206658:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718452882547 time 718452622131 state 0x1 ref 1 00000100:00100000:3.0:1789760780.206690:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718452882547 time 718466981477 state 0x0 ref 1 00000100:00100000:3.0:1789760780.206747:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565471744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760780.206803:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71733248, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22360 00010000:00010000:3.0:1789760780.206813:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.206828:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1789760780.206833:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760780.206840:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.206853:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.214367:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984821 is committed 00002000:00010000:2.0:1789760780.214507:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71733248 -> 71737344 00002000:00010000:2.0:1789760780.214513:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140128 -> 140136 00010000:00010000:2.0:1789760780.214527:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214540:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214549:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214558:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.214564:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214573:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214592:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.214601:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ddef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71733248->71737343] (req 71733248->71737343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.214697:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565471744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7993us (8207us total) trans 4294984821 rc 0/0 00000100:00100000:2.0:1789760780.214822:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17524 00000100:00100000:2.0:1789760780.214831:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718452882547 time 718466981477 state 0x2 ref 0 00000100:00100000:3.0:1789760780.219460:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.219550:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565471872 00000100:00100000:0.0:1789760780.219559:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565471872 00000100:00100000:0.0:1789760780.219609:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718452882547 time 718466981477 state 0x0 ref 1 00000100:00100000:0.0:1789760780.219625:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718467241893 time 718466981477 state 0x1 ref 1 00000100:00100000:0.0:1789760780.219657:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718467241893 time 718479948902 state 0x0 ref 1 00000100:00100000:0.0:1789760780.219669:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565471872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.219751:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71737344, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22368 00010000:00010000:0.0:1789760780.219760:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.219785:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.219789:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.219795:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.219809:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.225507:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984822 is committed 00002000:00010000:0.0:1789760780.225650:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71737344 -> 71741440 00002000:00010000:0.0:1789760780.225655:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140136 -> 140144 00010000:00010000:0.0:1789760780.225668:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225682:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225691:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225698:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.225735:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225745:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225765:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.225781:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674ddf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71737344->71741439] (req 71737344->71741439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.225863:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565471872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6191us (6408us total) trans 4294984822 rc 0/0 00000100:00100000:0.0:1789760780.225874:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17525 00000100:00100000:0.0:1789760780.225882:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718467241893 time 718479948902 state 0x2 ref 0 00000100:00100000:0.0:1789760780.231423:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.231586:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472000 00000100:00100000:2.0:1789760780.231596:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472000 00000100:00100000:2.0:1789760780.231647:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718467241893 time 718479948902 state 0x0 ref 1 00000100:00100000:2.0:1789760780.231661:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718480209318 time 718479948902 state 0x1 ref 1 00000100:00100000:2.0:1789760780.231697:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718480209318 time 718491989007 state 0x0 ref 1 00000100:00100000:2.0:1789760780.231764:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565472000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.231821:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71741440, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22370 00010000:00010000:2.0:1789760780.231831:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.231847:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.231851:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.231857:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.231869:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.238973:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984823 is committed 00002000:00010000:0.0:1789760780.239356:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71741440 -> 71745536 00002000:00010000:0.0:1789760780.239362:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140144 -> 140152 00010000:00010000:0.0:1789760780.239488:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239510:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239519:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239527:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.239532:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239541:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239561:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.239570:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ddfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71741440->71745535] (req 71741440->71745535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.239666:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565472000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7902us (8247us total) trans 4294984823 rc 0/0 00000100:00100000:0.0:1789760780.239676:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17526 00000100:00100000:0.0:1789760780.239685:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718480209318 time 718491989007 state 0x2 ref 0 00000100:00100000:1.0:1789760780.247672:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.247754:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472128 00000100:00100000:2.0:1789760780.247763:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472128 00000100:00100000:2.0:1789760780.247888:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718480209318 time 718491989007 state 0x0 ref 1 00000100:00100000:2.0:1789760780.247902:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718492249423 time 718491989007 state 0x1 ref 1 00000100:00100000:2.0:1789760780.247934:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718492249423 time 718508225437 state 0x0 ref 1 00000100:00100000:2.0:1789760780.247946:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565472128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.247990:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71745536, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22378 00010000:00010000:2.0:1789760780.248000:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.248014:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.248018:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.248085:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.248100:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.259036:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984824 is committed 00002000:00010000:2.0:1789760780.259202:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71745536 -> 71749632 00002000:00010000:2.0:1789760780.259207:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140152 -> 140160 00010000:00010000:2.0:1789760780.259220:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259234:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259245:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259253:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.259258:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259267:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259286:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.259298:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71745536->71749631] (req 71745536->71749631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.259400:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565472128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11451us (11732us total) trans 4294984824 rc 0/0 00000100:00100000:2.0:1789760780.259411:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17527 00000100:00100000:2.0:1789760780.259422:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718492249423 time 718508225437 state 0x2 ref 0 00000100:00100000:3.0:1789760780.268364:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.269364:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472256 00000100:00100000:0.0:1789760780.269587:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472256 00000100:00100000:0.0:1789760780.269648:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718492249423 time 718508225437 state 0x0 ref 1 00000100:00100000:0.0:1789760780.269663:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718508485853 time 718508225437 state 0x1 ref 1 00000100:00100000:0.0:1789760780.269779:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718508485853 time 718530070113 state 0x0 ref 1 00000100:00100000:0.0:1789760780.269794:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565472256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.269854:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71749632, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22380 00010000:00010000:0.0:1789760780.269864:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.269880:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.269884:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.269890:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.269905:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.277103:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984825 is committed 00002000:00010000:0.0:1789760780.277290:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71749632 -> 71753728 00002000:00010000:0.0:1789760780.277295:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140160 -> 140168 00010000:00010000:0.0:1789760780.277308:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277322:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277331:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277339:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.277343:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277353:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277374:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.277382:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71749632->71753727] (req 71749632->71753727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.277550:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565472256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7755us (9190us total) trans 4294984825 rc 0/0 00000100:00100000:0.0:1789760780.277562:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17528 00000100:00100000:0.0:1789760780.277571:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718508485853 time 718530070113 state 0x2 ref 0 00000100:00100000:0.0:1789760780.284433:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.284645:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472384 00000100:00100000:2.0:1789760780.284655:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472384 00000100:00100000:2.0:1789760780.284829:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718508485853 time 718530070113 state 0x0 ref 1 00000100:00100000:2.0:1789760780.284844:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718530330529 time 718530070113 state 0x1 ref 1 00000100:00100000:2.0:1789760780.284956:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718530330529 time 718545247549 state 0x0 ref 1 00000100:00100000:2.0:1789760780.284969:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.285012:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71753728, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22388 00010000:00010000:2.0:1789760780.285022:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.285038:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.285042:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.285049:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.285076:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.291550:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984826 is committed 00002000:00010000:0.0:1789760780.291768:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71753728 -> 71757824 00002000:00010000:0.0:1789760780.291774:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140168 -> 140176 00010000:00010000:0.0:1789760780.291787:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291800:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291809:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291817:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.291822:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291832:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291853:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.291861:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674de12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71753728->71757823] (req 71753728->71757823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.291959:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6986us (7530us total) trans 4294984826 rc 0/0 00000100:00100000:0.0:1789760780.291970:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17529 00000100:00100000:0.0:1789760780.291980:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718530330529 time 718545247549 state 0x2 ref 0 00000100:00100000:0.0:1789760780.295538:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.295685:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472512 00000100:00100000:2.0:1789760780.295695:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472512 00000100:00100000:2.0:1789760780.295832:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718530330529 time 718545247549 state 0x0 ref 1 00000100:00100000:2.0:1789760780.295849:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718545507965 time 718545247549 state 0x1 ref 1 00000100:00100000:2.0:1789760780.295872:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718545507965 time 718556164179 state 0x0 ref 1 00000100:00100000:2.0:1789760780.295886:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565472512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.295933:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71757824, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22390 00010000:00010000:2.0:1789760780.295942:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.295960:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.295964:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.295969:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.295982:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.301780:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984827 is committed 00002000:00010000:1.0:1789760780.304169:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71757824 -> 71761920 00002000:00010000:1.0:1789760780.304178:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140176 -> 140184 00010000:00010000:1.0:1789760780.304193:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304206:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304216:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304223:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.304229:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304237:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304259:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.304282:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674de19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71757824->71761919] (req 71757824->71761919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.305228:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565472512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9338us (9693us total) trans 4294984827 rc 0/0 00000100:00100000:0.0:1789760780.305240:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17530 00000100:00100000:0.0:1789760780.305250:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718545507965 time 718556164179 state 0x2 ref 0 00000100:00100000:3.0:1789760780.311290:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.311552:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472640 00000100:00100000:0.0:1789760780.311562:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472640 00000100:00100000:0.0:1789760780.311618:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718545507965 time 718556164179 state 0x0 ref 1 00000100:00100000:0.0:1789760780.311635:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718556424595 time 718556164179 state 0x1 ref 1 00000100:00100000:0.0:1789760780.311666:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718556424595 time 718571958133 state 0x0 ref 1 00000100:00100000:0.0:1789760780.311680:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.311771:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71761920, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22398 00010000:00010000:0.0:1789760780.311781:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.311797:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.311802:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.311808:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.311821:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.320284:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984828 is committed 00002000:00010000:3.0:1789760780.320616:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71761920 -> 71766016 00002000:00010000:3.0:1789760780.320622:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140184 -> 140192 00010000:00010000:3.0:1789760780.320637:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320649:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320663:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320670:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.320675:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320684:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320802:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.320812:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674de20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71761920->71766015] (req 71761920->71766015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.320942:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9261us (9658us total) trans 4294984828 rc 0/0 00000100:00100000:3.0:1789760780.320953:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17531 00000100:00100000:3.0:1789760780.320961:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718556424595 time 718571958133 state 0x2 ref 0 00000100:00100000:2.0:1789760780.328457:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.328767:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472768 00000100:00100000:0.0:1789760780.328777:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472768 00000100:00100000:0.0:1789760780.328833:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718556424595 time 718571958133 state 0x0 ref 1 00000100:00100000:0.0:1789760780.328848:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718572218549 time 718571958133 state 0x1 ref 1 00000100:00100000:0.0:1789760780.328883:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718572218549 time 718589174877 state 0x0 ref 1 00000100:00100000:0.0:1789760780.328895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.328944:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71766016, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223a0 00010000:00010000:0.0:1789760780.328953:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.328969:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.328973:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.328979:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.329668:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.337625:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984829 is committed 00002000:00010000:2.0:1789760780.338044:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71766016 -> 71770112 00002000:00010000:2.0:1789760780.338049:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140192 -> 140200 00010000:00010000:2.0:1789760780.338072:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338085:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338093:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338101:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.338106:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338115:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338135:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.338143:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674de27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71766016->71770111] (req 71766016->71770111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.338309:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9410us (9856us total) trans 4294984829 rc 0/0 00000100:00100000:2.0:1789760780.338319:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17532 00000100:00100000:2.0:1789760780.338329:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718572218549 time 718589174877 state 0x2 ref 0 00000100:00100000:0.0:1789760780.348557:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.349616:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565472896 00000100:00100000:2.0:1789760780.349628:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565472896 00000100:00100000:2.0:1789760780.349890:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718572218549 time 718589174877 state 0x0 ref 1 00000100:00100000:2.0:1789760780.349909:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718589435293 time 718589174877 state 0x1 ref 1 00000100:00100000:1.0:1789760780.349989:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718589435293 time 718610278229 state 0x0 ref 1 00000100:00100000:1.0:1789760780.350007:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.350063:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71770112, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223a8 00010000:00010000:1.0:1789760780.350074:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.350095:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.350100:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.350107:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.350120:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.356093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984830 is committed 00002000:00010000:1.0:1789760780.357230:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71770112 -> 71774208 00002000:00010000:1.0:1789760780.357315:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140200 -> 140208 00010000:00010000:1.0:1789760780.357330:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357345:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357355:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357363:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.357367:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357377:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357399:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.357408:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71770112->71774207] (req 71770112->71774207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.357549:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565472896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7538us (8994us total) trans 4294984830 rc 0/0 00000100:00100000:1.0:1789760780.357561:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17533 00000100:00100000:1.0:1789760780.357574:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718589435293 time 718610278229 state 0x2 ref 0 00000100:00100000:3.0:1789760780.363398:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.363498:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473024 00000100:00100000:0.0:1789760780.363506:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473024 00000100:00100000:0.0:1789760780.363562:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718589435293 time 718610278229 state 0x0 ref 1 00000100:00100000:0.0:1789760780.363576:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718610538645 time 718610278229 state 0x1 ref 1 00000100:00100000:0.0:1789760780.363601:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718610538645 time 718623894542 state 0x0 ref 1 00000100:00100000:0.0:1789760780.363611:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.363656:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71774208, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223b0 00010000:00010000:0.0:1789760780.363663:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.363677:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.363680:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.363685:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.363695:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.373264:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984831 is committed 00002000:00010000:0.0:1789760780.373392:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71774208 -> 71778304 00002000:00010000:0.0:1789760780.373398:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140208 -> 140216 00010000:00010000:0.0:1789760780.373412:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373426:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373435:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373442:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.373447:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373456:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373476:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.373484:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71774208->71778303] (req 71774208->71778303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.373573:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9958us (10180us total) trans 4294984831 rc 0/0 00000100:00100000:0.0:1789760780.373583:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17534 00000100:00100000:0.0:1789760780.373593:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718610538645 time 718623894542 state 0x2 ref 0 00000100:00100000:2.0:1789760780.381272:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.381851:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473152 00000100:00100000:0.0:1789760780.381862:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473152 00000100:00100000:0.0:1789760780.381919:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718610538645 time 718623894542 state 0x0 ref 1 00000100:00100000:0.0:1789760780.382112:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718624154958 time 718623894542 state 0x1 ref 1 00000100:00100000:0.0:1789760780.382184:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718624154958 time 718642475108 state 0x0 ref 1 00000100:00100000:0.0:1789760780.382199:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565473152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.382248:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71778304, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223b8 00010000:00010000:0.0:1789760780.382258:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.382274:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.382278:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.382284:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.382297:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.388096:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984832 is committed 00002000:00010000:0.0:1789760780.388263:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71778304 -> 71782400 00002000:00010000:0.0:1789760780.388268:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140216 -> 140224 00010000:00010000:0.0:1789760780.388283:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388302:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388311:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388319:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.388324:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388334:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388354:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.388362:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71778304->71782399] (req 71778304->71782399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.388453:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565473152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6253us (7186us total) trans 4294984832 rc 0/0 00000100:00100000:0.0:1789760780.388463:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17535 00000100:00100000:0.0:1789760780.388482:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718624154958 time 718642475108 state 0x2 ref 0 00000100:00100000:3.0:1789760780.392398:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.395605:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473280 00000100:00100000:1.0:1789760780.395621:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473280 00000100:00100000:1.0:1789760780.395685:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718624154958 time 718642475108 state 0x0 ref 1 00000100:00100000:1.0:1789760780.395725:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718642735524 time 718642475108 state 0x1 ref 1 00000100:00100000:1.0:1789760780.395961:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718642735524 time 718656251790 state 0x0 ref 1 00000100:00100000:1.0:1789760780.395974:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.396019:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71782400, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223c0 00010000:00010000:1.0:1789760780.396028:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.396040:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.396044:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.396050:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.396074:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.400155:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984833 is committed 00002000:00010000:1.0:1789760780.400294:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71782400 -> 71786496 00002000:00010000:1.0:1789760780.400299:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140224 -> 140232 00010000:00010000:1.0:1789760780.400313:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400325:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400335:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400346:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.400351:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400360:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400379:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.400395:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71782400->71786495] (req 71782400->71786495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.400537:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4561us (8144us total) trans 4294984833 rc 0/0 00000100:00100000:1.0:1789760780.400549:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17536 00000100:00100000:1.0:1789760780.400559:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718642735524 time 718656251790 state 0x2 ref 0 00000100:00100000:3.0:1789760780.403512:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.403872:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473408 00000100:00100000:0.0:1789760780.403883:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473408 00000100:00100000:0.0:1789760780.403939:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718642735524 time 718656251790 state 0x0 ref 1 00000100:00100000:0.0:1789760780.403955:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718656512206 time 718656251790 state 0x1 ref 1 00000100:00100000:0.0:1789760780.403989:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718656512206 time 718664280344 state 0x0 ref 1 00000100:00100000:0.0:1789760780.404001:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565473408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.404048:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71786496, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223c8 00010000:00010000:0.0:1789760780.404064:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.404080:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.404084:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.404090:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.404104:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.411919:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984834 is committed 00002000:00010000:0.0:1789760780.412281:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71786496 -> 71790592 00002000:00010000:0.0:1789760780.412287:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140232 -> 140240 00010000:00010000:0.0:1789760780.412301:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412313:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412327:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412334:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.412338:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412346:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412584:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.412593:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71786496->71790591] (req 71786496->71790591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.412942:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565473408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8937us (9433us total) trans 4294984834 rc 0/0 00000100:00100000:0.0:1789760780.412953:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17537 00000100:00100000:0.0:1789760780.412962:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718656512206 time 718664280344 state 0x2 ref 0 00000100:00100000:2.0:1789760780.418475:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.418573:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473536 00000100:00100000:0.0:1789760780.418583:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473536 00000100:00100000:0.0:1789760780.418636:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718656512206 time 718664280344 state 0x0 ref 1 00000100:00100000:0.0:1789760780.418651:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718664540760 time 718664280344 state 0x1 ref 1 00000100:00100000:0.0:1789760780.418681:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718664540760 time 718678973520 state 0x0 ref 1 00000100:00100000:0.0:1789760780.418692:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.418783:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71790592, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223d0 00010000:00010000:0.0:1789760780.418793:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.418809:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.418813:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.418820:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.418834:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.424758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984835 is committed 00002000:00010000:0.0:1789760780.424962:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71790592 -> 71794688 00002000:00010000:0.0:1789760780.424967:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140240 -> 140248 00010000:00010000:0.0:1789760780.424981:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.424993:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.425003:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.425015:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.425020:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.425029:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.425049:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.425122:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71790592->71794687] (req 71790592->71794687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.425220:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6525us (6751us total) trans 4294984835 rc 0/0 00000100:00100000:0.0:1789760780.425231:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17538 00000100:00100000:0.0:1789760780.425241:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718664540760 time 718678973520 state 0x2 ref 0 00000100:00100000:2.0:1789760780.434119:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.434282:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473664 00000100:00100000:1.0:1789760780.434291:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473664 00000100:00100000:1.0:1789760780.434348:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718664540760 time 718678973520 state 0x0 ref 1 00000100:00100000:1.0:1789760780.434363:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718679233936 time 718678973520 state 0x1 ref 1 00000100:00100000:1.0:1789760780.434401:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718679233936 time 718694693027 state 0x0 ref 1 00000100:00100000:1.0:1789760780.434417:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.434467:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71794688, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223d8 00010000:00010000:1.0:1789760780.434482:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.434499:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.434503:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.434510:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.434524:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.440352:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984836 is committed 00002000:00010000:1.0:1789760780.440458:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71794688 -> 71798784 00002000:00010000:1.0:1789760780.440463:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140248 -> 140256 00010000:00010000:1.0:1789760780.440475:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440488:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440498:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440505:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.440511:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440520:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440538:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.440545:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71794688->71798783] (req 71794688->71798783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.440636:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6217us (6522us total) trans 4294984836 rc 0/0 00000100:00100000:1.0:1789760780.440647:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17539 00000100:00100000:1.0:1789760780.440656:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718679233936 time 718694693027 state 0x2 ref 0 00000100:00100000:2.0:1789760780.444155:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.444468:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473792 00000100:00100000:0.0:1789760780.444487:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473792 00000100:00100000:0.0:1789760780.444543:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718679233936 time 718694693027 state 0x0 ref 1 00000100:00100000:0.0:1789760780.444558:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718694953443 time 718694693027 state 0x1 ref 1 00000100:00100000:0.0:1789760780.444599:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718694953443 time 718704880955 state 0x0 ref 1 00000100:00100000:0.0:1789760780.444616:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.444663:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71798784, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223e0 00010000:00010000:0.0:1789760780.444673:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.444689:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.444694:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.444700:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.444760:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.449764:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984837 is committed 00002000:00010000:0.0:1789760780.449935:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71798784 -> 71802880 00002000:00010000:0.0:1789760780.449941:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140256 -> 140264 00010000:00010000:0.0:1789760780.449954:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.449966:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.449975:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.449983:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.449988:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.449997:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.450016:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.450024:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71798784->71802879] (req 71798784->71802879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.450122:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565473792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5504us (5971us total) trans 4294984837 rc 0/0 00000100:00100000:0.0:1789760780.450133:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17540 00000100:00100000:0.0:1789760780.450143:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718694953443 time 718704880955 state 0x2 ref 0 00000100:00100000:2.0:1789760780.453782:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.453993:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565473920 00000100:00100000:0.0:1789760780.454002:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565473920 00000100:00100000:0.0:1789760780.454232:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718694953443 time 718704880955 state 0x0 ref 1 00000100:00100000:0.0:1789760780.454252:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718705141371 time 718704880955 state 0x1 ref 1 00000100:00100000:0.0:1789760780.454285:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718705141371 time 718714576999 state 0x0 ref 1 00000100:00100000:0.0:1789760780.454299:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565473920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.454347:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71802880, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223e8 00010000:00010000:0.0:1789760780.454357:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.454372:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.454377:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.454384:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.454398:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.463907:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984838 is committed 00002000:00010000:0.0:1789760780.464025:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71802880 -> 71806976 00002000:00010000:0.0:1789760780.464031:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140264 -> 140272 00010000:00010000:0.0:1789760780.464045:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464060:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464069:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464077:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.464082:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464091:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464112:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.464120:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71802880->71806975] (req 71802880->71806975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.465109:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565473920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10806us (11328us total) trans 4294984838 rc 0/0 00000100:00100000:0.0:1789760780.465123:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17541 00000100:00100000:0.0:1789760780.465132:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718705141371 time 718714576999 state 0x2 ref 0 00000100:00100000:2.0:1789760780.472640:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.472755:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474048 00000100:00100000:1.0:1789760780.472765:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474048 00000100:00100000:1.0:1789760780.472815:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718705141371 time 718714576999 state 0x0 ref 1 00000100:00100000:1.0:1789760780.472830:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718714837415 time 718714576999 state 0x1 ref 1 00000100:00100000:1.0:1789760780.472859:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718714837415 time 718733151906 state 0x0 ref 1 00000100:00100000:1.0:1789760780.472875:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.472939:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71806976, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223f0 00010000:00010000:1.0:1789760780.472948:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.472964:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.472969:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.472975:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.472989:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.478121:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984839 is committed 00002000:00010000:1.0:1789760780.478694:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71806976 -> 71811072 00002000:00010000:1.0:1789760780.478701:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140272 -> 140280 00010000:00010000:1.0:1789760780.478803:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478816:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478825:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478832:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.478837:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478846:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478864:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.478872:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71806976->71811071] (req 71806976->71811071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.479214:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6334us (6577us total) trans 4294984839 rc 0/0 00000100:00100000:1.0:1789760780.479225:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17542 00000100:00100000:1.0:1789760780.479234:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718714837415 time 718733151906 state 0x2 ref 0 00000100:00100000:2.0:1789760780.484182:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.485044:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474176 00000100:00100000:0.0:1789760780.485054:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474176 00000100:00100000:0.0:1789760780.485113:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718714837415 time 718733151906 state 0x0 ref 1 00000100:00100000:0.0:1789760780.485129:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718733412322 time 718733151906 state 0x1 ref 1 00000100:00100000:0.0:1789760780.485164:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718733412322 time 718745456156 state 0x0 ref 1 00000100:00100000:0.0:1789760780.485177:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.485225:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71811072, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x223f8 00010000:00010000:0.0:1789760780.485345:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.485360:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.485365:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.485372:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.485385:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.491666:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984840 is committed 00002000:00010000:3.0:1789760780.491947:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71811072 -> 71815168 00002000:00010000:3.0:1789760780.491952:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140280 -> 140288 00010000:00010000:3.0:1789760780.491964:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.491977:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.491986:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.491991:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760780.491994:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.491999:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.492009:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.492027:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.492046:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674de74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71811072->71815167] (req 71811072->71815167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.492170:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6990us (7992us total) trans 4294984840 rc 0/0 00000100:00100000:3.0:1789760780.492181:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17543 00000100:00100000:3.0:1789760780.492190:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718733412322 time 718745456156 state 0x2 ref 0 00000100:00100000:2.0:1789760780.501671:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.501954:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474304 00000100:00100000:0.0:1789760780.501964:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474304 00000100:00100000:0.0:1789760780.502023:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718733412322 time 718745456156 state 0x0 ref 1 00000100:00100000:0.0:1789760780.502038:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718745716572 time 718745456156 state 0x1 ref 1 00000100:00100000:0.0:1789760780.502100:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718745716572 time 718762391715 state 0x0 ref 1 00000100:00100000:0.0:1789760780.502112:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565474304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.502169:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71815168, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22400 00010000:00010000:0.0:1789760780.502179:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.502195:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.502199:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.502206:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.502220:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.507630:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984841 is committed 00002000:00010000:0.0:1789760780.507778:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71815168 -> 71819264 00002000:00010000:0.0:1789760780.507783:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140288 -> 140296 00010000:00010000:0.0:1789760780.507798:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507811:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507821:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507829:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.507833:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507842:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507862:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.507870:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674de7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71815168->71819263] (req 71815168->71819263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.507967:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565474304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5851us (6301us total) trans 4294984841 rc 0/0 00000100:00100000:0.0:1789760780.507978:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17544 00000100:00100000:0.0:1789760780.507987:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718745716572 time 718762391715 state 0x2 ref 0 00000100:00100000:2.0:1789760780.514183:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.514287:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474432 00000100:00100000:1.0:1789760780.514297:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474432 00000100:00100000:1.0:1789760780.514348:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718745716572 time 718762391715 state 0x0 ref 1 00000100:00100000:1.0:1789760780.514363:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718762652131 time 718762391715 state 0x1 ref 1 00000100:00100000:1.0:1789760780.514389:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718762652131 time 718774680745 state 0x0 ref 1 00000100:00100000:1.0:1789760780.514401:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565474432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.514448:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71819264, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22408 00010000:00010000:1.0:1789760780.514464:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.514480:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.514485:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.514491:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.514505:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.519641:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984842 is committed 00002000:00010000:1.0:1789760780.520370:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71819264 -> 71823360 00002000:00010000:1.0:1789760780.520377:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140296 -> 140304 00010000:00010000:1.0:1789760780.520391:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520403:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520413:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520420:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.520424:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520434:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520453:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.520467:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71819264->71823359] (req 71819264->71823359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.520598:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565474432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6194us (6421us total) trans 4294984842 rc 0/0 00000100:00100000:1.0:1789760780.520607:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17545 00000100:00100000:1.0:1789760780.520617:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718762652131 time 718774680745 state 0x2 ref 0 00000100:00100000:2.0:1789760780.529986:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760780.534030:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474560 00000100:00100000:3.0:1789760780.534044:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474560 00000100:00100000:3.0:1789760780.534111:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718762652131 time 718774680745 state 0x0 ref 1 00000100:00100000:3.0:1789760780.534127:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718774941161 time 718774680745 state 0x1 ref 1 00000100:00100000:3.0:1789760780.534166:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718774941161 time 718794457991 state 0x0 ref 1 00000100:00100000:3.0:1789760780.534180:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760780.534226:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71823360, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22410 00010000:00010000:3.0:1789760780.534237:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.534253:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1789760780.534258:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760780.534264:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.534278:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.543935:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984843 is committed 00002000:00010000:2.0:1789760780.544049:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71823360 -> 71827456 00002000:00010000:2.0:1789760780.544064:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140304 -> 140312 00010000:00010000:2.0:1789760780.544077:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544090:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544099:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544107:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.544111:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544120:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544140:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.544148:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674de89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71823360->71827455] (req 71823360->71827455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.544237:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565474560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10056us (14255us total) trans 4294984843 rc 0/0 00000100:00100000:2.0:1789760780.544250:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17546 00000100:00100000:2.0:1789760780.544259:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718774941161 time 718794457991 state 0x2 ref 0 00000100:00100000:2.0:1789760780.553336:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.553433:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474688 00000100:00100000:0.0:1789760780.553443:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474688 00000100:00100000:0.0:1789760780.553496:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718774941161 time 718794457991 state 0x0 ref 1 00000100:00100000:0.0:1789760780.553510:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718794718407 time 718794457991 state 0x1 ref 1 00000100:00100000:0.0:1789760780.553540:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718794718407 time 718813832747 state 0x0 ref 1 00000100:00100000:0.0:1789760780.553553:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565474688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.553599:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71827456, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22418 00010000:00010000:0.0:1789760780.553609:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.553625:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.553629:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.553635:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.553649:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.560040:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984844 is committed 00002000:00010000:0.0:1789760780.560175:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71827456 -> 71831552 00002000:00010000:0.0:1789760780.560179:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140312 -> 140320 00010000:00010000:0.0:1789760780.560190:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560199:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560204:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560209:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.560213:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560219:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560233:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.560238:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71827456->71831551] (req 71827456->71831551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.560546:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565474688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6982us (7206us total) trans 4294984844 rc 0/0 00000100:00100000:0.0:1789760780.560557:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17547 00000100:00100000:0.0:1789760780.560566:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718794718407 time 718813832747 state 0x2 ref 0 00000100:00100000:0.0:1789760780.564909:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.565003:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474816 00000100:00100000:1.0:1789760780.565014:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474816 00000100:00100000:1.0:1789760780.565069:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718794718407 time 718813832747 state 0x0 ref 1 00000100:00100000:1.0:1789760780.565084:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718814093163 time 718813832747 state 0x1 ref 1 00000100:00100000:1.0:1789760780.565117:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718814093163 time 718825408711 state 0x0 ref 1 00000100:00100000:1.0:1789760780.565129:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565474816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.565179:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71831552, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22420 00010000:00010000:1.0:1789760780.565189:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.565206:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.565210:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.565217:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.565246:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.571071:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984845 is committed 00002000:00010000:1.0:1789760780.571275:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71831552 -> 71835648 00002000:00010000:1.0:1789760780.571280:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140320 -> 140328 00010000:00010000:1.0:1789760780.571356:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571370:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571380:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571387:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.571392:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571401:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571420:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.571428:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674de97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71831552->71835647] (req 71831552->71835647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.571555:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565474816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6423us (6650us total) trans 4294984845 rc 0/0 00000100:00100000:1.0:1789760780.571566:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17548 00000100:00100000:1.0:1789760780.571575:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718814093163 time 718825408711 state 0x2 ref 0 00000100:00100000:2.0:1789760780.575942:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.576011:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565474944 00000100:00100000:0.0:1789760780.576021:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565474944 00000100:00100000:0.0:1789760780.576142:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718814093163 time 718825408711 state 0x0 ref 1 00000100:00100000:0.0:1789760780.576157:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718825669127 time 718825408711 state 0x1 ref 1 00000100:00100000:0.0:1789760780.576190:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718825669127 time 718836480170 state 0x0 ref 1 00000100:00100000:0.0:1789760780.576203:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565474944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.576249:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71835648, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22428 00010000:00010000:0.0:1789760780.576258:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.576273:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.576277:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.576283:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.576363:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.581196:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984846 is committed 00002000:00010000:0.0:1789760780.581308:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71835648 -> 71839744 00002000:00010000:0.0:1789760780.581313:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140328 -> 140336 00010000:00010000:0.0:1789760780.581325:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581338:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581346:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581354:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.581358:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581368:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581385:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.581393:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674de9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71835648->71839743] (req 71835648->71839743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.581523:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565474944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5317us (5585us total) trans 4294984846 rc 0/0 00000100:00100000:0.0:1789760780.581535:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17549 00000100:00100000:0.0:1789760780.581544:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718825669127 time 718836480170 state 0x2 ref 0 00000100:00100000:2.0:1789760780.584582:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.584691:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475072 00000100:00100000:0.0:1789760780.584701:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475072 00000100:00100000:0.0:1789760780.584858:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718825669127 time 718836480170 state 0x0 ref 1 00000100:00100000:0.0:1789760780.584873:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718836740586 time 718836480170 state 0x1 ref 1 00000100:00100000:0.0:1789760780.584942:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718836740586 time 718845233400 state 0x0 ref 1 00000100:00100000:0.0:1789760780.584966:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565475072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.585015:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71839744, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22430 00010000:00010000:0.0:1789760780.585025:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.585041:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.585045:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.585051:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.585065:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.590088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984847 is committed 00002000:00010000:0.0:1789760780.590772:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71839744 -> 71843840 00002000:00010000:0.0:1789760780.590778:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140336 -> 140344 00010000:00010000:0.0:1789760780.590791:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590813:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590827:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590835:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.590841:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590850:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590869:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.590876:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dea5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71839744->71843839] (req 71839744->71843839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.590970:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565475072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6013us (6393us total) trans 4294984847 rc 0/0 00000100:00100000:0.0:1789760780.590982:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17550 00000100:00100000:0.0:1789760780.590990:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718836740586 time 718845233400 state 0x2 ref 0 00000100:00100000:2.0:1789760780.597783:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.598207:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475200 00000100:00100000:1.0:1789760780.598217:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475200 00000100:00100000:1.0:1789760780.598272:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718836740586 time 718845233400 state 0x0 ref 1 00000100:00100000:1.0:1789760780.598287:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718845493816 time 718845233400 state 0x1 ref 1 00000100:00100000:1.0:1789760780.598316:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718845493816 time 718858608663 state 0x0 ref 1 00000100:00100000:1.0:1789760780.598329:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.598374:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71843840, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22438 00010000:00010000:1.0:1789760780.598384:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.598399:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.598404:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.598411:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.598425:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.603084:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984848 is committed 00002000:00010000:1.0:1789760780.604280:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71843840 -> 71847936 00002000:00010000:1.0:1789760780.604288:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140344 -> 140352 00010000:00010000:1.0:1789760780.604303:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604316:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604324:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604331:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.604335:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604344:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604364:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.604373:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674deac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71843840->71847935] (req 71843840->71847935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.604516:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6183us (6738us total) trans 4294984848 rc 0/0 00000100:00100000:1.0:1789760780.604528:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17551 00000100:00100000:1.0:1789760780.604540:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718845493816 time 718858608663 state 0x2 ref 0 00000100:00100000:2.0:1789760780.608535:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.608680:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475328 00000100:00100000:0.0:1789760780.608687:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475328 00000100:00100000:0.0:1789760780.608933:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718845493816 time 718858608663 state 0x0 ref 1 00000100:00100000:0.0:1789760780.608949:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718858869079 time 718858608663 state 0x1 ref 1 00000100:00100000:0.0:1789760780.608976:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718858869079 time 718869267100 state 0x0 ref 1 00000100:00100000:0.0:1789760780.608989:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565475328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.609037:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71847936, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22440 00010000:00010000:0.0:1789760780.609047:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.609067:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.609074:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.609080:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.609095:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.616313:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984849 is committed 00002000:00010000:0.0:1789760780.616775:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71847936 -> 71852032 00002000:00010000:0.0:1789760780.616781:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140352 -> 140360 00010000:00010000:0.0:1789760780.616795:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616808:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616816:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616828:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.616833:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616842:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616862:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.616870:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71847936->71852031] (req 71847936->71852031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.616961:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565475328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7969us (8432us total) trans 4294984849 rc 0/0 00000100:00100000:0.0:1789760780.616972:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17552 00000100:00100000:0.0:1789760780.616982:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718858869079 time 718869267100 state 0x2 ref 0 00000100:00100000:2.0:1789760780.623243:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.624010:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475456 00000100:00100000:0.0:1789760780.624020:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475456 00000100:00100000:0.0:1789760780.624076:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718858869079 time 718869267100 state 0x0 ref 1 00000100:00100000:0.0:1789760780.624092:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718869527516 time 718869267100 state 0x1 ref 1 00000100:00100000:0.0:1789760780.624165:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718869527516 time 718884456760 state 0x0 ref 1 00000100:00100000:0.0:1789760780.624184:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.624230:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71852032, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22448 00010000:00010000:0.0:1789760780.624238:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.624253:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.624258:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.624264:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.624277:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.629242:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984850 is committed 00002000:00010000:0.0:1789760780.629355:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71852032 -> 71856128 00002000:00010000:0.0:1789760780.629360:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140360 -> 140368 00010000:00010000:0.0:1789760780.629374:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629388:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629397:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629404:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.629409:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629418:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629492:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.629501:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71852032->71856127] (req 71852032->71856127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.629630:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5445us (6392us total) trans 4294984850 rc 0/0 00000100:00100000:0.0:1789760780.629641:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17553 00000100:00100000:0.0:1789760780.629650:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718869527516 time 718884456760 state 0x2 ref 0 00000100:00100000:2.0:1789760780.634948:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.635034:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475584 00000100:00100000:1.0:1789760780.635044:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475584 00000100:00100000:1.0:1789760780.635107:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718869527516 time 718884456760 state 0x0 ref 1 00000100:00100000:1.0:1789760780.635121:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718884717176 time 718884456760 state 0x1 ref 1 00000100:00100000:1.0:1789760780.635153:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718884717176 time 718895444863 state 0x0 ref 1 00000100:00100000:1.0:1789760780.635165:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565475584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.635219:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71856128, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22450 00010000:00010000:1.0:1789760780.635229:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.635245:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.635250:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.635256:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.635270:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.639920:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984851 is committed 00002000:00010000:1.0:1789760780.640320:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71856128 -> 71860224 00002000:00010000:1.0:1789760780.640326:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140368 -> 140376 00010000:00010000:1.0:1789760780.640340:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640352:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640360:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640367:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.640372:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640380:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640398:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.640404:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dec1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71856128->71860223] (req 71856128->71860223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.640503:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565475584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5334us (5559us total) trans 4294984851 rc 0/0 00000100:00100000:1.0:1789760780.640512:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17554 00000100:00100000:1.0:1789760780.640522:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718884717176 time 718895444863 state 0x2 ref 0 00000100:00100000:2.0:1789760780.644332:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.644443:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475712 00000100:00100000:0.0:1789760780.644453:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475712 00000100:00100000:0.0:1789760780.644506:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718884717176 time 718895444863 state 0x0 ref 1 00000100:00100000:0.0:1789760780.644521:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718895705279 time 718895444863 state 0x1 ref 1 00000100:00100000:0.0:1789760780.644586:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718895705279 time 718904876980 state 0x0 ref 1 00000100:00100000:0.0:1789760780.644599:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.644649:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71860224, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22458 00010000:00010000:0.0:1789760780.644669:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.644686:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.644691:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.644739:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.644753:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.649077:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984852 is committed 00002000:00010000:0.0:1789760780.649206:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71860224 -> 71864320 00002000:00010000:0.0:1789760780.649212:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140376 -> 140384 00010000:00010000:0.0:1789760780.649225:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649237:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649245:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649252:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.649257:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649274:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649296:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.649304:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dec8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71860224->71864319] (req 71860224->71864319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.649401:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4800us (5074us total) trans 4294984852 rc 0/0 00000100:00100000:0.0:1789760780.649411:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17555 00000100:00100000:0.0:1789760780.649419:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718895705279 time 718904876980 state 0x2 ref 0 00000100:00100000:0.0:1789760780.654635:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.654784:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475840 00000100:00100000:2.0:1789760780.654794:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475840 00000100:00100000:2.0:1789760780.654846:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718895705279 time 718904876980 state 0x0 ref 1 00000100:00100000:2.0:1789760780.654862:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718905137396 time 718904876980 state 0x1 ref 1 00000100:00100000:2.0:1789760780.654945:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718905137396 time 718915235006 state 0x0 ref 1 00000100:00100000:2.0:1789760780.654959:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.655006:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71864320, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22460 00010000:00010000:2.0:1789760780.655015:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.655031:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.655037:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.655043:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.655057:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.665092:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984853 is committed 00002000:00010000:0.0:1789760780.665211:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71864320 -> 71868416 00002000:00010000:0.0:1789760780.665217:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140384 -> 140392 00010000:00010000:0.0:1789760780.665242:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665255:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665265:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665273:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.665278:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665288:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665309:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.665317:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674decf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71864320->71868415] (req 71864320->71868415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.665409:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565475840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10448us (10778us total) trans 4294984853 rc 0/0 00000100:00100000:0.0:1789760780.665420:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17556 00000100:00100000:0.0:1789760780.665496:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718905137396 time 718915235006 state 0x2 ref 0 00000100:00100000:2.0:1789760780.669164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760780.669759:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565475968 00000100:00100000:1.0:1789760780.669769:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565475968 00000100:00100000:1.0:1789760780.669821:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718905137396 time 718915235006 state 0x0 ref 1 00000100:00100000:1.0:1789760780.669836:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718915495422 time 718915235006 state 0x1 ref 1 00000100:00100000:1.0:1789760780.669866:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718915495422 time 718930157678 state 0x0 ref 1 00000100:00100000:1.0:1789760780.669878:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565475968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760780.669930:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71868416, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22468 00010000:00010000:1.0:1789760780.669940:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.669954:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789760780.669958:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.669964:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.669976:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.681533:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984854 is committed 00002000:00010000:1.0:1789760780.681927:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71868416 -> 71872512 00002000:00010000:1.0:1789760780.681932:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140392 -> 140400 00010000:00010000:1.0:1789760780.681944:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.681961:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.681970:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.681977:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760780.681982:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.681992:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.682011:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.682018:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ded6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71868416->71872511] (req 71868416->71872511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.685965:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565475968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16077us (16797us total) trans 4294984854 rc 0/0 00000100:00100000:0.0:1789760780.685982:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17557 00000100:00100000:0.0:1789760780.685993:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718915495422 time 718930157678 state 0x2 ref 0 00000100:00100000:2.0:1789760780.691867:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.695106:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476096 00000100:00100000:0.0:1789760780.695121:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476096 00000100:00100000:0.0:1789760780.695187:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718915495422 time 718930157678 state 0x0 ref 1 00000100:00100000:0.0:1789760780.695203:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718930418094 time 718930157678 state 0x1 ref 1 00000100:00100000:0.0:1789760780.695241:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718930418094 time 718955533280 state 0x0 ref 1 00000100:00100000:0.0:1789760780.695255:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565476096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.695307:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71872512, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22470 00010000:00010000:0.0:1789760780.695316:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.695332:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.695336:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.695342:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.695358:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.703759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984855 is committed 00002000:00010000:0.0:1789760780.703865:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71872512 -> 71876608 00002000:00010000:0.0:1789760780.703870:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140400 -> 140408 00010000:00010000:0.0:1789760780.703883:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703896:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703905:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703912:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.703918:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703927:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703945:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.703952:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dedd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71872512->71876607] (req 71872512->71876607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.704128:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565476096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8871us (12265us total) trans 4294984855 rc 0/0 00000100:00100000:0.0:1789760780.704139:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17558 00000100:00100000:0.0:1789760780.704148:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718930418094 time 718955533280 state 0x2 ref 0 00000100:00100000:3.0:1789760780.713065:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.713293:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476224 00000100:00100000:0.0:1789760780.713302:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476224 00000100:00100000:0.0:1789760780.713361:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718930418094 time 718955533280 state 0x0 ref 1 00000100:00100000:0.0:1789760780.713376:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718955793696 time 718955533280 state 0x1 ref 1 00000100:00100000:2.0:1789760780.713489:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718955793696 time 718973777161 state 0x0 ref 1 00000100:00100000:2.0:1789760780.713504:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.713554:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71876608, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22478 00010000:00010000:2.0:1789760780.713563:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.713579:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789760780.713584:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.713591:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.713605:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.721300:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984856 is committed 00002000:00010000:3.0:1789760780.722547:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71876608 -> 71880704 00002000:00010000:3.0:1789760780.722555:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140408 -> 140416 00010000:00010000:3.0:1789760780.722568:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722581:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722590:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722598:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.722603:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722612:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722632:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.722639:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674dee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71876608->71880703] (req 71876608->71880703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.722798:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9292us (10571us total) trans 4294984856 rc 0/0 00000100:00100000:3.0:1789760780.722808:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17559 00000100:00100000:3.0:1789760780.722818:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718955793696 time 718973777161 state 0x2 ref 0 00000100:00100000:2.0:1789760780.734673:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.734857:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476352 00000100:00100000:0.0:1789760780.734867:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476352 00000100:00100000:0.0:1789760780.734925:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718955793696 time 718973777161 state 0x0 ref 1 00000100:00100000:0.0:1789760780.734940:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718974037577 time 718973777161 state 0x1 ref 1 00000100:00100000:0.0:1789760780.734972:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718974037577 time 718995264136 state 0x0 ref 1 00000100:00100000:0.0:1789760780.734985:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.735034:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71880704, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22480 00010000:00010000:0.0:1789760780.735043:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.735060:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789760780.735065:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.735072:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.735086:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.740582:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984857 is committed 00002000:00010000:0.0:1789760780.740926:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71880704 -> 71884800 00002000:00010000:0.0:1789760780.740932:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140416 -> 140424 00010000:00010000:0.0:1789760780.740945:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.740957:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.740966:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.740978:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.740982:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.740992:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.741012:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.741019:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674deeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71880704->71884799] (req 71880704->71884799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.741217:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6229us (6548us total) trans 4294984857 rc 0/0 00000100:00100000:0.0:1789760780.741229:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17560 00000100:00100000:0.0:1789760780.741238:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718974037577 time 718995264136 state 0x2 ref 0 00000100:00100000:2.0:1789760780.748140:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.748801:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476480 00000100:00100000:0.0:1789760780.748810:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476480 00000100:00100000:0.0:1789760780.748864:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718974037577 time 718995264136 state 0x0 ref 1 00000100:00100000:0.0:1789760780.748879:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718995524552 time 718995264136 state 0x1 ref 1 00000100:00100000:0.0:1789760780.748910:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718995524552 time 719009202516 state 0x0 ref 1 00000100:00100000:0.0:1789760780.748926:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.748972:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71884800, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22488 00010000:00010000:0.0:1789760780.748982:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.748999:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.749003:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.749009:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.749023:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.753901:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984858 is committed 00002000:00010000:0.0:1789760780.754025:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71884800 -> 71888896 00002000:00010000:0.0:1789760780.754031:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140424 -> 140432 00010000:00010000:0.0:1789760780.754045:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754068:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754077:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754085:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.754090:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754098:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754116:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.754124:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71884800->71888895] (req 71884800->71888895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.754220:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5292us (6083us total) trans 4294984858 rc 0/0 00000100:00100000:0.0:1789760780.754231:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17561 00000100:00100000:0.0:1789760780.754240:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718995524552 time 719009202516 state 0x2 ref 0 00000100:00100000:3.0:1789760780.764531:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.764690:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476608 00000100:00100000:0.0:1789760780.764700:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476608 00000100:00100000:0.0:1789760780.765182:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 718995524552 time 719009202516 state 0x0 ref 1 00000100:00100000:0.0:1789760780.765199:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719009462932 time 719009202516 state 0x1 ref 1 00000100:00100000:0.0:1789760780.765236:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719009462932 time 719025527375 state 0x0 ref 1 00000100:00100000:0.0:1789760780.765250:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.765298:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71888896, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22490 00010000:00010000:0.0:1789760780.765308:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.765322:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.765326:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.765333:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.765347:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.772967:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984859 is committed 00002000:00010000:0.0:1789760780.774130:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71888896 -> 71892992 00002000:00010000:0.0:1789760780.774137:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140432 -> 140440 00010000:00010000:0.0:1789760780.774152:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774164:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774173:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774180:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.774185:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774194:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774213:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.774220:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674def9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71888896->71892991] (req 71888896->71892991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.774360:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9109us (9833us total) trans 4294984859 rc 0/0 00000100:00100000:0.0:1789760780.774371:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17562 00000100:00100000:0.0:1789760780.774380:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719009462932 time 719025527375 state 0x2 ref 0 00000100:00100000:2.0:1789760780.782599:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.783585:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476736 00000100:00100000:0.0:1789760780.783597:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476736 00000100:00100000:0.0:1789760780.783656:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719009462932 time 719025527375 state 0x0 ref 1 00000100:00100000:0.0:1789760780.783673:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719025787791 time 719025527375 state 0x1 ref 1 00000100:00100000:0.0:1789760780.783727:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719025787791 time 719043997168 state 0x0 ref 1 00000100:00100000:0.0:1789760780.783742:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.783788:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71892992, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x22498 00010000:00010000:0.0:1789760780.784122:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.784139:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.784144:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.784149:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.784163:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.790762:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984860 is committed 00002000:00010000:0.0:1789760780.791040:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71892992 -> 71897088 00002000:00010000:0.0:1789760780.791045:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140440 -> 140448 00010000:00010000:0.0:1789760780.791108:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791122:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791131:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791138:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.791143:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791152:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791170:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.791184:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71892992->71897087] (req 71892992->71897087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.791676:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565476736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7931us (9082us total) trans 4294984860 rc 0/0 00000100:00100000:0.0:1789760780.791687:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17563 00000100:00100000:0.0:1789760780.791695:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719025787791 time 719043997168 state 0x2 ref 0 00000100:00100000:2.0:1789760780.795299:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.795445:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476864 00000100:00100000:0.0:1789760780.795455:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476864 00000100:00100000:0.0:1789760780.795512:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719025787791 time 719043997168 state 0x0 ref 1 00000100:00100000:0.0:1789760780.795528:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719044257584 time 719043997168 state 0x1 ref 1 00000100:00100000:0.0:1789760780.795555:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719044257584 time 719055847407 state 0x0 ref 1 00000100:00100000:0.0:1789760780.795569:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.795616:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71897088, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224a0 00010000:00010000:0.0:1789760780.795626:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.795641:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.795645:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.795651:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.795671:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.805507:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984861 is committed 00002000:00010000:0.0:1789760780.805600:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71897088 -> 71901184 00002000:00010000:0.0:1789760780.805605:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140448 -> 140456 00010000:00010000:0.0:1789760780.805619:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805631:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805641:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805648:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.805653:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805662:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805682:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.805775:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71897088->71901183] (req 71897088->71901183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.805913:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565476864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10335us (10611us total) trans 4294984861 rc 0/0 00000100:00100000:0.0:1789760780.805924:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17564 00000100:00100000:0.0:1789760780.805933:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719044257584 time 719055847407 state 0x2 ref 0 00000100:00100000:3.0:1789760780.811905:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.812101:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565476992 00000100:00100000:0.0:1789760780.812111:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565476992 00000100:00100000:0.0:1789760780.812170:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719044257584 time 719055847407 state 0x0 ref 1 00000100:00100000:0.0:1789760780.812186:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719056107823 time 719055847407 state 0x1 ref 1 00000100:00100000:0.0:1789760780.812220:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719056107823 time 719072512429 state 0x0 ref 1 00000100:00100000:0.0:1789760780.812237:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565476992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.812286:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71901184, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224a8 00010000:00010000:0.0:1789760780.812296:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.812312:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.812316:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.812323:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.812336:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.820684:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984862 is committed 00002000:00010000:2.0:1789760780.821553:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71901184 -> 71905280 00002000:00010000:2.0:1789760780.821560:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140456 -> 140464 00010000:00010000:2.0:1789760780.821573:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821585:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821594:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821601:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.821605:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821614:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821633:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.821640:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674df0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71901184->71905279] (req 71901184->71905279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.823939:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565476992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11698us (12035us total) trans 4294984862 rc 0/0 00000100:00100000:2.0:1789760780.823958:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17565 00000100:00100000:2.0:1789760780.823968:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719056107823 time 719072512429 state 0x2 ref 0 00000100:00100000:2.0:1789760780.834830:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.834938:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477120 00000100:00100000:0.0:1789760780.834948:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477120 00000100:00100000:0.0:1789760780.835007:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719056107823 time 719072512429 state 0x0 ref 1 00000100:00100000:0.0:1789760780.835023:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719072772845 time 719072512429 state 0x1 ref 1 00000100:00100000:0.0:1789760780.835113:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719072772845 time 719095402951 state 0x0 ref 1 00000100:00100000:0.0:1789760780.835128:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565477120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.835178:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71905280, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224b0 00010000:00010000:0.0:1789760780.835200:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.835217:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.835222:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.835228:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.835241:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760780.847392:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984863 is committed 00002000:00010000:0.0:1789760780.847603:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71905280 -> 71909376 00002000:00010000:0.0:1789760780.847608:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140464 -> 140472 00010000:00010000:0.0:1789760780.847622:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847639:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847648:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847656:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.847660:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847669:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847688:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.847697:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71905280->71909375] (req 71905280->71909375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.848371:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565477120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13239us (13543us total) trans 4294984863 rc 0/0 00000100:00100000:0.0:1789760780.848383:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17566 00000100:00100000:0.0:1789760780.848393:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719072772845 time 719095402951 state 0x2 ref 0 00000100:00100000:3.0:1789760780.852348:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.852403:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477248 00000100:00100000:0.0:1789760780.852414:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477248 00000100:00100000:0.0:1789760780.852467:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719072772845 time 719095402951 state 0x0 ref 1 00000100:00100000:0.0:1789760780.852481:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719095663367 time 719095402951 state 0x1 ref 1 00000100:00100000:0.0:1789760780.852587:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719095663367 time 719112879018 state 0x0 ref 1 00000100:00100000:0.0:1789760780.852598:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.852638:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71909376, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224b8 00010000:00010000:0.0:1789760780.852645:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.852657:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.852660:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.852664:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.852674:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.859287:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984864 is committed 00002000:00010000:0.0:1789760780.863293:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71909376 -> 71913472 00002000:00010000:0.0:1789760780.863303:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140472 -> 140480 00010000:00010000:0.0:1789760780.863317:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863330:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863344:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863350:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.863355:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863363:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863383:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.863389:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71909376->71913471] (req 71909376->71913471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.863486:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10884us (11141us total) trans 4294984864 rc 0/0 00000100:00100000:0.0:1789760780.863497:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17567 00000100:00100000:0.0:1789760780.863506:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719095663367 time 719112879018 state 0x2 ref 0 00000100:00100000:3.0:1789760780.868643:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.868755:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477376 00000100:00100000:2.0:1789760780.868766:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477376 00000100:00100000:2.0:1789760780.868972:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719095663367 time 719112879018 state 0x0 ref 1 00000100:00100000:2.0:1789760780.868991:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719113139434 time 719112879018 state 0x1 ref 1 00000100:00100000:2.0:1789760780.869035:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719113139434 time 719129325353 state 0x0 ref 1 00000100:00100000:2.0:1789760780.869052:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565477376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.869106:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71913472, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224c0 00010000:00010000:2.0:1789760780.869118:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.869142:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760780.869147:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.869155:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.869171:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.874574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984865 is committed 00002000:00010000:2.0:1789760780.874787:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71913472 -> 71917568 00002000:00010000:2.0:1789760780.874792:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140480 -> 140488 00010000:00010000:2.0:1789760780.874805:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874817:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874826:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874833:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.874838:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874847:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874871:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.874879:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71913472->71917567] (req 71913472->71917567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.874972:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565477376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5921us (6334us total) trans 4294984865 rc 0/0 00000100:00100000:2.0:1789760780.874983:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17568 00000100:00100000:2.0:1789760780.874992:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719113139434 time 719129325353 state 0x2 ref 0 00000100:00100000:2.0:1789760780.880060:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.880433:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477504 00000100:00100000:0.0:1789760780.880443:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477504 00000100:00100000:0.0:1789760780.880498:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719113139434 time 719129325353 state 0x0 ref 1 00000100:00100000:0.0:1789760780.880517:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719129585769 time 719129325353 state 0x1 ref 1 00000100:00100000:0.0:1789760780.880548:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719129585769 time 719140839377 state 0x0 ref 1 00000100:00100000:0.0:1789760780.880561:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565477504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.880607:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71917568, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224c8 00010000:00010000:0.0:1789760780.880616:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.880632:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.880636:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.880642:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.880656:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.890338:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984866 is committed 00002000:00010000:0.0:1789760780.890533:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71917568 -> 71921664 00002000:00010000:0.0:1789760780.890538:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140488 -> 140496 00010000:00010000:0.0:1789760780.890552:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890565:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890574:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890582:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.890587:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890596:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890616:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.890625:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71917568->71921663] (req 71917568->71921663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.890767:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565477504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10203us (10718us total) trans 4294984866 rc 0/0 00000100:00100000:0.0:1789760780.890777:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17569 00000100:00100000:0.0:1789760780.890787:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719129585769 time 719140839377 state 0x2 ref 0 00000100:00100000:3.0:1789760780.897270:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.897403:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477632 00000100:00100000:0.0:1789760780.897413:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477632 00000100:00100000:0.0:1789760780.897476:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719129585769 time 719140839377 state 0x0 ref 1 00000100:00100000:0.0:1789760780.897492:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719141099793 time 719140839377 state 0x1 ref 1 00000100:00100000:0.0:1789760780.897518:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719141099793 time 719157810400 state 0x0 ref 1 00000100:00100000:0.0:1789760780.897534:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.897578:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71921664, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224d0 00010000:00010000:0.0:1789760780.897587:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.897602:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.897606:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.897612:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.897627:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.905189:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984867 is committed 00002000:00010000:2.0:1789760780.905341:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71921664 -> 71925760 00002000:00010000:2.0:1789760780.905347:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140496 -> 140504 00010000:00010000:2.0:1789760780.905360:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905372:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905381:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905389:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.905395:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905404:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905423:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.905431:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71921664->71925759] (req 71921664->71925759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.905528:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7992us (8263us total) trans 4294984867 rc 0/0 00000100:00100000:2.0:1789760780.905539:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17570 00000100:00100000:2.0:1789760780.905548:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719141099793 time 719157810400 state 0x2 ref 0 00000100:00100000:3.0:1789760780.909135:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.909213:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477760 00000100:00100000:2.0:1789760780.909223:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477760 00000100:00100000:2.0:1789760780.909274:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719141099793 time 719157810400 state 0x0 ref 1 00000100:00100000:2.0:1789760780.909287:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719158070816 time 719157810400 state 0x1 ref 1 00000100:00100000:2.0:1789760780.909319:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719158070816 time 719169611202 state 0x0 ref 1 00000100:00100000:2.0:1789760780.909332:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565477760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.909380:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71925760, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224d8 00010000:00010000:2.0:1789760780.909390:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.909406:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760780.909411:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.909418:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.909432:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.919929:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984868 is committed 00002000:00010000:3.0:1789760780.920753:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71925760 -> 71929856 00002000:00010000:3.0:1789760780.920760:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140504 -> 140512 00010000:00010000:3.0:1789760780.920774:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920859:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920871:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920879:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760780.920884:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920895:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920916:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760780.920931:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674df38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71925760->71929855] (req 71925760->71929855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760780.921027:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565477760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11692us (11895us total) trans 4294984868 rc 0/0 00000100:00100000:3.0:1789760780.921037:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17571 00000100:00100000:3.0:1789760780.921047:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719158070816 time 719169611202 state 0x2 ref 0 00000100:00100000:0.0:1789760780.927465:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.927616:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565477888 00000100:00100000:2.0:1789760780.927626:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565477888 00000100:00100000:2.0:1789760780.927685:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719158070816 time 719169611202 state 0x0 ref 1 00000100:00100000:2.0:1789760780.927701:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719169871618 time 719169611202 state 0x1 ref 1 00000100:00100000:2.0:1789760780.927764:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719169871618 time 719188055893 state 0x0 ref 1 00000100:00100000:2.0:1789760780.927777:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.927823:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71929856, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0x224e0 00010000:00010000:2.0:1789760780.927833:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.927849:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760780.927854:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.927861:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.927875:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.934154:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984869 is committed 00002000:00010000:2.0:1789760780.934275:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71929856 -> 71933952 00002000:00010000:2.0:1789760780.934280:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760780 -> 1789760781 00002000:00010000:2.0:1789760780.934283:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760780 -> 1789760781 00002000:00010000:2.0:1789760780.934285:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140512 -> 140520 00010000:00010000:2.0:1789760780.934298:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934310:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934319:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934326:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.934331:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934339:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934358:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.934367:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674df3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71929856->71933951] (req 71929856->71933951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.934458:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565477888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6679us (6998us total) trans 4294984869 rc 0/0 00000100:00100000:2.0:1789760780.934469:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17572 00000100:00100000:2.0:1789760780.934478:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719169871618 time 719188055893 state 0x2 ref 0 00000100:00100000:2.0:1789760780.940272:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.940358:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478016 00000100:00100000:0.0:1789760780.940367:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478016 00000100:00100000:0.0:1789760780.940425:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719169871618 time 719188055893 state 0x0 ref 1 00000100:00100000:0.0:1789760780.940440:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719188316309 time 719188055893 state 0x1 ref 1 00000100:00100000:0.0:1789760780.940470:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719188316309 time 719200762234 state 0x0 ref 1 00000100:00100000:0.0:1789760780.940482:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565478016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.940532:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71933952, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x224e8 00010000:00010000:0.0:1789760780.940544:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.940559:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.940564:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.940570:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.940583:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.946497:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984870 is committed 00002000:00010000:0.0:1789760780.947889:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71933952 -> 71938048 00002000:00010000:0.0:1789760780.947899:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140520 -> 140528 00010000:00010000:0.0:1789760780.947913:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947926:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947935:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947944:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.947948:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947957:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947977:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.947986:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71933952->71938047] (req 71933952->71938047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.948187:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565478016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7701us (7920us total) trans 4294984870 rc 0/0 00000100:00100000:0.0:1789760780.948198:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17573 00000100:00100000:0.0:1789760780.948207:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719188316309 time 719200762234 state 0x2 ref 0 00000100:00100000:3.0:1789760780.954154:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.954252:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478144 00000100:00100000:2.0:1789760780.954261:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478144 00000100:00100000:2.0:1789760780.954317:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719188316309 time 719200762234 state 0x0 ref 1 00000100:00100000:2.0:1789760780.954333:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719201022650 time 719200762234 state 0x1 ref 1 00000100:00100000:2.0:1789760780.954363:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719201022650 time 719214655314 state 0x0 ref 1 00000100:00100000:2.0:1789760780.954376:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.954421:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71938048, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x224f0 00010000:00010000:2.0:1789760780.954431:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.954551:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760780.954555:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.954564:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.954579:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760780.959766:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984871 is committed 00002000:00010000:2.0:1789760780.960037:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71938048 -> 71942144 00002000:00010000:2.0:1789760780.960042:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140528 -> 140536 00010000:00010000:2.0:1789760780.960114:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960129:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960139:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960148:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.960154:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960242:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960263:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.960277:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674df4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71938048->71942143] (req 71938048->71942143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.960421:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6041us (6270us total) trans 4294984871 rc 0/0 00000100:00100000:2.0:1789760780.960433:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17574 00000100:00100000:2.0:1789760780.960452:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719201022650 time 719214655314 state 0x2 ref 0 00000100:00100000:2.0:1789760780.964912:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.965066:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478272 00000100:00100000:0.0:1789760780.965076:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478272 00000100:00100000:0.0:1789760780.965131:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719201022650 time 719214655314 state 0x0 ref 1 00000100:00100000:0.0:1789760780.965146:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719214915730 time 719214655314 state 0x1 ref 1 00000100:00100000:0.0:1789760780.965183:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719214915730 time 719225474928 state 0x0 ref 1 00000100:00100000:0.0:1789760780.965196:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.965244:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71942144, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x224f8 00010000:00010000:0.0:1789760780.965253:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.965285:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.965290:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.965297:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.965311:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760780.971047:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984872 is committed 00002000:00010000:0.0:1789760780.971212:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71942144 -> 71946240 00002000:00010000:0.0:1789760780.971217:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140536 -> 140544 00010000:00010000:0.0:1789760780.971229:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971242:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971252:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971261:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.971266:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971275:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971366:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.971375:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71942144->71946239] (req 71942144->71946239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.971567:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6368us (6660us total) trans 4294984872 rc 0/0 00000100:00100000:0.0:1789760780.971578:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17575 00000100:00100000:0.0:1789760780.971589:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719214915730 time 719225474928 state 0x2 ref 0 00000100:00100000:3.0:1789760780.978213:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760780.978450:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478400 00000100:00100000:0.0:1789760780.978460:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478400 00000100:00100000:0.0:1789760780.978510:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719214915730 time 719225474928 state 0x0 ref 1 00000100:00100000:0.0:1789760780.978525:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719225735344 time 719225474928 state 0x1 ref 1 00000100:00100000:0.0:1789760780.978555:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719225735344 time 719238847013 state 0x0 ref 1 00000100:00100000:0.0:1789760780.978566:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760780.978612:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71946240, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22500 00010000:00010000:0.0:1789760780.978620:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.978635:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760780.978641:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.978646:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.978660:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.983588:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984873 is committed 00002000:00010000:0.0:1789760780.983739:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71946240 -> 71950336 00002000:00010000:0.0:1789760780.983744:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140544 -> 140552 00010000:00010000:0.0:1789760780.983757:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983770:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983779:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983786:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760780.983791:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983800:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983819:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.983831:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71946240->71950335] (req 71946240->71950335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.983922:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5353us (5714us total) trans 4294984873 rc 0/0 00000100:00100000:0.0:1789760780.983932:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17576 00000100:00100000:0.0:1789760780.983941:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719225735344 time 719238847013 state 0x2 ref 0 00000100:00100000:3.0:1789760780.993829:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760780.994280:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478528 00000100:00100000:2.0:1789760780.994290:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478528 00000100:00100000:2.0:1789760780.994343:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719225735344 time 719238847013 state 0x0 ref 1 00000100:00100000:2.0:1789760780.994357:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719239107429 time 719238847013 state 0x1 ref 1 00000100:00100000:2.0:1789760780.994390:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719239107429 time 719254682020 state 0x0 ref 1 00000100:00100000:2.0:1789760780.994402:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760780.994448:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71950336, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22508 00010000:00010000:2.0:1789760780.994456:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.994470:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760780.994474:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.994481:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.994494:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760780.998587:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984874 is committed 00002000:00010000:2.0:1789760780.998910:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71950336 -> 71954432 00002000:00010000:2.0:1789760780.998915:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140552 -> 140560 00010000:00010000:2.0:1789760780.998929:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.998941:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.998950:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.998958:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760780.998963:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.998973:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.998991:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.999002:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674df62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71950336->71954431] (req 71950336->71954431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.999389:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4983us (5562us total) trans 4294984874 rc 0/0 00000100:00100000:2.0:1789760780.999400:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17577 00000100:00100000:2.0:1789760780.999409:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719239107429 time 719254682020 state 0x2 ref 0 00000100:00100000:2.0:1789760781.008562:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.009552:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478656 00000100:00100000:0.0:1789760781.009564:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478656 00000100:00100000:0.0:1789760781.009626:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719239107429 time 719254682020 state 0x0 ref 1 00000100:00100000:0.0:1789760781.009643:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719254942436 time 719254682020 state 0x1 ref 1 00000100:00100000:0.0:1789760781.009852:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719254942436 time 719270141979 state 0x0 ref 1 00000100:00100000:0.0:1789760781.009867:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.009917:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71954432, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22510 00010000:00010000:0.0:1789760781.009926:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.009941:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.009946:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.009952:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.009970:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.015264:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984875 is committed 00002000:00010000:0.0:1789760781.017215:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71954432 -> 71958528 00002000:00010000:0.0:1789760781.017224:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140560 -> 140568 00010000:00010000:0.0:1789760781.017237:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017250:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017259:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017267:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.017272:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017281:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017300:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.017307:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674df69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71954432->71958527] (req 71954432->71958527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.017405:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7538us (8848us total) trans 4294984875 rc 0/0 00000100:00100000:0.0:1789760781.017417:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17578 00000100:00100000:0.0:1789760781.017426:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719254942436 time 719270141979 state 0x2 ref 0 00000100:00100000:3.0:1789760781.020201:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.020264:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478784 00000100:00100000:0.0:1789760781.020273:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478784 00000100:00100000:0.0:1789760781.020323:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719254942436 time 719270141979 state 0x0 ref 1 00000100:00100000:0.0:1789760781.020336:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719270402395 time 719270141979 state 0x1 ref 1 00000100:00100000:0.0:1789760781.020368:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719270402395 time 719280660476 state 0x0 ref 1 00000100:00100000:0.0:1789760781.020380:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.020424:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71958528, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22518 00010000:00010000:0.0:1789760781.020433:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.020448:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.020452:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.020458:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.020472:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.025059:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984876 is committed 00002000:00010000:0.0:1789760781.025195:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71958528 -> 71962624 00002000:00010000:0.0:1789760781.025200:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140568 -> 140576 00010000:00010000:0.0:1789760781.025213:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025224:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025234:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025241:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.025245:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025254:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025273:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.025280:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71958528->71962623] (req 71958528->71962623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.025379:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565478784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4997us (5292us total) trans 4294984876 rc 0/0 00000100:00100000:0.0:1789760781.025390:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17579 00000100:00100000:0.0:1789760781.025399:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719270402395 time 719280660476 state 0x2 ref 0 00000100:00100000:3.0:1789760781.032148:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.032292:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565478912 00000100:00100000:2.0:1789760781.032302:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565478912 00000100:00100000:2.0:1789760781.032353:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719270402395 time 719280660476 state 0x0 ref 1 00000100:00100000:2.0:1789760781.032367:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719280920892 time 719280660476 state 0x1 ref 1 00000100:00100000:2.0:1789760781.032394:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719280920892 time 719292686851 state 0x0 ref 1 00000100:00100000:2.0:1789760781.032406:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.032449:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71962624, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22520 00010000:00010000:2.0:1789760781.032458:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.032473:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.032477:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.032483:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.032498:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.038521:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984877 is committed 00002000:00010000:3.0:1789760781.038630:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71962624 -> 71966720 00002000:00010000:3.0:1789760781.038635:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140576 -> 140584 00010000:00010000:3.0:1789760781.038659:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038673:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038682:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038690:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760781.038696:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038727:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038746:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.038754:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674df77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71962624->71966719] (req 71962624->71966719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760781.038884:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565478912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6474us (6751us total) trans 4294984877 rc 0/0 00000100:00100000:3.0:1789760781.038894:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17580 00000100:00100000:3.0:1789760781.038903:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719280920892 time 719292686851 state 0x2 ref 0 00000100:00100000:2.0:1789760781.050952:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.051057:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479040 00000100:00100000:0.0:1789760781.051067:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479040 00000100:00100000:0.0:1789760781.051121:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719280920892 time 719292686851 state 0x0 ref 1 00000100:00100000:0.0:1789760781.051135:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719292947267 time 719292686851 state 0x1 ref 1 00000100:00100000:0.0:1789760781.051160:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719292947267 time 719311452749 state 0x0 ref 1 00000100:00100000:0.0:1789760781.051173:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.051226:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71966720, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22528 00010000:00010000:0.0:1789760781.051235:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.051251:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.051255:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.051261:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.051275:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.056469:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984878 is committed 00002000:00010000:0.0:1789760781.058406:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71966720 -> 71970816 00002000:00010000:0.0:1789760781.058415:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140584 -> 140592 00010000:00010000:0.0:1789760781.058430:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058443:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058465:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058474:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.058479:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058488:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058508:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.058516:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71966720->71970815] (req 71966720->71970815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.058666:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7491us (7719us total) trans 4294984878 rc 0/0 00000100:00100000:0.0:1789760781.058677:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17581 00000100:00100000:0.0:1789760781.058687:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719292947267 time 719311452749 state 0x2 ref 0 00000100:00100000:2.0:1789760781.067603:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.068611:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479168 00000100:00100000:0.0:1789760781.068623:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479168 00000100:00100000:0.0:1789760781.068689:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719292947267 time 719311452749 state 0x0 ref 1 00000100:00100000:0.0:1789760781.069170:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719311713165 time 719311452749 state 0x1 ref 1 00000100:00100000:1.0:1789760781.069344:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719311713165 time 719329634036 state 0x0 ref 1 00000100:00100000:1.0:1789760781.069362:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565479168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.069410:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71970816, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22530 00010000:00010000:1.0:1789760781.069419:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.069443:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.069448:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.069455:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.069468:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.079998:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984879 is committed 00002000:00010000:1.0:1789760781.080131:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71970816 -> 71974912 00002000:00010000:1.0:1789760781.080236:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140592 -> 140600 00010000:00010000:1.0:1789760781.080250:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080263:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080272:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080280:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.080285:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080294:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080313:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.080321:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71970816->71974911] (req 71970816->71974911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.080414:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565479168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11053us (12815us total) trans 4294984879 rc 0/0 00000100:00100000:1.0:1789760781.080424:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17582 00000100:00100000:1.0:1789760781.080433:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719311713165 time 719329634036 state 0x2 ref 0 00000100:00100000:3.0:1789760781.087397:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.088136:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479296 00000100:00100000:2.0:1789760781.088147:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479296 00000100:00100000:2.0:1789760781.088214:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719311713165 time 719329634036 state 0x0 ref 1 00000100:00100000:2.0:1789760781.089323:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719329894452 time 719329634036 state 0x1 ref 1 00000100:00100000:2.0:1789760781.089409:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719329894452 time 719349700565 state 0x0 ref 1 00000100:00100000:2.0:1789760781.089447:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565479296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.089498:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71974912, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22538 00010000:00010000:2.0:1789760781.089508:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.089525:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.089530:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.089535:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.089555:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.097563:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984880 is committed 00002000:00010000:2.0:1789760781.097782:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71974912 -> 71979008 00002000:00010000:2.0:1789760781.097962:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140600 -> 140608 00010000:00010000:2.0:1789760781.097975:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.097987:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.097997:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.098004:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.098009:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.098018:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.098103:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.098111:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674df8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71974912->71979007] (req 71974912->71979007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.098324:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565479296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8880us (10930us total) trans 4294984880 rc 0/0 00000100:00100000:2.0:1789760781.098336:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17583 00000100:00100000:2.0:1789760781.098345:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719329894452 time 719349700565 state 0x2 ref 0 00000100:00100000:2.0:1789760781.104943:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.105041:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479424 00000100:00100000:0.0:1789760781.105060:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479424 00000100:00100000:0.0:1789760781.105113:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719329894452 time 719349700565 state 0x0 ref 1 00000100:00100000:0.0:1789760781.105126:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719349960981 time 719349700565 state 0x1 ref 1 00000100:00100000:0.0:1789760781.105156:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719349960981 time 719365448191 state 0x0 ref 1 00000100:00100000:0.0:1789760781.105169:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.105216:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71979008, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22540 00010000:00010000:0.0:1789760781.105226:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.105242:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.105246:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.105253:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.105267:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.112812:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984881 is committed 00002000:00010000:0.0:1789760781.112919:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71979008 -> 71983104 00002000:00010000:0.0:1789760781.112925:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140608 -> 140616 00010000:00010000:0.0:1789760781.112937:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.112950:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.112958:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.112966:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.112971:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.112980:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.112999:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.113007:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674df93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71979008->71983103] (req 71979008->71983103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.113104:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7933us (8166us total) trans 4294984881 rc 0/0 00000100:00100000:0.0:1789760781.113117:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17584 00000100:00100000:0.0:1789760781.113125:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719349960981 time 719365448191 state 0x2 ref 0 00000100:00100000:3.0:1789760781.117146:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.117569:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479552 00000100:00100000:1.0:1789760781.117579:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479552 00000100:00100000:1.0:1789760781.117632:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719349960981 time 719365448191 state 0x0 ref 1 00000100:00100000:1.0:1789760781.117648:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719365708607 time 719365448191 state 0x1 ref 1 00000100:00100000:1.0:1789760781.118734:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719365708607 time 719379020589 state 0x0 ref 1 00000100:00100000:1.0:1789760781.119060:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.119111:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71983104, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22548 00010000:00010000:1.0:1789760781.119121:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.119142:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.119147:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.119153:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.119167:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.123602:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984882 is committed 00002000:00010000:1.0:1789760781.123821:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71983104 -> 71987200 00002000:00010000:1.0:1789760781.123826:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140616 -> 140624 00010000:00010000:1.0:1789760781.123839:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123852:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123862:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123870:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.123876:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123885:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123906:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.123914:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674df9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71983104->71987199] (req 71983104->71987199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.124008:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4952us (6866us total) trans 4294984882 rc 0/0 00000100:00100000:1.0:1789760781.124019:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17585 00000100:00100000:1.0:1789760781.124030:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719365708607 time 719379020589 state 0x2 ref 0 00000100:00100000:0.0:1789760781.128003:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.128153:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479680 00000100:00100000:2.0:1789760781.128163:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479680 00000100:00100000:2.0:1789760781.128214:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719365708607 time 719379020589 state 0x0 ref 1 00000100:00100000:2.0:1789760781.128230:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719379281005 time 719379020589 state 0x1 ref 1 00000100:00100000:2.0:1789760781.128259:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719379281005 time 719388550930 state 0x0 ref 1 00000100:00100000:2.0:1789760781.128271:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.128314:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71987200, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22550 00010000:00010000:2.0:1789760781.128324:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.128340:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.128345:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.128351:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.128371:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.133484:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984883 is committed 00002000:00010000:2.0:1789760781.133636:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71987200 -> 71991296 00002000:00010000:2.0:1789760781.133641:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140624 -> 140632 00010000:00010000:2.0:1789760781.133758:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133771:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133780:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133788:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.133793:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133802:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133821:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.133829:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674dfa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71987200->71991295] (req 71987200->71991295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.133965:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5690us (5965us total) trans 4294984883 rc 0/0 00000100:00100000:2.0:1789760781.133978:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17586 00000100:00100000:2.0:1789760781.133987:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719379281005 time 719388550930 state 0x2 ref 0 00000100:00100000:2.0:1789760781.140236:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.140332:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479808 00000100:00100000:0.0:1789760781.140342:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479808 00000100:00100000:0.0:1789760781.140395:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719379281005 time 719388550930 state 0x0 ref 1 00000100:00100000:0.0:1789760781.140411:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719388811346 time 719388550930 state 0x1 ref 1 00000100:00100000:0.0:1789760781.140445:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719388811346 time 719400737410 state 0x0 ref 1 00000100:00100000:0.0:1789760781.140458:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.140501:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71991296, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22558 00010000:00010000:0.0:1789760781.140511:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.140527:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.140532:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.140539:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.140553:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.144506:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984884 is committed 00002000:00010000:0.0:1789760781.144619:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71991296 -> 71995392 00002000:00010000:0.0:1789760781.144625:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140632 -> 140640 00010000:00010000:0.0:1789760781.144639:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144661:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144670:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144678:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.144683:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144693:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144751:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.144760:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71991296->71995391] (req 71991296->71995391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.144907:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565479808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4445us (4674us total) trans 4294984884 rc 0/0 00000100:00100000:0.0:1789760781.144918:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17587 00000100:00100000:0.0:1789760781.144927:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719388811346 time 719400737410 state 0x2 ref 0 00000100:00100000:3.0:1789760781.148581:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.148696:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565479936 00000100:00100000:1.0:1789760781.148734:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565479936 00000100:00100000:1.0:1789760781.148790:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719388811346 time 719400737410 state 0x0 ref 1 00000100:00100000:1.0:1789760781.148805:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719400997826 time 719400737410 state 0x1 ref 1 00000100:00100000:1.0:1789760781.148837:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719400997826 time 719409128884 state 0x0 ref 1 00000100:00100000:1.0:1789760781.148849:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.148899:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71995392, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22560 00010000:00010000:1.0:1789760781.148909:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.148930:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.148935:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.148946:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.148962:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.153649:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984885 is committed 00002000:00010000:1.0:1789760781.154034:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71995392 -> 71999488 00002000:00010000:1.0:1789760781.154040:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140640 -> 140648 00010000:00010000:1.0:1789760781.154053:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154066:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154074:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154082:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.154087:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154099:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154125:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.154133:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674dfaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71995392->71999487] (req 71995392->71999487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.154222:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565479936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5371us (5645us total) trans 4294984885 rc 0/0 00000100:00100000:1.0:1789760781.154232:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17588 00000100:00100000:1.0:1789760781.154242:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719400997826 time 719409128884 state 0x2 ref 0 00000100:00100000:0.0:1789760781.160126:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.160224:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480064 00000100:00100000:2.0:1789760781.160234:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480064 00000100:00100000:2.0:1789760781.160289:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719400997826 time 719409128884 state 0x0 ref 1 00000100:00100000:2.0:1789760781.160305:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719409389300 time 719409128884 state 0x1 ref 1 00000100:00100000:0.0:1789760781.160368:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719409389300 time 719420658397 state 0x0 ref 1 00000100:00100000:0.0:1789760781.160384:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.160427:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71999488, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22568 00010000:00010000:0.0:1789760781.160434:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.160446:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.160450:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.160454:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.160465:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.164981:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984886 is committed 00002000:00010000:0.0:1789760781.165261:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71999488 -> 72003584 00002000:00010000:0.0:1789760781.165266:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140648 -> 140656 00010000:00010000:0.0:1789760781.165280:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165292:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165300:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165312:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.165316:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165323:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165340:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.165347:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71999488->72003583] (req 71999488->72003583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.165435:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5051us (5312us total) trans 4294984886 rc 0/0 00000100:00100000:0.0:1789760781.165445:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17589 00000100:00100000:0.0:1789760781.165454:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719409389300 time 719420658397 state 0x2 ref 0 00000100:00100000:2.0:1789760781.169324:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.169404:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480192 00000100:00100000:0.0:1789760781.169415:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480192 00000100:00100000:0.0:1789760781.169474:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719409389300 time 719420658397 state 0x0 ref 1 00000100:00100000:0.0:1789760781.169489:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719420918813 time 719420658397 state 0x1 ref 1 00000100:00100000:0.0:1789760781.169557:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719420918813 time 719429848812 state 0x0 ref 1 00000100:00100000:0.0:1789760781.169574:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.169628:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72003584, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22570 00010000:00010000:0.0:1789760781.169637:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.169653:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.169657:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.169664:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.169678:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.175013:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984887 is committed 00002000:00010000:0.0:1789760781.175169:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72003584 -> 72007680 00002000:00010000:0.0:1789760781.175175:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140656 -> 140664 00010000:00010000:0.0:1789760781.175187:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175201:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175210:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175217:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.175223:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175233:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175252:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.175260:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72003584->72007679] (req 72003584->72007679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.175412:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5836us (6092us total) trans 4294984887 rc 0/0 00000100:00100000:0.0:1789760781.175423:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17590 00000100:00100000:0.0:1789760781.175432:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719420918813 time 719429848812 state 0x2 ref 0 00000100:00100000:3.0:1789760781.180104:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.180414:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480320 00000100:00100000:1.0:1789760781.180422:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480320 00000100:00100000:1.0:1789760781.180475:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719420918813 time 719429848812 state 0x0 ref 1 00000100:00100000:1.0:1789760781.180495:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719430109228 time 719429848812 state 0x1 ref 1 00000100:00100000:1.0:1789760781.180585:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719430109228 time 719440876312 state 0x0 ref 1 00000100:00100000:1.0:1789760781.180598:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.180741:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72007680, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22578 00010000:00010000:1.0:1789760781.180753:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.180773:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.180778:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.180784:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.180798:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.187032:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984888 is committed 00002000:00010000:1.0:1789760781.187204:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72007680 -> 72011776 00002000:00010000:1.0:1789760781.187209:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140664 -> 140672 00010000:00010000:1.0:1789760781.187224:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187237:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187246:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187253:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.187257:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187267:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187286:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.187298:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674dfc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72007680->72011775] (req 72007680->72011775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.187439:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6830us (7330us total) trans 4294984888 rc 0/0 00000100:00100000:1.0:1789760781.187450:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17591 00000100:00100000:1.0:1789760781.187461:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719430109228 time 719440876312 state 0x2 ref 0 00000100:00100000:1.0:1789760781.194141:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.194214:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480448 00000100:00100000:0.0:1789760781.194223:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480448 00000100:00100000:0.0:1789760781.194279:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719430109228 time 719440876312 state 0x0 ref 1 00000100:00100000:0.0:1789760781.194294:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719441136728 time 719440876312 state 0x1 ref 1 00000100:00100000:0.0:1789760781.194325:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719441136728 time 719454616573 state 0x0 ref 1 00000100:00100000:0.0:1789760781.194338:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.194384:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72011776, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22580 00010000:00010000:0.0:1789760781.194398:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.194414:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.194418:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.194424:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.194437:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.199297:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984889 is committed 00002000:00010000:0.0:1789760781.199466:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72011776 -> 72015872 00002000:00010000:0.0:1789760781.199471:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140672 -> 140680 00010000:00010000:0.0:1789760781.199484:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199495:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199504:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199511:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.199516:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199524:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199543:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.199551:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dfcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72011776->72015871] (req 72011776->72015871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.199700:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5360us (5575us total) trans 4294984889 rc 0/0 00000100:00100000:0.0:1789760781.199763:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17592 00000100:00100000:0.0:1789760781.199772:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719441136728 time 719454616573 state 0x2 ref 0 00000100:00100000:2.0:1789760781.204550:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.204859:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480576 00000100:00100000:0.0:1789760781.204869:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480576 00000100:00100000:0.0:1789760781.204930:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719441136728 time 719454616573 state 0x0 ref 1 00000100:00100000:0.0:1789760781.204946:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719454876989 time 719454616573 state 0x1 ref 1 00000100:00100000:0.0:1789760781.204976:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719454876989 time 719465268415 state 0x0 ref 1 00000100:00100000:0.0:1789760781.204989:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.205037:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72015872, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22588 00010000:00010000:0.0:1789760781.205046:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.205062:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.205067:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.205073:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.205090:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.210419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984890 is committed 00002000:00010000:0.0:1789760781.210841:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72015872 -> 72019968 00002000:00010000:0.0:1789760781.210846:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140680 -> 140688 00010000:00010000:0.0:1789760781.210859:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210872:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210882:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210889:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.210893:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210908:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210928:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.210942:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72015872->72019967] (req 72015872->72019967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.211038:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6047us (6494us total) trans 4294984890 rc 0/0 00000100:00100000:0.0:1789760781.211053:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17593 00000100:00100000:0.0:1789760781.211062:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719454876989 time 719465268415 state 0x2 ref 0 00000100:00100000:3.0:1789760781.215500:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.215566:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480704 00000100:00100000:1.0:1789760781.215575:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480704 00000100:00100000:1.0:1789760781.215628:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719454876989 time 719465268415 state 0x0 ref 1 00000100:00100000:1.0:1789760781.215643:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719465528831 time 719465268415 state 0x1 ref 1 00000100:00100000:1.0:1789760781.215671:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719465528831 time 719475963572 state 0x0 ref 1 00000100:00100000:1.0:1789760781.215684:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.218415:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72019968, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22590 00010000:00010000:1.0:1789760781.218430:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.218447:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.218451:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.218458:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.218473:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.225617:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984891 is committed 00002000:00010000:1.0:1789760781.225784:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72019968 -> 72024064 00002000:00010000:1.0:1789760781.225790:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140688 -> 140696 00010000:00010000:1.0:1789760781.225804:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.225817:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.225825:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.225832:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.225836:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.225844:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.226114:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.226123:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674dfd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72019968->72024063] (req 72019968->72024063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.226209:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10523us (10715us total) trans 4294984891 rc 0/0 00000100:00100000:1.0:1789760781.226221:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17594 00000100:00100000:1.0:1789760781.226230:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719465528831 time 719475963572 state 0x2 ref 0 00000100:00100000:1.0:1789760781.231031:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.232367:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480832 00000100:00100000:0.0:1789760781.232383:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480832 00000100:00100000:0.0:1789760781.232457:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719465528831 time 719475963572 state 0x0 ref 1 00000100:00100000:0.0:1789760781.232473:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719476223988 time 719475963572 state 0x1 ref 1 00000100:00100000:0.0:1789760781.232508:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719476223988 time 719492800444 state 0x0 ref 1 00000100:00100000:0.0:1789760781.232523:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.232579:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72024064, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22598 00010000:00010000:0.0:1789760781.232588:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.232603:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.232607:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.232614:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.232632:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.238114:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984892 is committed 00002000:00010000:0.0:1789760781.238237:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72024064 -> 72028160 00002000:00010000:0.0:1789760781.238242:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140696 -> 140704 00010000:00010000:0.0:1789760781.238255:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238267:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238276:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238283:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.238288:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238297:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238316:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.238323:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72024064->72028159] (req 72024064->72028159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.238419:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565480832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5895us (7392us total) trans 4294984892 rc 0/0 00000100:00100000:0.0:1789760781.238430:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17595 00000100:00100000:0.0:1789760781.238440:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719476223988 time 719492800444 state 0x2 ref 0 00000100:00100000:2.0:1789760781.246009:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.246218:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565480960 00000100:00100000:0.0:1789760781.246229:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565480960 00000100:00100000:0.0:1789760781.246285:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719476223988 time 719492800444 state 0x0 ref 1 00000100:00100000:0.0:1789760781.246301:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719493060860 time 719492800444 state 0x1 ref 1 00000100:00100000:0.0:1789760781.246333:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719493060860 time 719506624952 state 0x0 ref 1 00000100:00100000:0.0:1789760781.246347:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.246399:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72028160, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225a0 00010000:00010000:0.0:1789760781.246410:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.246424:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.246428:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.246434:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.246447:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.251255:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984893 is committed 00002000:00010000:0.0:1789760781.251457:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72028160 -> 72032256 00002000:00010000:0.0:1789760781.251463:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140704 -> 140712 00010000:00010000:0.0:1789760781.251476:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251489:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251568:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251576:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.251581:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251591:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251610:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.251619:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dfe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72028160->72032255] (req 72028160->72032255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.251897:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565480960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5549us (5965us total) trans 4294984893 rc 0/0 00000100:00100000:0.0:1789760781.251908:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17596 00000100:00100000:0.0:1789760781.251918:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719493060860 time 719506624952 state 0x2 ref 0 00000100:00100000:3.0:1789760781.261933:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.262053:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481088 00000100:00100000:1.0:1789760781.262063:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481088 00000100:00100000:1.0:1789760781.262185:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719493060860 time 719506624952 state 0x0 ref 1 00000100:00100000:1.0:1789760781.262205:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719506885368 time 719506624952 state 0x1 ref 1 00000100:00100000:1.0:1789760781.262237:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719506885368 time 719522529672 state 0x0 ref 1 00000100:00100000:1.0:1789760781.262250:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.262299:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72032256, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225a8 00010000:00010000:1.0:1789760781.262308:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.262323:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.262327:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.262334:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.262354:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.266544:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984894 is committed 00002000:00010000:1.0:1789760781.266664:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72032256 -> 72036352 00002000:00010000:1.0:1789760781.266669:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140712 -> 140720 00010000:00010000:1.0:1789760781.266681:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266695:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266743:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266752:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.266757:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266766:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266787:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.266794:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674dfee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72032256->72036351] (req 72032256->72036351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.266884:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4632us (4955us total) trans 4294984894 rc 0/0 00000100:00100000:1.0:1789760781.266894:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17597 00000100:00100000:1.0:1789760781.266903:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719506885368 time 719522529672 state 0x2 ref 0 00000100:00100000:1.0:1789760781.276859:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.276922:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481216 00000100:00100000:0.0:1789760781.276933:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481216 00000100:00100000:0.0:1789760781.276989:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719506885368 time 719522529672 state 0x0 ref 1 00000100:00100000:0.0:1789760781.277005:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719522790088 time 719522529672 state 0x1 ref 1 00000100:00100000:0.0:1789760781.277082:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719522790088 time 719537373935 state 0x0 ref 1 00000100:00100000:0.0:1789760781.277096:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.277150:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72036352, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225b0 00010000:00010000:0.0:1789760781.277160:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.277176:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.277181:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.277187:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.277202:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.284015:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984895 is committed 00002000:00010000:0.0:1789760781.284152:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72036352 -> 72040448 00002000:00010000:0.0:1789760781.284158:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140720 -> 140728 00010000:00010000:0.0:1789760781.284172:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284185:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284194:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284201:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.284206:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284216:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284236:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.284244:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674dff5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72036352->72040447] (req 72036352->72040447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.284337:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7238us (7482us total) trans 4294984895 rc 0/0 00000100:00100000:0.0:1789760781.284348:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17598 00000100:00100000:0.0:1789760781.284357:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719522790088 time 719537373935 state 0x2 ref 0 00000100:00100000:2.0:1789760781.290429:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.290545:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481344 00000100:00100000:0.0:1789760781.290554:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481344 00000100:00100000:0.0:1789760781.290610:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719522790088 time 719537373935 state 0x0 ref 1 00000100:00100000:0.0:1789760781.290627:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719537634351 time 719537373935 state 0x1 ref 1 00000100:00100000:0.0:1789760781.290686:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719537634351 time 719550977940 state 0x0 ref 1 00000100:00100000:0.0:1789760781.290701:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565481344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.290784:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72040448, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225b8 00010000:00010000:0.0:1789760781.290793:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.290809:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.290814:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.290820:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.290843:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.296527:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984896 is committed 00002000:00010000:0.0:1789760781.297265:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72040448 -> 72044544 00002000:00010000:0.0:1789760781.297272:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140728 -> 140736 00010000:00010000:0.0:1789760781.297284:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297301:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297309:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297316:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.297320:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297329:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297349:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.297356:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674dffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72040448->72044543] (req 72040448->72044543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.297450:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565481344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6748us (7024us total) trans 4294984896 rc 0/0 00000100:00100000:0.0:1789760781.297460:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17599 00000100:00100000:0.0:1789760781.297470:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719537634351 time 719550977940 state 0x2 ref 0 00000100:00100000:3.0:1789760781.305366:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.307132:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481472 00000100:00100000:1.0:1789760781.307145:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481472 00000100:00100000:1.0:1789760781.307207:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719537634351 time 719550977940 state 0x0 ref 1 00000100:00100000:1.0:1789760781.307222:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719551238356 time 719550977940 state 0x1 ref 1 00000100:00100000:1.0:1789760781.307296:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719551238356 time 719567587843 state 0x0 ref 1 00000100:00100000:1.0:1789760781.307310:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.307359:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72044544, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225c0 00010000:00010000:1.0:1789760781.307368:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.307383:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.307387:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.307393:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.307411:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.314568:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984897 is committed 00002000:00010000:1.0:1789760781.316121:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72044544 -> 72048640 00002000:00010000:1.0:1789760781.316129:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140736 -> 140744 00010000:00010000:1.0:1789760781.316142:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316155:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316164:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316171:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.316177:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316186:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316206:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.316213:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e003 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72044544->72048639] (req 72044544->72048639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.316312:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565481472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9000us (10949us total) trans 4294984897 rc 0/0 00000100:00100000:1.0:1789760781.316322:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17600 00000100:00100000:1.0:1789760781.316331:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719551238356 time 719567587843 state 0x2 ref 0 00000100:00100000:1.0:1789760781.322820:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.323019:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481600 00000100:00100000:0.0:1789760781.323029:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481600 00000100:00100000:0.0:1789760781.323083:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719551238356 time 719567587843 state 0x0 ref 1 00000100:00100000:0.0:1789760781.323099:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719567848259 time 719567587843 state 0x1 ref 1 00000100:00100000:0.0:1789760781.323187:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719567848259 time 719583477251 state 0x0 ref 1 00000100:00100000:0.0:1789760781.323201:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.323252:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72048640, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225c8 00010000:00010000:0.0:1789760781.323261:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.323276:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.323280:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.323286:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.323300:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.332962:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984898 is committed 00002000:00010000:0.0:1789760781.333296:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72048640 -> 72052736 00002000:00010000:0.0:1789760781.333302:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140744 -> 140752 00010000:00010000:0.0:1789760781.333314:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.333327:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.333342:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.334022:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.334029:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.334039:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.334060:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.334068:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e00a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72048640->72052735] (req 72048640->72052735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.334223:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11021us (11409us total) trans 4294984898 rc 0/0 00000100:00100000:0.0:1789760781.334238:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17601 00000100:00100000:0.0:1789760781.334247:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719567848259 time 719583477251 state 0x2 ref 0 00000100:00100000:2.0:1789760781.338398:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.338605:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481728 00000100:00100000:0.0:1789760781.338614:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481728 00000100:00100000:0.0:1789760781.338679:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719567848259 time 719583477251 state 0x0 ref 1 00000100:00100000:0.0:1789760781.338694:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719583737667 time 719583477251 state 0x1 ref 1 00000100:00100000:0.0:1789760781.338865:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719583737667 time 719599042688 state 0x0 ref 1 00000100:00100000:0.0:1789760781.338883:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.338930:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72052736, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225d0 00010000:00010000:0.0:1789760781.338940:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.338956:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.338960:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.338967:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.338981:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.345806:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984899 is committed 00002000:00010000:0.0:1789760781.346353:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72052736 -> 72056832 00002000:00010000:0.0:1789760781.346358:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140752 -> 140760 00010000:00010000:0.0:1789760781.346372:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346384:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346394:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346406:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.346416:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346426:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346444:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.346452:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72052736->72056831] (req 72052736->72056831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.346545:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7663us (8153us total) trans 4294984899 rc 0/0 00000100:00100000:0.0:1789760781.346555:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17602 00000100:00100000:0.0:1789760781.346565:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719583737667 time 719599042688 state 0x2 ref 0 00000100:00100000:3.0:1789760781.354867:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.355250:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481856 00000100:00100000:1.0:1789760781.355259:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481856 00000100:00100000:1.0:1789760781.355312:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719583737667 time 719599042688 state 0x0 ref 1 00000100:00100000:1.0:1789760781.355327:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719599303104 time 719599042688 state 0x1 ref 1 00000100:00100000:1.0:1789760781.355354:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719599303104 time 719615646260 state 0x0 ref 1 00000100:00100000:1.0:1789760781.355367:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565481856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.355420:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72056832, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225d8 00010000:00010000:1.0:1789760781.355430:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.355446:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.355450:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.355457:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.355472:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.361866:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984900 is committed 00002000:00010000:1.0:1789760781.362102:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72056832 -> 72060928 00002000:00010000:1.0:1789760781.362107:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140760 -> 140768 00010000:00010000:1.0:1789760781.362120:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362132:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362142:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362149:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.362154:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362162:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362182:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.362190:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e018 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72056832->72060927] (req 72056832->72060927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.362284:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565481856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6914us (7422us total) trans 4294984900 rc 0/0 00000100:00100000:1.0:1789760781.362294:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17603 00000100:00100000:1.0:1789760781.362304:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719599303104 time 719615646260 state 0x2 ref 0 00000100:00100000:1.0:1789760781.366843:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.367043:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565481984 00000100:00100000:0.0:1789760781.367053:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565481984 00000100:00100000:0.0:1789760781.367110:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719599303104 time 719615646260 state 0x0 ref 1 00000100:00100000:0.0:1789760781.367124:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719615906676 time 719615646260 state 0x1 ref 1 00000100:00100000:0.0:1789760781.367231:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719615906676 time 719627521390 state 0x0 ref 1 00000100:00100000:0.0:1789760781.367248:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.367294:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72060928, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225e0 00010000:00010000:0.0:1789760781.367303:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.367318:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.367322:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.367327:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.367341:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.374406:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984901 is committed 00002000:00010000:0.0:1789760781.374590:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72060928 -> 72065024 00002000:00010000:0.0:1789760781.374595:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140768 -> 140776 00010000:00010000:0.0:1789760781.374607:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374618:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374626:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374633:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.374638:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374647:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374666:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.374673:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e01f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72060928->72065023] (req 72060928->72065023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.374961:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565481984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7711us (8123us total) trans 4294984901 rc 0/0 00000100:00100000:0.0:1789760781.374972:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17604 00000100:00100000:0.0:1789760781.374982:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719615906676 time 719627521390 state 0x2 ref 0 00000100:00100000:2.0:1789760781.378269:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.379274:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482112 00000100:00100000:0.0:1789760781.379285:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482112 00000100:00100000:0.0:1789760781.379346:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719615906676 time 719627521390 state 0x0 ref 1 00000100:00100000:0.0:1789760781.379362:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719627781806 time 719627521390 state 0x1 ref 1 00000100:00100000:0.0:1789760781.379393:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719627781806 time 719639684536 state 0x0 ref 1 00000100:00100000:0.0:1789760781.379405:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565482112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.379463:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72065024, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225e8 00010000:00010000:0.0:1789760781.379472:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.379488:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.379492:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.379499:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.379513:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.386419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984902 is committed 00002000:00010000:0.0:1789760781.387610:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72065024 -> 72069120 00002000:00010000:0.0:1789760781.387618:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140776 -> 140784 00010000:00010000:0.0:1789760781.388273:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388288:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388298:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388305:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.388310:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388319:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388342:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.388350:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e026 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72065024->72069119] (req 72065024->72069119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.388579:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565482112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9170us (10315us total) trans 4294984902 rc 0/0 00000100:00100000:0.0:1789760781.388590:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17605 00000100:00100000:0.0:1789760781.388599:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719627781806 time 719639684536 state 0x2 ref 0 00000100:00100000:1.0:1789760781.393830:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.393963:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482240 00000100:00100000:2.0:1789760781.393973:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482240 00000100:00100000:2.0:1789760781.394028:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719627781806 time 719639684536 state 0x0 ref 1 00000100:00100000:2.0:1789760781.394044:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719639944952 time 719639684536 state 0x1 ref 1 00000100:00100000:3.0:1789760781.394537:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719639944952 time 719654824002 state 0x0 ref 1 00000100:00100000:3.0:1789760781.394555:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565482240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760781.394603:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72069120, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225f0 00010000:00010000:3.0:1789760781.394612:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.394638:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:3.0:1789760781.394642:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760781.394649:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.394664:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.400863:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984903 is committed 00002000:00010000:3.0:1789760781.401043:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72069120 -> 72073216 00002000:00010000:3.0:1789760781.401111:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140784 -> 140792 00010000:00010000:3.0:1789760781.401126:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401139:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401153:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401160:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760781.401165:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401174:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401195:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.401203:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e02d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72069120->72073215] (req 72069120->72073215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760781.401297:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565482240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6743us (7472us total) trans 4294984903 rc 0/0 00000100:00100000:3.0:1789760781.401308:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17606 00000100:00100000:3.0:1789760781.401317:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719639944952 time 719654824002 state 0x2 ref 0 00000100:00100000:1.0:1789760781.404750:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.404827:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482368 00000100:00100000:0.0:1789760781.404846:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482368 00000100:00100000:0.0:1789760781.404917:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719639944952 time 719654824002 state 0x0 ref 1 00000100:00100000:0.0:1789760781.404933:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719655084418 time 719654824002 state 0x1 ref 1 00000100:00100000:0.0:1789760781.404957:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719655084418 time 719665249721 state 0x0 ref 1 00000100:00100000:0.0:1789760781.404971:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565482368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.405023:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72073216, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x225f8 00010000:00010000:0.0:1789760781.405034:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.405049:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.405055:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.405061:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.405075:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.412770:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984904 is committed 00002000:00010000:0.0:1789760781.412895:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72073216 -> 72077312 00002000:00010000:0.0:1789760781.412901:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140792 -> 140800 00010000:00010000:0.0:1789760781.412916:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412928:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412938:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412945:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.412949:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412957:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412979:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.412990:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72073216->72077311] (req 72073216->72077311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.413182:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565482368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8208us (8471us total) trans 4294984904 rc 0/0 00000100:00100000:0.0:1789760781.413193:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17607 00000100:00100000:0.0:1789760781.413203:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719655084418 time 719665249721 state 0x2 ref 0 00000100:00100000:2.0:1789760781.424954:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.425102:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482496 00000100:00100000:0.0:1789760781.425112:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482496 00000100:00100000:0.0:1789760781.425171:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719655084418 time 719665249721 state 0x0 ref 1 00000100:00100000:0.0:1789760781.425187:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719665510137 time 719665249721 state 0x1 ref 1 00000100:00100000:0.0:1789760781.425220:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719665510137 time 719685512636 state 0x0 ref 1 00000100:00100000:0.0:1789760781.425233:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565482496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.425279:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72077312, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22600 00010000:00010000:0.0:1789760781.425288:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.425303:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.425306:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.425312:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.425331:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.432258:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984905 is committed 00002000:00010000:0.0:1789760781.432418:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72077312 -> 72081408 00002000:00010000:0.0:1789760781.432424:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140800 -> 140808 00010000:00010000:0.0:1789760781.432439:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432452:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432461:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432470:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.432475:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432486:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432506:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.432515:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e03b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72077312->72081407] (req 72077312->72081407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.432657:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565482496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7421us (7708us total) trans 4294984905 rc 0/0 00000100:00100000:0.0:1789760781.432669:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17608 00000100:00100000:0.0:1789760781.432680:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719665510137 time 719685512636 state 0x2 ref 0 00000100:00100000:1.0:1789760781.437254:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760781.437413:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482624 00000100:00100000:3.0:1789760781.437423:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482624 00000100:00100000:3.0:1789760781.437478:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719665510137 time 719685512636 state 0x0 ref 1 00000100:00100000:3.0:1789760781.437495:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719685773052 time 719685512636 state 0x1 ref 1 00000100:00100000:3.0:1789760781.437530:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719685773052 time 719697821812 state 0x0 ref 1 00000100:00100000:3.0:1789760781.437543:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760781.437590:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72081408, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22608 00010000:00010000:3.0:1789760781.437600:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.437615:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:3.0:1789760781.437619:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760781.437638:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.437659:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.443426:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984906 is committed 00002000:00010000:2.0:1789760781.443619:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72081408 -> 72085504 00002000:00010000:2.0:1789760781.444379:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140808 -> 140816 00010000:00010000:2.0:1789760781.444399:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444413:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444422:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444430:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.444436:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444445:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444465:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.444474:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e042 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72081408->72085503] (req 72081408->72085503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.444650:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7103us (7400us total) trans 4294984906 rc 0/0 00000100:00100000:2.0:1789760781.444661:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17609 00000100:00100000:2.0:1789760781.444672:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719685773052 time 719697821812 state 0x2 ref 0 00000100:00100000:1.0:1789760781.449306:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.450951:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482752 00000100:00100000:0.0:1789760781.450967:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482752 00000100:00100000:0.0:1789760781.451030:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719685773052 time 719697821812 state 0x0 ref 1 00000100:00100000:0.0:1789760781.451046:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719698082228 time 719697821812 state 0x1 ref 1 00000100:00100000:0.0:1789760781.451133:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719698082228 time 719711423770 state 0x0 ref 1 00000100:00100000:0.0:1789760781.451147:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.451208:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72085504, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22610 00010000:00010000:0.0:1789760781.451217:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.451233:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.451238:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.451244:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.451258:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.457160:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984907 is committed 00002000:00010000:0.0:1789760781.457615:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72085504 -> 72089600 00002000:00010000:0.0:1789760781.457622:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140816 -> 140824 00010000:00010000:0.0:1789760781.457645:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457658:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457667:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457674:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.457678:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457687:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457763:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.457772:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e049 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72085504->72089599] (req 72085504->72089599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.457922:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6773us (8622us total) trans 4294984907 rc 0/0 00000100:00100000:0.0:1789760781.457933:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17610 00000100:00100000:0.0:1789760781.457943:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719698082228 time 719711423770 state 0x2 ref 0 00000100:00100000:0.0:1789760781.471831:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.471942:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565482880 00000100:00100000:2.0:1789760781.471953:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565482880 00000100:00100000:2.0:1789760781.472010:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719698082228 time 719711423770 state 0x0 ref 1 00000100:00100000:2.0:1789760781.472025:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719711684186 time 719711423770 state 0x1 ref 1 00000100:00100000:2.0:1789760781.472061:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719711684186 time 719732353052 state 0x0 ref 1 00000100:00100000:2.0:1789760781.472074:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.472121:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72089600, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22618 00010000:00010000:2.0:1789760781.472141:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.472156:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.472161:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.472166:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.472185:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760781.479599:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984908 is committed 00002000:00010000:2.0:1789760781.479820:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72089600 -> 72093696 00002000:00010000:2.0:1789760781.479826:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140824 -> 140832 00010000:00010000:2.0:1789760781.479839:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479851:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479910:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479920:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.479924:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479932:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479951:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.479959:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e050 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72089600->72093695] (req 72089600->72093695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.480051:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565482880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7976us (8225us total) trans 4294984908 rc 0/0 00000100:00100000:2.0:1789760781.480060:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17611 00000100:00100000:2.0:1789760781.480067:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719711684186 time 719732353052 state 0x2 ref 0 00000100:00100000:2.0:1789760781.488497:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.488600:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483008 00000100:00100000:1.0:1789760781.488609:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483008 00000100:00100000:1.0:1789760781.488663:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719711684186 time 719732353052 state 0x0 ref 1 00000100:00100000:1.0:1789760781.488677:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719732613468 time 719732353052 state 0x1 ref 1 00000100:00100000:1.0:1789760781.488746:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719732613468 time 719749038266 state 0x0 ref 1 00000100:00100000:1.0:1789760781.488758:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565483008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.488801:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72093696, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22620 00010000:00010000:1.0:1789760781.488810:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.488826:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.488830:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.488837:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.488851:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.502191:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984909 is committed 00002000:00010000:1.0:1789760781.502324:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72093696 -> 72097792 00002000:00010000:1.0:1789760781.502329:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140832 -> 140840 00010000:00010000:1.0:1789760781.502344:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502358:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502368:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502376:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.502381:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502391:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502417:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.502425:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72093696->72097791] (req 72093696->72097791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.502527:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565483008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13766us (14036us total) trans 4294984909 rc 0/0 00000100:00100000:1.0:1789760781.502538:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17612 00000100:00100000:1.0:1789760781.502548:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719732613468 time 719749038266 state 0x2 ref 0 00000100:00100000:1.0:1789760781.511341:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.512827:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483136 00000100:00100000:0.0:1789760781.512848:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483136 00000100:00100000:0.0:1789760781.512911:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719732613468 time 719749038266 state 0x0 ref 1 00000100:00100000:0.0:1789760781.512925:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719749298682 time 719749038266 state 0x1 ref 1 00000100:00100000:0.0:1789760781.512963:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719749298682 time 719773255606 state 0x0 ref 1 00000100:00100000:0.0:1789760781.512977:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565483136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.513035:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72097792, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22628 00010000:00010000:0.0:1789760781.513045:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.513063:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.513067:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.513074:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.513092:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.515942:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760781.529175:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984910 is committed 00002000:00010000:0.0:1789760781.529402:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72097792 -> 72101888 00002000:00010000:0.0:1789760781.529408:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140840 -> 140848 00010000:00010000:0.0:1789760781.529420:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529433:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529442:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529450:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.529456:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529465:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529483:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.529490:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e05e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72097792->72101887] (req 72097792->72101887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.529580:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565483136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16602us (18245us total) trans 4294984910 rc 0/0 00000100:00100000:0.0:1789760781.529590:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17613 00000100:00100000:0.0:1789760781.529600:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719749298682 time 719773255606 state 0x2 ref 0 00000100:00100000:0.0:1789760781.541353:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.541455:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483264 00000100:00100000:2.0:1789760781.541464:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483264 00000100:00100000:2.0:1789760781.541517:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719749298682 time 719773255606 state 0x0 ref 1 00000100:00100000:2.0:1789760781.541532:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719773516022 time 719773255606 state 0x1 ref 1 00000100:00100000:2.0:1789760781.541569:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719773516022 time 719801860663 state 0x0 ref 1 00000100:00100000:2.0:1789760781.541582:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.541626:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72101888, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22630 00010000:00010000:2.0:1789760781.541636:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.541652:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.541656:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.541662:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.541676:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.548326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984911 is committed 00002000:00010000:2.0:1789760781.555793:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72101888 -> 72105984 00002000:00010000:2.0:1789760781.555804:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140848 -> 140856 00010000:00010000:2.0:1789760781.555818:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555833:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555910:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555918:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.555923:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555934:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555955:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.555963:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e065 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72101888->72105983] (req 72101888->72105983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.556761:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15057us (15293us total) trans 4294984911 rc 0/0 00000100:00100000:2.0:1789760781.556775:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17614 00000100:00100000:2.0:1789760781.556785:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719773516022 time 719801860663 state 0x2 ref 0 00000100:00100000:2.0:1789760781.564563:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.566284:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483392 00000100:00100000:1.0:1789760781.566299:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483392 00000100:00100000:1.0:1789760781.566359:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719773516022 time 719801860663 state 0x0 ref 1 00000100:00100000:1.0:1789760781.566374:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719802121079 time 719801860663 state 0x1 ref 1 00000100:00100000:1.0:1789760781.566412:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719802121079 time 719826703999 state 0x0 ref 1 00000100:00100000:1.0:1789760781.566435:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.566484:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72105984, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22638 00010000:00010000:1.0:1789760781.566493:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.566515:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.566519:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.566525:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.566539:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.573288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984912 is committed 00002000:00010000:1.0:1789760781.573410:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72105984 -> 72110080 00002000:00010000:1.0:1789760781.573415:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140856 -> 140864 00010000:00010000:1.0:1789760781.573436:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573449:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573458:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573465:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.573470:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573479:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573504:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.573512:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e06c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72105984->72110079] (req 72105984->72110079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.573606:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7179us (9048us total) trans 4294984912 rc 0/0 00000100:00100000:1.0:1789760781.573617:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17615 00000100:00100000:1.0:1789760781.573626:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719802121079 time 719826703999 state 0x2 ref 0 00000100:00100000:1.0:1789760781.582408:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.584908:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483520 00000100:00100000:0.0:1789760781.584923:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483520 00000100:00100000:0.0:1789760781.584988:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719802121079 time 719826703999 state 0x0 ref 1 00000100:00100000:0.0:1789760781.585004:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719826964415 time 719826703999 state 0x1 ref 1 00000100:00100000:0.0:1789760781.585044:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719826964415 time 719845335904 state 0x0 ref 1 00000100:00100000:0.0:1789760781.585059:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.585106:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72110080, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22640 00010000:00010000:0.0:1789760781.585117:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.585132:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1789760781.585137:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.585143:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.585157:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.590574:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984913 is committed 00002000:00010000:1.0:1789760781.595207:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72110080 -> 72114176 00002000:00010000:1.0:1789760781.595217:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140864 -> 140872 00010000:00010000:1.0:1789760781.595231:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595243:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595253:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595260:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.595266:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595275:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595365:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.595374:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72110080->72114175] (req 72110080->72114175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.595530:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10469us (13124us total) trans 4294984913 rc 0/0 00000100:00100000:1.0:1789760781.595541:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17616 00000100:00100000:1.0:1789760781.595552:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719826964415 time 719845335904 state 0x2 ref 0 00000100:00100000:0.0:1789760781.602924:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.603072:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483648 00000100:00100000:2.0:1789760781.603081:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483648 00000100:00100000:2.0:1789760781.603135:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719826964415 time 719845335904 state 0x0 ref 1 00000100:00100000:2.0:1789760781.603150:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719845596320 time 719845335904 state 0x1 ref 1 00000100:00100000:2.0:1789760781.603177:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719845596320 time 719863468924 state 0x0 ref 1 00000100:00100000:2.0:1789760781.603187:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.603233:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72114176, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22648 00010000:00010000:2.0:1789760781.603243:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.603259:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.603263:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.603270:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.603293:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.607955:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984914 is committed 00002000:00010000:2.0:1789760781.608113:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72114176 -> 72118272 00002000:00010000:2.0:1789760781.608118:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140872 -> 140880 00010000:00010000:2.0:1789760781.608132:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608145:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608154:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608161:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.608166:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608174:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608192:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.608201:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e07a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72114176->72118271] (req 72114176->72118271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.608298:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5107us (5379us total) trans 4294984914 rc 0/0 00000100:00100000:2.0:1789760781.608308:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17617 00000100:00100000:2.0:1789760781.608318:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719845596320 time 719863468924 state 0x2 ref 0 00000100:00100000:2.0:1789760781.615275:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.615440:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483776 00000100:00100000:1.0:1789760781.615449:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483776 00000100:00100000:1.0:1789760781.615504:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719845596320 time 719863468924 state 0x0 ref 1 00000100:00100000:1.0:1789760781.615521:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719863729340 time 719863468924 state 0x1 ref 1 00000100:00100000:1.0:1789760781.615555:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719863729340 time 719875847308 state 0x0 ref 1 00000100:00100000:1.0:1789760781.615568:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.615614:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72118272, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22650 00010000:00010000:1.0:1789760781.615623:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.615640:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.615644:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.615651:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.615665:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.619989:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984915 is committed 00002000:00010000:1.0:1789760781.620183:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72118272 -> 72122368 00002000:00010000:1.0:1789760781.620188:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140880 -> 140888 00010000:00010000:1.0:1789760781.620200:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620212:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620221:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620228:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.620232:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620240:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620264:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.620272:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e081 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72118272->72122367] (req 72118272->72122367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.620360:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4790us (5090us total) trans 4294984915 rc 0/0 00000100:00100000:1.0:1789760781.620371:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17618 00000100:00100000:1.0:1789760781.620380:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719863729340 time 719875847308 state 0x2 ref 0 00000100:00100000:1.0:1789760781.630218:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.630364:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565483904 00000100:00100000:2.0:1789760781.630374:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565483904 00000100:00100000:2.0:1789760781.630427:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719863729340 time 719875847308 state 0x0 ref 1 00000100:00100000:2.0:1789760781.630444:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719876107724 time 719875847308 state 0x1 ref 1 00000100:00100000:2.0:1789760781.630473:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719876107724 time 719890765325 state 0x0 ref 1 00000100:00100000:2.0:1789760781.630487:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.630534:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72122368, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22658 00010000:00010000:2.0:1789760781.630543:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.630559:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.630564:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.630570:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.630583:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.635149:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984916 is committed 00002000:00010000:2.0:1789760781.635474:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72122368 -> 72126464 00002000:00010000:2.0:1789760781.635479:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140888 -> 140896 00010000:00010000:2.0:1789760781.635492:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635511:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635520:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635528:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.635533:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635542:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635561:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.635569:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e088 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72122368->72126463] (req 72122368->72126463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.635668:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565483904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5180us (5456us total) trans 4294984916 rc 0/0 00000100:00100000:2.0:1789760781.635679:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17619 00000100:00100000:2.0:1789760781.635689:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719876107724 time 719890765325 state 0x2 ref 0 00000100:00100000:0.0:1789760781.643387:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.644613:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484032 00000100:00100000:2.0:1789760781.644626:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484032 00000100:00100000:2.0:1789760781.644691:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719876107724 time 719890765325 state 0x0 ref 1 00000100:00100000:2.0:1789760781.644738:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719891025741 time 719890765325 state 0x1 ref 1 00000100:00100000:2.0:1789760781.644767:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719891025741 time 719905058958 state 0x0 ref 1 00000100:00100000:2.0:1789760781.644780:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.644827:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72126464, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22660 00010000:00010000:2.0:1789760781.644837:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.644854:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.644858:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.644865:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.644880:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.651667:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984917 is committed 00002000:00010000:2.0:1789760781.651775:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72126464 -> 72130560 00002000:00010000:2.0:1789760781.651780:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140896 -> 140904 00010000:00010000:2.0:1789760781.651794:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651806:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651819:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651825:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.651830:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651838:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651857:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.651864:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e08f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72126464->72130559] (req 72126464->72130559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.651965:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7183us (8587us total) trans 4294984917 rc 0/0 00000100:00100000:2.0:1789760781.651976:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17620 00000100:00100000:2.0:1789760781.651985:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719891025741 time 719905058958 state 0x2 ref 0 00000100:00100000:1.0:1789760781.656600:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.656699:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484160 00000100:00100000:2.0:1789760781.656750:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484160 00000100:00100000:2.0:1789760781.656803:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719891025741 time 719905058958 state 0x0 ref 1 00000100:00100000:2.0:1789760781.656819:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719905319374 time 719905058958 state 0x1 ref 1 00000100:00100000:2.0:1789760781.656850:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719905319374 time 719917142806 state 0x0 ref 1 00000100:00100000:2.0:1789760781.656862:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.656910:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72130560, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22668 00010000:00010000:2.0:1789760781.656919:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.656935:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.656940:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.656947:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.656962:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.662250:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984918 is committed 00002000:00010000:2.0:1789760781.662622:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72130560 -> 72134656 00002000:00010000:2.0:1789760781.662628:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140904 -> 140912 00010000:00010000:2.0:1789760781.662746:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662760:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662829:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662842:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.662847:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662855:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662874:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.662882:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e096 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72130560->72134655] (req 72130560->72134655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.663042:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6177us (6448us total) trans 4294984918 rc 0/0 00000100:00100000:2.0:1789760781.663063:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17621 00000100:00100000:2.0:1789760781.663072:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719905319374 time 719917142806 state 0x2 ref 0 00000100:00100000:1.0:1789760781.668185:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.668249:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484288 00000100:00100000:2.0:1789760781.668260:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484288 00000100:00100000:2.0:1789760781.668319:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719905319374 time 719917142806 state 0x0 ref 1 00000100:00100000:2.0:1789760781.668334:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719917403222 time 719917142806 state 0x1 ref 1 00000100:00100000:2.0:1789760781.668358:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719917403222 time 719928651075 state 0x0 ref 1 00000100:00100000:2.0:1789760781.668375:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.668424:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72134656, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22670 00010000:00010000:2.0:1789760781.668433:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.668461:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.668465:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.668471:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.668485:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.673473:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984919 is committed 00002000:00010000:2.0:1789760781.673595:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72134656 -> 72138752 00002000:00010000:2.0:1789760781.673600:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140912 -> 140920 00010000:00010000:2.0:1789760781.673614:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673639:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673649:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673657:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.673663:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673671:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673689:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.673697:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e09d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72134656->72138751] (req 72134656->72138751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.673836:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565484288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5460us (5656us total) trans 4294984919 rc 0/0 00000100:00100000:2.0:1789760781.673847:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17622 00000100:00100000:2.0:1789760781.673856:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719917403222 time 719928651075 state 0x2 ref 0 00000100:00100000:0.0:1789760781.683025:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.683103:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484416 00000100:00100000:2.0:1789760781.683114:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484416 00000100:00100000:2.0:1789760781.683172:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719917403222 time 719928651075 state 0x0 ref 1 00000100:00100000:2.0:1789760781.683187:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719928911491 time 719928651075 state 0x1 ref 1 00000100:00100000:2.0:1789760781.683218:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719928911491 time 719943509794 state 0x0 ref 1 00000100:00100000:2.0:1789760781.683231:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565484416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.683280:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72138752, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22678 00010000:00010000:2.0:1789760781.683290:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.683306:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.683311:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.683317:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.683331:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.691523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984920 is committed 00002000:00010000:3.0:1789760781.696302:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72138752 -> 72142848 00002000:00010000:3.0:1789760781.696310:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140920 -> 140928 00010000:00010000:3.0:1789760781.696325:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696337:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696350:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696357:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760781.696362:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696371:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696391:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.696399:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e0a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72138752->72142847] (req 72138752->72142847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760781.696506:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565484416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13271us (13485us total) trans 4294984920 rc 0/0 00000100:00100000:3.0:1789760781.696517:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17623 00000100:00100000:3.0:1789760781.696526:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719928911491 time 719943509794 state 0x2 ref 0 00000100:00100000:1.0:1789760781.703144:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.703246:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484544 00000100:00100000:2.0:1789760781.703257:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484544 00000100:00100000:2.0:1789760781.703306:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719928911491 time 719943509794 state 0x0 ref 1 00000100:00100000:2.0:1789760781.703323:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719943770210 time 719943509794 state 0x1 ref 1 00000100:00100000:2.0:1789760781.703524:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719943770210 time 719963814700 state 0x0 ref 1 00000100:00100000:2.0:1789760781.703538:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565484544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.703588:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72142848, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22680 00010000:00010000:2.0:1789760781.703598:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.703614:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1789760781.703620:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.703626:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.703650:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.715201:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984921 is committed 00000100:00100000:0.0:1789760781.717095:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00002000:00010000:1.0:1789760781.717278:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72142848 -> 72146944 00002000:00010000:1.0:1789760781.717284:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140928 -> 140936 00010000:00010000:1.0:1789760781.717299:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717312:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717320:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717332:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.717337:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717364:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717382:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.717390:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e0ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72142848->72146943] (req 72142848->72146943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.717472:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565484544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13934us (14336us total) trans 4294984921 rc 0/0 00000100:00100000:1.0:1789760781.717482:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17624 00000100:00100000:1.0:1789760781.717492:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719943770210 time 719963814700 state 0x2 ref 0 00000100:00100000:1.0:1789760781.718341:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.718813:0:13532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484800 00000100:00100000:2.0:1789760781.718822:0:13532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484800 00000100:00100000:2.0:1789760781.718888:0:13532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 467 00000100:00100000:2.0:1789760781.718899:0:13532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2359:x1876699565484800:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760781.718978:0:13532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2359:x1876699565484800:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760781.718984:0:13532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 467 00000100:00080000:1.0:1789760781.719290:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760781.720211:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484672 00000100:00100000:0.0:1789760781.720220:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484672 00000100:00100000:0.0:1789760781.720299:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 398 00000100:00100000:0.0:1789760781.720308:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565484672:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1789760781.720424:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565484672:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 117us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.720431:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 398 00000100:00100000:1.0:1789760781.724853:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760781.725023:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565484928 00000100:00100000:3.0:1789760781.725034:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565484928 00000100:00100000:3.0:1789760781.725112:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 468 00000100:00100000:3.0:1789760781.725121:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565484928:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1789760781.725201:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565484928:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.725208:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 468 00000100:00080000:1.0:1789760781.725255:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760781.732468:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.732607:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485056 00000100:00100000:1.0:1789760781.732619:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485056 00000100:00100000:1.0:1789760781.732692:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719943770210 time 719963814700 state 0x0 ref 1 00000100:00100000:1.0:1789760781.732765:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719964075116 time 719963814700 state 0x1 ref 1 00000100:00100000:1.0:1789760781.732793:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719964075116 time 719993085783 state 0x0 ref 1 00000100:00100000:1.0:1789760781.732805:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.732853:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72146944, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22688 00010000:00010000:1.0:1789760781.732863:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.732889:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1789760781.732894:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.732900:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.732913:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.739130:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984922 is committed 00002000:00010000:1.0:1789760781.739259:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72146944 -> 72151040 00002000:00010000:1.0:1789760781.739264:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140936 -> 140944 00010000:00010000:1.0:1789760781.739277:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739289:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739298:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739306:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.739310:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739319:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739339:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.739487:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72146944->72151039] (req 72146944->72151039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.739932:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6893us (7237us total) trans 4294984922 rc 0/0 00000100:00100000:1.0:1789760781.739944:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17625 00000100:00100000:1.0:1789760781.739954:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719964075116 time 719993085783 state 0x2 ref 0 00000100:00100000:3.0:1789760781.746891:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.747174:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485184 00000100:00100000:0.0:1789760781.747183:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485184 00000100:00100000:0.0:1789760781.747236:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719964075116 time 719993085783 state 0x0 ref 1 00000100:00100000:0.0:1789760781.747251:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719993346199 time 719993085783 state 0x1 ref 1 00000100:00100000:0.0:1789760781.747278:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719993346199 time 720007570174 state 0x0 ref 1 00000100:00100000:0.0:1789760781.747290:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.747339:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72151040, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22690 00010000:00010000:0.0:1789760781.747349:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.747376:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.747381:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.747386:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.747402:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.754388:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984923 is committed 00002000:00010000:0.0:1789760781.754577:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72151040 -> 72155136 00002000:00010000:0.0:1789760781.754582:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140944 -> 140952 00010000:00010000:0.0:1789760781.754596:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754609:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754617:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754625:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.754630:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754650:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754675:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.754683:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72151040->72155135] (req 72151040->72155135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.754828:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7534us (7951us total) trans 4294984923 rc 0/0 00000100:00100000:0.0:1789760781.754840:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17626 00000100:00100000:0.0:1789760781.754850:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719993346199 time 720007570174 state 0x2 ref 0 00000100:00100000:1.0:1789760781.763807:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.763926:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485312 00000100:00100000:2.0:1789760781.763937:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485312 00000100:00100000:2.0:1789760781.763994:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 719993346199 time 720007570174 state 0x0 ref 1 00000100:00100000:2.0:1789760781.764011:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720007830590 time 720007570174 state 0x1 ref 1 00000100:00100000:2.0:1789760781.764043:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720007830590 time 720024334766 state 0x0 ref 1 00000100:00100000:2.0:1789760781.764056:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.764104:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72155136, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22698 00010000:00010000:2.0:1789760781.764114:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.764134:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760781.764139:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.764145:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.764159:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.770478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984924 is committed 00002000:00010000:2.0:1789760781.770830:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72155136 -> 72159232 00002000:00010000:2.0:1789760781.770835:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140952 -> 140960 00010000:00010000:2.0:1789760781.770849:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770861:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770870:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770877:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.770882:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770890:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770914:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.770922:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e0c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72155136->72159231] (req 72155136->72159231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.771228:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7169us (7424us total) trans 4294984924 rc 0/0 00000100:00100000:2.0:1789760781.771240:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17627 00000100:00100000:2.0:1789760781.771249:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720007830590 time 720024334766 state 0x2 ref 0 00000100:00100000:2.0:1789760781.774341:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.774441:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485440 00000100:00100000:1.0:1789760781.774452:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485440 00000100:00100000:1.0:1789760781.774509:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720007830590 time 720024334766 state 0x0 ref 1 00000100:00100000:1.0:1789760781.774524:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720024595182 time 720024334766 state 0x1 ref 1 00000100:00100000:1.0:1789760781.774553:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720024595182 time 720034845185 state 0x0 ref 1 00000100:00100000:1.0:1789760781.774567:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.774618:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72159232, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226a0 00010000:00010000:1.0:1789760781.774628:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.774646:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.774651:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.774658:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.774674:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.779547:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984925 is committed 00002000:00010000:1.0:1789760781.779658:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72159232 -> 72163328 00002000:00010000:1.0:1789760781.779664:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140960 -> 140968 00010000:00010000:1.0:1789760781.779677:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779689:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779698:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779736:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.779742:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779750:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779767:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.779774:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72159232->72163327] (req 72159232->72163327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.779863:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5294us (5527us total) trans 4294984925 rc 0/0 00000100:00100000:1.0:1789760781.779875:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17628 00000100:00100000:1.0:1789760781.779885:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720024595182 time 720034845185 state 0x2 ref 0 00000100:00100000:3.0:1789760781.784373:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.784563:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485568 00000100:00100000:0.0:1789760781.784573:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485568 00000100:00100000:0.0:1789760781.784629:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720024595182 time 720034845185 state 0x0 ref 1 00000100:00100000:0.0:1789760781.784644:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720035105601 time 720034845185 state 0x1 ref 1 00000100:00100000:0.0:1789760781.784668:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720035105601 time 720044960727 state 0x0 ref 1 00000100:00100000:0.0:1789760781.784680:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.784764:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72163328, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226a8 00010000:00010000:0.0:1789760781.784772:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.784786:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.784790:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.784797:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.784810:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.791750:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984926 is committed 00002000:00010000:0.0:1789760781.791878:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72163328 -> 72167424 00002000:00010000:0.0:1789760781.791883:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140968 -> 140976 00010000:00010000:0.0:1789760781.791896:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791907:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791916:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791922:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.791927:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791936:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791954:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.791967:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72163328->72167423] (req 72163328->72167423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.792069:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565485568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7385us (7700us total) trans 4294984926 rc 0/0 00000100:00100000:0.0:1789760781.792080:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17629 00000100:00100000:0.0:1789760781.792088:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720035105601 time 720044960727 state 0x2 ref 0 00000100:00100000:3.0:1789760781.799279:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.799512:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485696 00000100:00100000:2.0:1789760781.799522:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485696 00000100:00100000:2.0:1789760781.799586:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720035105601 time 720044960727 state 0x0 ref 1 00000100:00100000:2.0:1789760781.799603:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720045221143 time 720044960727 state 0x1 ref 1 00000100:00100000:2.0:1789760781.799633:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720045221143 time 720059925763 state 0x0 ref 1 00000100:00100000:2.0:1789760781.799646:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565485696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.799694:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72167424, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226b0 00010000:00010000:2.0:1789760781.799798:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.799820:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760781.799825:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.799831:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.799845:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.805095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984927 is committed 00002000:00010000:2.0:1789760781.805297:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72167424 -> 72171520 00002000:00010000:2.0:1789760781.805302:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140976 -> 140984 00010000:00010000:2.0:1789760781.805315:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805327:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805336:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805343:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.805348:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805358:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805385:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.805393:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e0d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72167424->72171519] (req 72167424->72171519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.805520:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565485696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5872us (6245us total) trans 4294984927 rc 0/0 00000100:00100000:2.0:1789760781.805531:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17630 00000100:00100000:2.0:1789760781.805540:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720045221143 time 720059925763 state 0x2 ref 0 00000100:00100000:2.0:1789760781.815201:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.815335:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485824 00000100:00100000:1.0:1789760781.815346:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485824 00000100:00100000:1.0:1789760781.815405:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720045221143 time 720059925763 state 0x0 ref 1 00000100:00100000:1.0:1789760781.815422:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720060186179 time 720059925763 state 0x1 ref 1 00000100:00100000:1.0:1789760781.815499:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720060186179 time 720075790056 state 0x0 ref 1 00000100:00100000:1.0:1789760781.815512:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.815570:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72171520, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226b8 00010000:00010000:1.0:1789760781.815580:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.815595:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.815599:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.815606:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.815620:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.819428:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984928 is committed 00002000:00010000:1.0:1789760781.819677:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72171520 -> 72175616 00002000:00010000:1.0:1789760781.819682:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140984 -> 140992 00010000:00010000:1.0:1789760781.819696:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819749:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819758:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819766:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.819770:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819779:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819799:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.819808:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72171520->72175615] (req 72171520->72175615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.819892:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565485824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4377us (4699us total) trans 4294984928 rc 0/0 00000100:00100000:1.0:1789760781.819902:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17631 00000100:00100000:1.0:1789760781.819911:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720060186179 time 720075790056 state 0x2 ref 0 00000100:00100000:3.0:1789760781.826913:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.827040:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565485952 00000100:00100000:0.0:1789760781.827050:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565485952 00000100:00100000:0.0:1789760781.827104:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720060186179 time 720075790056 state 0x0 ref 1 00000100:00100000:0.0:1789760781.827119:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720076050472 time 720075790056 state 0x1 ref 1 00000100:00100000:0.0:1789760781.827149:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720076050472 time 720087441325 state 0x0 ref 1 00000100:00100000:0.0:1789760781.827162:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565485952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.827210:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72175616, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226c0 00010000:00010000:0.0:1789760781.827219:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.827234:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.827239:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.827245:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.827259:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.831599:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984929 is committed 00002000:00010000:0.0:1789760781.831781:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72175616 -> 72179712 00002000:00010000:0.0:1789760781.831786:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 140992 -> 141000 00010000:00010000:0.0:1789760781.831799:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831812:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831822:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831829:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.831834:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831843:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831874:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.831888:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72175616->72179711] (req 72175616->72179711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.831985:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565485952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4820us (5078us total) trans 4294984929 rc 0/0 00000100:00100000:0.0:1789760781.831994:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17632 00000100:00100000:0.0:1789760781.832004:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720076050472 time 720087441325 state 0x2 ref 0 00000100:00100000:3.0:1789760781.839663:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.839784:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486080 00000100:00100000:2.0:1789760781.839792:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486080 00000100:00100000:2.0:1789760781.839841:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720076050472 time 720087441325 state 0x0 ref 1 00000100:00100000:2.0:1789760781.839854:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720087701741 time 720087441325 state 0x1 ref 1 00000100:00100000:2.0:1789760781.839884:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720087701741 time 720100176025 state 0x0 ref 1 00000100:00100000:2.0:1789760781.839895:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.839939:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72179712, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226c8 00010000:00010000:2.0:1789760781.839947:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.839967:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760781.839971:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.839977:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.839990:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.846608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984930 is committed 00002000:00010000:2.0:1789760781.846812:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72179712 -> 72183808 00002000:00010000:2.0:1789760781.846817:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141000 -> 141008 00010000:00010000:2.0:1789760781.846830:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846842:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846851:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846857:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760781.846862:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846869:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846893:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.846901:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72179712->72183807] (req 72179712->72183807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.847027:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7129us (7368us total) trans 4294984930 rc 0/0 00000100:00100000:2.0:1789760781.847039:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17633 00000100:00100000:2.0:1789760781.847056:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720087701741 time 720100176025 state 0x2 ref 0 00000100:00100000:2.0:1789760781.855440:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.855556:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486208 00000100:00100000:1.0:1789760781.855565:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486208 00000100:00100000:1.0:1789760781.855618:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720087701741 time 720100176025 state 0x0 ref 1 00000100:00100000:1.0:1789760781.855645:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720100436441 time 720100176025 state 0x1 ref 1 00000100:00100000:1.0:1789760781.855673:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720100436441 time 720115965349 state 0x0 ref 1 00000100:00100000:1.0:1789760781.855685:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565486208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.855758:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72183808, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226d0 00010000:00010000:1.0:1789760781.855768:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.855782:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.855788:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.855795:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.855809:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.859558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984931 is committed 00002000:00010000:1.0:1789760781.860953:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72183808 -> 72187904 00002000:00010000:1.0:1789760781.860961:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141008 -> 141016 00010000:00010000:1.0:1789760781.860975:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.860989:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.860999:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.861006:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.861011:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.861021:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.861730:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.861750:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e0f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72183808->72187903] (req 72183808->72187903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.861856:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565486208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6167us (6419us total) trans 4294984931 rc 0/0 00000100:00100000:1.0:1789760781.861867:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17634 00000100:00100000:1.0:1789760781.861876:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720100436441 time 720115965349 state 0x2 ref 0 00000100:00100000:3.0:1789760781.869348:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.869457:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486336 00000100:00100000:0.0:1789760781.869468:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486336 00000100:00100000:0.0:1789760781.869531:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720100436441 time 720115965349 state 0x0 ref 1 00000100:00100000:0.0:1789760781.869548:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720116225765 time 720115965349 state 0x1 ref 1 00000100:00100000:0.0:1789760781.869578:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720116225765 time 720129869829 state 0x0 ref 1 00000100:00100000:0.0:1789760781.869589:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.869636:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72187904, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226d8 00010000:00010000:0.0:1789760781.869645:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.869661:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.869666:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.869672:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.869692:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.874844:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984932 is committed 00002000:00010000:3.0:1789760781.874951:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72187904 -> 72192000 00002000:00010000:3.0:1789760781.874956:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141016 -> 141024 00010000:00010000:3.0:1789760781.874970:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.874982:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.874993:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.875008:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760781.875013:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.875022:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.875041:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.875110:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e0f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72187904->72191999] (req 72187904->72191999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760781.875265:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5672us (5921us total) trans 4294984932 rc 0/0 00000100:00100000:3.0:1789760781.875276:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17635 00000100:00100000:3.0:1789760781.875285:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720116225765 time 720129869829 state 0x2 ref 0 00000100:00100000:3.0:1789760781.878435:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760781.878504:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486464 00000100:00100000:2.0:1789760781.878514:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486464 00000100:00100000:2.0:1789760781.878570:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720116225765 time 720129869829 state 0x0 ref 1 00000100:00100000:2.0:1789760781.878586:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720130130245 time 720129869829 state 0x1 ref 1 00000100:00100000:2.0:1789760781.878618:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720130130245 time 720138909694 state 0x0 ref 1 00000100:00100000:2.0:1789760781.878631:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565486464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760781.878687:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72192000, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226e0 00010000:00010000:2.0:1789760781.878696:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.878764:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760781.878769:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.878775:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.878790:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.882426:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984933 is committed 00002000:00010000:0.0:1789760781.882540:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72192000 -> 72196096 00002000:00010000:0.0:1789760781.882545:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141024 -> 141032 00010000:00010000:0.0:1789760781.882558:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882570:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882579:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882587:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.882592:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882601:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882621:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.882635:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e0ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72192000->72196095] (req 72192000->72196095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.882889:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565486464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4255us (4458us total) trans 4294984933 rc 0/0 00000100:00100000:0.0:1789760781.882901:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17636 00000100:00100000:0.0:1789760781.882911:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720130130245 time 720138909694 state 0x2 ref 0 00000100:00100000:2.0:1789760781.887908:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.888008:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486592 00000100:00100000:1.0:1789760781.888018:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486592 00000100:00100000:1.0:1789760781.888080:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720130130245 time 720138909694 state 0x0 ref 1 00000100:00100000:1.0:1789760781.888095:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720139170110 time 720138909694 state 0x1 ref 1 00000100:00100000:1.0:1789760781.888124:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720139170110 time 720148416019 state 0x0 ref 1 00000100:00100000:1.0:1789760781.888136:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565486592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.888179:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72196096, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226e8 00010000:00010000:1.0:1789760781.888188:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.888205:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.888209:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.888215:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.888234:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.893630:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984934 is committed 00002000:00010000:1.0:1789760781.893964:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72196096 -> 72200192 00002000:00010000:1.0:1789760781.893969:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141032 -> 141040 00010000:00010000:1.0:1789760781.893982:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.893995:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.894005:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.894013:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.894018:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.894026:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.894106:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.894116:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e106 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72196096->72200191] (req 72196096->72200191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.894250:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565486592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6110us (6345us total) trans 4294984934 rc 0/0 00000100:00100000:1.0:1789760781.894261:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17637 00000100:00100000:1.0:1789760781.894270:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720139170110 time 720148416019 state 0x2 ref 0 00000100:00100000:1.0:1789760781.900528:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760781.900611:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486720 00000100:00100000:3.0:1789760781.900621:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486720 00000100:00100000:3.0:1789760781.900686:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720139170110 time 720148416019 state 0x0 ref 1 00000100:00100000:3.0:1789760781.900830:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720148676435 time 720148416019 state 0x1 ref 1 00000100:00100000:3.0:1789760781.900866:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720148676435 time 720161157303 state 0x0 ref 1 00000100:00100000:3.0:1789760781.900878:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760781.900924:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72200192, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226f0 00010000:00010000:3.0:1789760781.900934:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.900949:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760781.900953:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760781.900960:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.900974:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.905282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984935 is committed 00002000:00010000:3.0:1789760781.905408:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72200192 -> 72204288 00002000:00010000:3.0:1789760781.905414:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141040 -> 141048 00010000:00010000:3.0:1789760781.905427:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905440:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905449:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905462:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760781.905467:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905475:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905495:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760781.905503:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e10d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72200192->72204287] (req 72200192->72204287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760781.905599:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4718us (5076us total) trans 4294984935 rc 0/0 00000100:00100000:3.0:1789760781.905610:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17638 00000100:00100000:3.0:1789760781.905620:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720148676435 time 720161157303 state 0x2 ref 0 00000100:00100000:2.0:1789760781.912919:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.913024:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486848 00000100:00100000:0.0:1789760781.913033:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486848 00000100:00100000:0.0:1789760781.913093:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720148676435 time 720161157303 state 0x0 ref 1 00000100:00100000:0.0:1789760781.913109:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720161417719 time 720161157303 state 0x1 ref 1 00000100:00100000:0.0:1789760781.913140:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720161417719 time 720173431742 state 0x0 ref 1 00000100:00100000:0.0:1789760781.913153:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.913201:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72204288, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x226f8 00010000:00010000:0.0:1789760781.913209:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.913224:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.913228:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.913234:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.913255:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.917537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984936 is committed 00002000:00010000:0.0:1789760781.918432:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72204288 -> 72208384 00002000:00010000:0.0:1789760781.918439:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141048 -> 141056 00010000:00010000:0.0:1789760781.918453:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918466:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918475:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918482:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.918488:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918497:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918515:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.918522:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72204288->72208383] (req 72204288->72208383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.918780:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5625us (5866us total) trans 4294984936 rc 0/0 00000100:00100000:0.0:1789760781.918910:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17639 00000100:00100000:0.0:1789760781.918920:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720161417719 time 720173431742 state 0x2 ref 0 00000100:00100000:0.0:1789760781.923247:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.923394:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565486976 00000100:00100000:1.0:1789760781.923404:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565486976 00000100:00100000:1.0:1789760781.923457:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720161417719 time 720173431742 state 0x0 ref 1 00000100:00100000:1.0:1789760781.923473:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720173692158 time 720173431742 state 0x1 ref 1 00000100:00100000:1.0:1789760781.923505:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720173692158 time 720183797917 state 0x0 ref 1 00000100:00100000:1.0:1789760781.923518:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.925095:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72208384, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22700 00010000:00010000:1.0:1789760781.925110:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.925126:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.925130:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.925137:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.925150:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.930340:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984937 is committed 00002000:00010000:1.0:1789760781.930514:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72208384 -> 72212480 00002000:00010000:1.0:1789760781.930519:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141056 -> 141064 00010000:00010000:1.0:1789760781.930532:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930544:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930554:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930562:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.930566:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930574:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930593:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.930600:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674e11b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72208384->72212479] (req 72208384->72212479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.930691:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565486976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7171us (7449us total) trans 4294984937 rc 0/0 00000100:00100000:1.0:1789760781.930993:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17640 00000100:00100000:1.0:1789760781.931003:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720173692158 time 720183797917 state 0x2 ref 0 00000100:00100000:1.0:1789760781.935543:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760781.935644:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487104 00000100:00100000:3.0:1789760781.935654:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487104 00000100:00100000:0.0:1789760781.935962:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720173692158 time 720183797917 state 0x0 ref 1 00000100:00100000:0.0:1789760781.935978:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720184058333 time 720183797917 state 0x1 ref 1 00000100:00100000:0.0:1789760781.936041:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720184058333 time 720196332965 state 0x0 ref 1 00000100:00100000:0.0:1789760781.936063:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565487104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.936110:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72212480, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0x22708 00010000:00010000:0.0:1789760781.936119:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.936135:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.936140:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.936147:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.936161:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760781.943695:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984938 is committed 00002000:00010000:0.0:1789760781.945965:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72212480 -> 72216576 00002000:00010000:0.0:1789760781.945974:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760781 -> 1789760782 00002000:00010000:0.0:1789760781.945977:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760781 -> 1789760782 00002000:00010000:0.0:1789760781.945979:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141064 -> 141072 00010000:00010000:0.0:1789760781.945993:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946007:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946016:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946024:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.946029:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946038:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946057:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.946065:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e122 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72212480->72216575] (req 72212480->72216575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.946375:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565487104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10309us (10835us total) trans 4294984938 rc 0/0 00000100:00100000:0.0:1789760781.946388:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17641 00000100:00100000:0.0:1789760781.946398:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720184058333 time 720196332965 state 0x2 ref 0 00000100:00100000:2.0:1789760781.957459:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.957925:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487232 00000100:00100000:0.0:1789760781.957944:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487232 00000100:00100000:0.0:1789760781.958006:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720184058333 time 720196332965 state 0x0 ref 1 00000100:00100000:0.0:1789760781.958261:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720196593381 time 720196332965 state 0x1 ref 1 00000100:00100000:0.0:1789760781.958300:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720196593381 time 720218591352 state 0x0 ref 1 00000100:00100000:0.0:1789760781.958316:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565487232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.958368:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72216576, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22710 00010000:00010000:0.0:1789760781.958378:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.958394:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.958398:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.958404:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.958418:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.964528:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984939 is committed 00002000:00010000:0.0:1789760781.964663:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72216576 -> 72220672 00002000:00010000:0.0:1789760781.964669:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141072 -> 141080 00010000:00010000:0.0:1789760781.964682:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964695:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964732:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964740:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.964745:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964753:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964771:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.964779:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e129 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72216576->72220671] (req 72216576->72220671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.964937:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565487232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6621us (7483us total) trans 4294984939 rc 0/0 00000100:00100000:0.0:1789760781.964951:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17642 00000100:00100000:0.0:1789760781.964960:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720196593381 time 720218591352 state 0x2 ref 0 00000100:00100000:2.0:1789760781.972249:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760781.972933:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487360 00000100:00100000:1.0:1789760781.972944:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487360 00000100:00100000:1.0:1789760781.973001:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720196593381 time 720218591352 state 0x0 ref 1 00000100:00100000:1.0:1789760781.973016:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720218851768 time 720218591352 state 0x1 ref 1 00000100:00100000:1.0:1789760781.973095:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720218851768 time 720233386765 state 0x0 ref 1 00000100:00100000:1.0:1789760781.973107:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760781.973155:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72220672, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22718 00010000:00010000:1.0:1789760781.973164:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.973179:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760781.973183:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.973189:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.973202:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760781.977757:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984940 is committed 00002000:00010000:1.0:1789760781.981285:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72220672 -> 72224768 00002000:00010000:1.0:1789760781.981296:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141080 -> 141088 00010000:00010000:1.0:1789760781.981310:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981324:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981332:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981340:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760781.981345:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981354:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981373:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.981381:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674e130 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72220672->72224767] (req 72220672->72224767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.981913:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8802us (9669us total) trans 4294984940 rc 0/0 00000100:00100000:1.0:1789760781.981925:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17643 00000100:00100000:1.0:1789760781.981935:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720218851768 time 720233386765 state 0x2 ref 0 00000100:00100000:1.0:1789760781.985877:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.986055:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487488 00000100:00100000:0.0:1789760781.986064:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487488 00000100:00100000:0.0:1789760781.986126:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720218851768 time 720233386765 state 0x0 ref 1 00000100:00100000:0.0:1789760781.986198:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720233647181 time 720233386765 state 0x1 ref 1 00000100:00100000:0.0:1789760781.986274:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720233647181 time 720246564578 state 0x0 ref 1 00000100:00100000:0.0:1789760781.986288:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.986334:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72224768, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22720 00010000:00010000:0.0:1789760781.986393:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.986410:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.986415:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.986421:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.986436:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760781.990389:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984941 is committed 00002000:00010000:0.0:1789760781.990602:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72224768 -> 72228864 00002000:00010000:0.0:1789760781.990608:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141088 -> 141096 00010000:00010000:0.0:1789760781.990622:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990635:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990751:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990759:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760781.990764:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990774:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990795:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.990802:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e137 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72224768->72228863] (req 72224768->72228863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760781.990891:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4602us (5019us total) trans 4294984941 rc 0/0 00000100:00100000:0.0:1789760781.990902:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17644 00000100:00100000:0.0:1789760781.990911:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720233647181 time 720246564578 state 0x2 ref 0 00000100:00100000:2.0:1789760781.995874:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760781.996617:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487616 00000100:00100000:0.0:1789760781.996628:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487616 00000100:00100000:0.0:1789760781.996683:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720233647181 time 720246564578 state 0x0 ref 1 00000100:00100000:0.0:1789760781.996742:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720246824994 time 720246564578 state 0x1 ref 1 00000100:00100000:0.0:1789760781.996818:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720246824994 time 720257108862 state 0x0 ref 1 00000100:00100000:0.0:1789760781.996833:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760781.996879:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72228864, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22728 00010000:00010000:0.0:1789760781.996889:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.996906:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760781.996911:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760781.996917:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760781.996931:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.001222:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984942 is committed 00002000:00010000:0.0:1789760782.003852:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72228864 -> 72232960 00002000:00010000:0.0:1789760782.003861:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141096 -> 141104 00010000:00010000:0.0:1789760782.003874:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003893:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003902:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003908:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.003913:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003922:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003941:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.003949:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e13e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72228864->72232959] (req 72228864->72232959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.004095:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7260us (8226us total) trans 4294984942 rc 0/0 00000100:00100000:0.0:1789760782.004106:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17645 00000100:00100000:0.0:1789760782.004116:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720246824994 time 720257108862 state 0x2 ref 0 00000100:00100000:2.0:1789760782.009138:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.010759:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487744 00000100:00100000:1.0:1789760782.010782:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487744 00000100:00080000:2.0:1789760782.011283:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760782.011322:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720246824994 time 720257108862 state 0x0 ref 1 00000100:00100000:1.0:1789760782.011340:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720257369278 time 720257108862 state 0x1 ref 1 00000100:00100000:1.0:1789760782.011784:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720257369278 time 720272073368 state 0x0 ref 1 00000100:00100000:1.0:1789760782.011802:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565487744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.011862:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72232960, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22730 00010000:00010000:1.0:1789760782.011872:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.011887:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.011892:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.011897:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.011911:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.020206:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984943 is committed 00002000:00010000:1.0:1789760782.021244:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72232960 -> 72237056 00002000:00010000:1.0:1789760782.021251:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141104 -> 141112 00010000:00010000:1.0:1789760782.021265:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021279:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021289:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021296:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.021301:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021310:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021329:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.021336:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674e145 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72232960->72237055] (req 72232960->72237055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.021431:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565487744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9629us (12298us total) trans 4294984943 rc 0/0 00000100:00100000:1.0:1789760782.021441:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17646 00000100:00100000:1.0:1789760782.021451:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720257369278 time 720272073368 state 0x2 ref 0 00000100:00100000:1.0:1789760782.031182:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.031293:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565487872 00000100:00100000:0.0:1789760782.031303:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565487872 00000100:00100000:0.0:1789760782.031359:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720257369278 time 720272073368 state 0x0 ref 1 00000100:00100000:0.0:1789760782.031374:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720272333784 time 720272073368 state 0x1 ref 1 00000100:00100000:0.0:1789760782.031461:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720272333784 time 720291752519 state 0x0 ref 1 00000100:00100000:0.0:1789760782.031474:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.031518:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72237056, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22738 00010000:00010000:0.0:1789760782.031529:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.031544:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.031548:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.031555:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.031568:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.038158:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984944 is committed 00002000:00010000:0.0:1789760782.040942:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72237056 -> 72241152 00002000:00010000:0.0:1789760782.040953:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141112 -> 141120 00010000:00010000:0.0:1789760782.040968:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.040982:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.040998:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.041006:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.041012:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.041021:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.041042:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.041051:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e14c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72237056->72241151] (req 72237056->72241151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.041155:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565487872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9678us (9977us total) trans 4294984944 rc 0/0 00000100:00100000:0.0:1789760782.041165:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17647 00000100:00100000:0.0:1789760782.041175:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720272333784 time 720291752519 state 0x2 ref 0 00000100:00100000:2.0:1789760782.048152:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.048552:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488000 00000100:00100000:0.0:1789760782.048563:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488000 00000100:00100000:0.0:1789760782.048626:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720272333784 time 720291752519 state 0x0 ref 1 00000100:00100000:0.0:1789760782.048642:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720292012935 time 720291752519 state 0x1 ref 1 00000100:00100000:0.0:1789760782.048677:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720292012935 time 720308968599 state 0x0 ref 1 00000100:00100000:0.0:1789760782.048691:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.048778:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72241152, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22740 00010000:00010000:0.0:1789760782.048787:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.048803:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.048807:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.048814:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.048828:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.055331:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984945 is committed 00002000:00010000:0.0:1789760782.055560:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72241152 -> 72245248 00002000:00010000:0.0:1789760782.055567:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141120 -> 141128 00010000:00010000:0.0:1789760782.055582:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055594:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055603:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055616:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.055620:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055629:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055649:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.055656:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e153 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72241152->72245247] (req 72241152->72245247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.055799:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7107us (7652us total) trans 4294984945 rc 0/0 00000100:00100000:0.0:1789760782.055809:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17648 00000100:00100000:0.0:1789760782.055818:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720292012935 time 720308968599 state 0x2 ref 0 00000100:00100000:2.0:1789760782.059828:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.059926:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488128 00000100:00100000:1.0:1789760782.059940:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488128 00000100:00100000:1.0:1789760782.059994:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720292012935 time 720308968599 state 0x0 ref 1 00000100:00100000:1.0:1789760782.060009:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720309229015 time 720308968599 state 0x1 ref 1 00000100:00100000:1.0:1789760782.060074:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720309229015 time 720320365429 state 0x0 ref 1 00000100:00100000:1.0:1789760782.060088:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.060134:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72245248, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22748 00010000:00010000:1.0:1789760782.060143:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.060158:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.060162:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.060168:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.060182:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.065672:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984946 is committed 00002000:00010000:1.0:1789760782.065879:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72245248 -> 72249344 00002000:00010000:1.0:1789760782.065885:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141128 -> 141136 00010000:00010000:1.0:1789760782.065897:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065915:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065924:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065932:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.065936:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065944:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065963:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.065972:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e15a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72245248->72249343] (req 72245248->72249343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.066067:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5977us (6244us total) trans 4294984946 rc 0/0 00000100:00100000:1.0:1789760782.066079:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17649 00000100:00100000:1.0:1789760782.066088:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720309229015 time 720320365429 state 0x2 ref 0 00000100:00100000:1.0:1789760782.070113:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.070209:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488256 00000100:00100000:0.0:1789760782.070218:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488256 00000100:00100000:0.0:1789760782.070273:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720309229015 time 720320365429 state 0x0 ref 1 00000100:00100000:0.0:1789760782.070288:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720320625845 time 720320365429 state 0x1 ref 1 00000100:00100000:0.0:1789760782.070320:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720320625845 time 720330612213 state 0x0 ref 1 00000100:00100000:0.0:1789760782.070337:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.070383:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72249344, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22750 00010000:00010000:0.0:1789760782.070392:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.070409:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.070414:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.070420:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.070448:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.075994:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984947 is committed 00002000:00010000:0.0:1789760782.076168:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72249344 -> 72253440 00002000:00010000:0.0:1789760782.076174:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141136 -> 141144 00010000:00010000:0.0:1789760782.076188:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076201:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076209:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076217:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.076223:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076232:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076252:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.076261:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e161 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72249344->72253439] (req 72249344->72253439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.076352:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6014us (6244us total) trans 4294984947 rc 0/0 00000100:00100000:0.0:1789760782.076364:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17650 00000100:00100000:0.0:1789760782.076373:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720320625845 time 720330612213 state 0x2 ref 0 00000100:00100000:2.0:1789760782.082820:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.083239:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488384 00000100:00100000:0.0:1789760782.083249:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488384 00000100:00100000:0.0:1789760782.083305:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720320625845 time 720330612213 state 0x0 ref 1 00000100:00100000:0.0:1789760782.083326:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720330872629 time 720330612213 state 0x1 ref 1 00000100:00100000:0.0:1789760782.083361:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720330872629 time 720343653238 state 0x0 ref 1 00000100:00100000:0.0:1789760782.084002:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.084054:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72253440, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22758 00010000:00010000:0.0:1789760782.084063:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.084079:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.084084:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.084090:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.084104:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.091350:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984948 is committed 00002000:00010000:0.0:1789760782.095077:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72253440 -> 72257536 00002000:00010000:0.0:1789760782.095085:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141144 -> 141152 00010000:00010000:0.0:1789760782.095098:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095111:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095121:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095128:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.095134:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095142:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095162:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.095170:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e168 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72253440->72257535] (req 72253440->72257535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.095298:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11922us (12482us total) trans 4294984948 rc 0/0 00000100:00100000:0.0:1789760782.095309:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17651 00000100:00100000:0.0:1789760782.095318:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720330872629 time 720343653238 state 0x2 ref 0 00000100:00100000:2.0:1789760782.102381:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.102467:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488512 00000100:00100000:1.0:1789760782.102476:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488512 00000100:00100000:1.0:1789760782.102527:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720330872629 time 720343653238 state 0x0 ref 1 00000100:00100000:1.0:1789760782.102543:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720343913654 time 720343653238 state 0x1 ref 1 00000100:00100000:1.0:1789760782.102571:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720343913654 time 720362863176 state 0x0 ref 1 00000100:00100000:1.0:1789760782.102584:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.102640:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72257536, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22760 00010000:00010000:1.0:1789760782.102654:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.102670:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.102674:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.102680:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.102693:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.109917:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984949 is committed 00002000:00010000:1.0:1789760782.110965:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72257536 -> 72261632 00002000:00010000:1.0:1789760782.110971:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141152 -> 141160 00010000:00010000:1.0:1789760782.110997:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111016:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111025:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111033:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.111038:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111047:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111065:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.111072:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e16f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72257536->72261631] (req 72257536->72261631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.111251:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8663us (8873us total) trans 4294984949 rc 0/0 00000100:00100000:1.0:1789760782.111261:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17652 00000100:00100000:1.0:1789760782.111271:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720343913654 time 720362863176 state 0x2 ref 0 00000100:00100000:0.0:1789760782.124348:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.124543:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488640 00000100:00100000:2.0:1789760782.124554:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488640 00000100:00100000:2.0:1789760782.124608:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720343913654 time 720362863176 state 0x0 ref 1 00000100:00100000:2.0:1789760782.124622:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720363123592 time 720362863176 state 0x1 ref 1 00000100:00100000:2.0:1789760782.124769:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720363123592 time 720385060216 state 0x0 ref 1 00000100:00100000:2.0:1789760782.124784:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.124832:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72261632, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22768 00010000:00010000:2.0:1789760782.124841:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.124856:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.124860:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.124865:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.124878:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.132641:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984950 is committed 00002000:00010000:0.0:1789760782.139876:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72261632 -> 72265728 00002000:00010000:0.0:1789760782.139888:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141160 -> 141168 00010000:00010000:0.0:1789760782.139904:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139918:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139926:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139933:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.139938:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139947:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139965:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.139972:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e176 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72261632->72265727] (req 72261632->72265727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.140419:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565488640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15632us (16074us total) trans 4294984950 rc 0/0 00000100:00100000:0.0:1789760782.140430:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17653 00000100:00100000:0.0:1789760782.140440:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720363123592 time 720385060216 state 0x2 ref 0 00000100:00100000:2.0:1789760782.146205:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.147899:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488768 00000100:00100000:0.0:1789760782.147912:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488768 00000100:00100000:1.0:1789760782.149404:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720363123592 time 720385060216 state 0x0 ref 1 00000100:00100000:1.0:1789760782.149421:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720385320632 time 720385060216 state 0x1 ref 1 00000100:00100000:1.0:1789760782.149503:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720385320632 time 720409793734 state 0x0 ref 1 00000100:00100000:1.0:1789760782.149518:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.149567:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72265728, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22770 00010000:00010000:1.0:1789760782.149576:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.149592:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.149596:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.149602:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.149615:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.154805:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984951 is committed 00002000:00010000:1.0:1789760782.155127:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72265728 -> 72269824 00002000:00010000:1.0:1789760782.155133:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141168 -> 141176 00010000:00010000:1.0:1789760782.155147:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155159:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155168:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155176:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.155181:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155190:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155210:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.155218:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e17d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72265728->72269823] (req 72265728->72269823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.155413:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565488768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5894us (9213us total) trans 4294984951 rc 0/0 00000100:00100000:1.0:1789760782.155424:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17654 00000100:00100000:1.0:1789760782.155433:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720385320632 time 720409793734 state 0x2 ref 0 00000100:00100000:2.0:1789760782.159310:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.159405:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565488896 00000100:00100000:1.0:1789760782.159414:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565488896 00000100:00100000:1.0:1789760782.159464:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720385320632 time 720409793734 state 0x0 ref 1 00000100:00100000:1.0:1789760782.159479:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720410054150 time 720409793734 state 0x1 ref 1 00000100:00100000:1.0:1789760782.159508:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720410054150 time 720419801150 state 0x0 ref 1 00000100:00100000:1.0:1789760782.159524:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565488896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.159571:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72269824, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22778 00010000:00010000:1.0:1789760782.159580:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.159595:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.159599:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.159605:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.159620:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.164681:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984952 is committed 00002000:00010000:1.0:1789760782.164886:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72269824 -> 72273920 00002000:00010000:1.0:1789760782.164892:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141176 -> 141184 00010000:00010000:1.0:1789760782.164905:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164917:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164926:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164946:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.164952:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164960:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164981:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.164988:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e184 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72269824->72273919] (req 72269824->72273919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.165199:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565488896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5672us (5893us total) trans 4294984952 rc 0/0 00000100:00100000:1.0:1789760782.165209:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17655 00000100:00100000:1.0:1789760782.165217:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720410054150 time 720419801150 state 0x2 ref 0 00000100:00100000:0.0:1789760782.173672:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.174366:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489024 00000100:00100000:2.0:1789760782.174378:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489024 00000100:00100000:2.0:1789760782.174433:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720410054150 time 720419801150 state 0x0 ref 1 00000100:00100000:2.0:1789760782.174448:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720420061566 time 720419801150 state 0x1 ref 1 00000100:00100000:2.0:1789760782.174481:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720420061566 time 720434773331 state 0x0 ref 1 00000100:00100000:2.0:1789760782.174495:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.174543:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72273920, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22780 00010000:00010000:2.0:1789760782.174552:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.174567:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.174571:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.174577:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.174591:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.181473:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984953 is committed 00002000:00010000:2.0:1789760782.181666:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72273920 -> 72278016 00002000:00010000:2.0:1789760782.181671:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141184 -> 141192 00010000:00010000:2.0:1789760782.181685:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181742:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181753:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181767:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.181771:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181780:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181808:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.181817:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e18b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72273920->72278015] (req 72273920->72278015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.181910:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7413us (8242us total) trans 4294984953 rc 0/0 00000100:00100000:2.0:1789760782.181922:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17656 00000100:00100000:2.0:1789760782.181934:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720420061566 time 720434773331 state 0x2 ref 0 00000100:00100000:2.0:1789760782.187239:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.187449:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489152 00000100:00100000:1.0:1789760782.187528:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489152 00000100:00100000:1.0:1789760782.187586:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720420061566 time 720434773331 state 0x0 ref 1 00000100:00100000:1.0:1789760782.187602:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720435033747 time 720434773331 state 0x1 ref 1 00000100:00100000:1.0:1789760782.187636:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720435033747 time 720447927972 state 0x0 ref 1 00000100:00100000:1.0:1789760782.187648:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565489152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.187696:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72278016, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22788 00010000:00010000:1.0:1789760782.187737:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.187754:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.187758:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.187765:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.187779:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.201410:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984954 is committed 00002000:00010000:1.0:1789760782.201544:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72278016 -> 72282112 00002000:00010000:1.0:1789760782.201549:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141192 -> 141200 00010000:00010000:1.0:1789760782.201561:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201573:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201581:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201587:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.201592:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201599:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201621:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.201630:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e192 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72278016->72282111] (req 72278016->72282111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.201765:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565489152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14114us (14532us total) trans 4294984954 rc 0/0 00000100:00100000:1.0:1789760782.201776:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17657 00000100:00100000:1.0:1789760782.201785:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720435033747 time 720447927972 state 0x2 ref 0 00000100:00100000:0.0:1789760782.206802:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.207439:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489280 00000100:00100000:1.0:1789760782.207448:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489280 00000100:00100000:1.0:1789760782.207502:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720435033747 time 720447927972 state 0x0 ref 1 00000100:00100000:1.0:1789760782.207517:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720448188388 time 720447927972 state 0x1 ref 1 00000100:00100000:1.0:1789760782.207548:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720448188388 time 720467840515 state 0x0 ref 1 00000100:00100000:1.0:1789760782.207561:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.207933:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72282112, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22790 00010000:00010000:1.0:1789760782.207944:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.207959:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.207964:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.207971:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.207984:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.219539:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984955 is committed 00002000:00010000:2.0:1789760782.220158:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72282112 -> 72286208 00002000:00010000:2.0:1789760782.220164:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141200 -> 141208 00010000:00010000:2.0:1789760782.220178:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220191:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220201:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220208:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.220213:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220222:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220241:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.220248:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e199 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72282112->72286207] (req 72282112->72286207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.220343:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12779us (13545us total) trans 4294984955 rc 0/0 00000100:00100000:2.0:1789760782.220354:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17658 00000100:00100000:2.0:1789760782.220363:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720448188388 time 720467840515 state 0x2 ref 0 00000100:00100000:0.0:1789760782.224979:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.225789:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489408 00000100:00100000:2.0:1789760782.225800:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489408 00000100:00100000:2.0:1789760782.225853:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720448188388 time 720467840515 state 0x0 ref 1 00000100:00100000:2.0:1789760782.225868:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720468100931 time 720467840515 state 0x1 ref 1 00000100:00100000:2.0:1789760782.225902:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720468100931 time 720486193300 state 0x0 ref 1 00000100:00100000:2.0:1789760782.225914:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.225962:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72286208, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22798 00010000:00010000:2.0:1789760782.225971:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.225987:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.225992:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.225999:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.226013:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.234785:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984956 is committed 00002000:00010000:2.0:1789760782.234904:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72286208 -> 72290304 00002000:00010000:2.0:1789760782.234909:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141208 -> 141216 00010000:00010000:2.0:1789760782.234922:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.234934:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.234944:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.234955:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.234960:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.234968:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.234997:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.235004:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72286208->72290303] (req 72286208->72290303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.235096:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9179us (10119us total) trans 4294984956 rc 0/0 00000100:00100000:2.0:1789760782.235107:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17659 00000100:00100000:2.0:1789760782.235116:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720468100931 time 720486193300 state 0x2 ref 0 00000100:00100000:1.0:1789760782.240497:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.240617:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489536 00000100:00100000:3.0:1789760782.240626:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489536 00000100:00100000:3.0:1789760782.240754:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720468100931 time 720486193300 state 0x0 ref 1 00000100:00100000:3.0:1789760782.240770:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720486453716 time 720486193300 state 0x1 ref 1 00000100:00100000:3.0:1789760782.240836:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720486453716 time 720501127432 state 0x0 ref 1 00000100:00100000:3.0:1789760782.240849:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.240893:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72290304, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227a0 00010000:00010000:3.0:1789760782.240903:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.240919:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.240923:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.240929:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.240943:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.246817:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984957 is committed 00002000:00010000:3.0:1789760782.247242:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72290304 -> 72294400 00002000:00010000:3.0:1789760782.247247:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141216 -> 141224 00010000:00010000:3.0:1789760782.247259:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247276:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247285:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247291:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760782.247296:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247303:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247322:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.247330:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72290304->72294399] (req 72290304->72294399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.247426:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565489536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6575us (6933us total) trans 4294984957 rc 0/0 00000100:00100000:3.0:1789760782.247437:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17660 00000100:00100000:3.0:1789760782.247447:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720486453716 time 720501127432 state 0x2 ref 0 00000100:00100000:0.0:1789760782.251013:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.251546:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489664 00000100:00100000:2.0:1789760782.251558:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489664 00000100:00100000:2.0:1789760782.251616:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720486453716 time 720501127432 state 0x0 ref 1 00000100:00100000:2.0:1789760782.251634:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720501387848 time 720501127432 state 0x1 ref 1 00000100:00100000:2.0:1789760782.251665:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720501387848 time 720511957498 state 0x0 ref 1 00000100:00100000:2.0:1789760782.251683:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565489664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.252833:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72294400, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227a8 00010000:00010000:0.0:1789760782.252847:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.252871:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.252876:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.252883:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.252896:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.258786:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984958 is committed 00002000:00010000:0.0:1789760782.258972:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72294400 -> 72298496 00002000:00010000:0.0:1789760782.258978:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141224 -> 141232 00010000:00010000:0.0:1789760782.258991:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259005:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259014:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259021:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.259026:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259034:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259060:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.259068:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e1ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72294400->72298495] (req 72294400->72298495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.259178:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565489664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7484us (8160us total) trans 4294984958 rc 0/0 00000100:00100000:0.0:1789760782.259189:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17661 00000100:00100000:0.0:1789760782.259198:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720501387848 time 720511957498 state 0x2 ref 0 00000100:00100000:0.0:1789760782.276041:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.276182:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489792 00000100:00100000:2.0:1789760782.276192:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489792 00000100:00100000:2.0:1789760782.276244:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720501387848 time 720511957498 state 0x0 ref 1 00000100:00100000:2.0:1789760782.276260:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720512217914 time 720511957498 state 0x1 ref 1 00000100:00100000:2.0:1789760782.276335:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720512217914 time 720536626517 state 0x0 ref 1 00000100:00100000:2.0:1789760782.276347:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565489792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.276458:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72298496, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227b0 00010000:00010000:2.0:1789760782.276469:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.276485:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.276489:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.276495:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.276510:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.281580:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984959 is committed 00002000:00010000:2.0:1789760782.281695:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72298496 -> 72302592 00002000:00010000:2.0:1789760782.281738:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141232 -> 141240 00010000:00010000:2.0:1789760782.281753:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281766:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281776:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281783:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.281788:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281797:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281818:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.281825:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e1b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72298496->72302591] (req 72298496->72302591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.281909:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565489792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5558us (5870us total) trans 4294984959 rc 0/0 00000100:00100000:2.0:1789760782.281919:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17662 00000100:00100000:2.0:1789760782.281929:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720512217914 time 720536626517 state 0x2 ref 0 00000100:00100000:1.0:1789760782.287692:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.287854:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565489920 00000100:00100000:3.0:1789760782.287863:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565489920 00000100:00100000:3.0:1789760782.287914:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720512217914 time 720536626517 state 0x0 ref 1 00000100:00100000:3.0:1789760782.287929:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720536886933 time 720536626517 state 0x1 ref 1 00000100:00100000:3.0:1789760782.287959:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720536886933 time 720548251063 state 0x0 ref 1 00000100:00100000:3.0:1789760782.287971:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565489920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.288011:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72302592, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227b8 00010000:00010000:3.0:1789760782.288030:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.288046:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.288050:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.288056:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.288070:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.292684:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984960 is committed 00002000:00010000:3.0:1789760782.293211:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72302592 -> 72306688 00002000:00010000:3.0:1789760782.293217:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141240 -> 141248 00010000:00010000:3.0:1789760782.293230:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293244:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293254:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293261:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760782.293266:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293274:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293293:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.293300:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72302592->72306687] (req 72302592->72306687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.293450:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565489920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5475us (5762us total) trans 4294984960 rc 0/0 00000100:00100000:3.0:1789760782.293461:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17663 00000100:00100000:3.0:1789760782.293470:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720536886933 time 720548251063 state 0x2 ref 0 00000100:00100000:0.0:1789760782.298307:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.298481:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490048 00000100:00100000:1.0:1789760782.298489:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490048 00000100:00100000:1.0:1789760782.298540:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720536886933 time 720548251063 state 0x0 ref 1 00000100:00100000:1.0:1789760782.298554:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720548511479 time 720548251063 state 0x1 ref 1 00000100:00100000:1.0:1789760782.298610:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720548511479 time 720558901106 state 0x0 ref 1 00000100:00100000:1.0:1789760782.298624:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.298671:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72306688, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227c0 00010000:00010000:1.0:1789760782.298680:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.298695:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.298742:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.298748:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.298767:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.303367:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984961 is committed 00002000:00010000:1.0:1789760782.303627:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72306688 -> 72310784 00002000:00010000:1.0:1789760782.303633:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141248 -> 141256 00010000:00010000:1.0:1789760782.303754:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303766:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303775:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303783:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.303787:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303795:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303814:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.303822:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72306688->72310783] (req 72306688->72310783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.303919:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5292us (5617us total) trans 4294984961 rc 0/0 00000100:00100000:1.0:1789760782.303930:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17664 00000100:00100000:1.0:1789760782.303940:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720548511479 time 720558901106 state 0x2 ref 0 00000100:00100000:1.0:1789760782.321815:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.322116:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490176 00000100:00100000:2.0:1789760782.322126:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490176 00000100:00100000:2.0:1789760782.322177:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720548511479 time 720558901106 state 0x0 ref 1 00000100:00100000:2.0:1789760782.322192:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720559161522 time 720558901106 state 0x1 ref 1 00000100:00100000:2.0:1789760782.322217:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720559161522 time 720582509353 state 0x0 ref 1 00000100:00100000:2.0:1789760782.322228:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.322272:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72310784, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227c8 00010000:00010000:2.0:1789760782.322282:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.322297:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.322301:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.322307:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.322320:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.328056:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984962 is committed 00002000:00010000:2.0:1789760782.328293:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72310784 -> 72314880 00002000:00010000:2.0:1789760782.328298:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141256 -> 141264 00010000:00010000:2.0:1789760782.328312:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328324:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328338:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328345:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.328349:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328357:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328376:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.328384:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e1ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72310784->72314879] (req 72310784->72314879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.328631:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6399us (6821us total) trans 4294984962 rc 0/0 00000100:00100000:2.0:1789760782.328650:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17665 00000100:00100000:2.0:1789760782.328660:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720559161522 time 720582509353 state 0x2 ref 0 00000100:00100000:2.0:1789760782.334650:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.334744:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490304 00000100:00100000:3.0:1789760782.334759:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490304 00000100:00100000:3.0:1789760782.334818:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720559161522 time 720582509353 state 0x0 ref 1 00000100:00100000:3.0:1789760782.334834:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720582769769 time 720582509353 state 0x1 ref 1 00000100:00100000:3.0:1789760782.334912:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720582769769 time 720595203475 state 0x0 ref 1 00000100:00100000:3.0:1789760782.334925:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565490304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.334971:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72314880, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227d0 00010000:00010000:3.0:1789760782.334981:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.334996:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.335000:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.335007:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.335020:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.341966:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984963 is committed 00002000:00010000:1.0:1789760782.342342:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72314880 -> 72318976 00002000:00010000:1.0:1789760782.342347:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141264 -> 141272 00010000:00010000:1.0:1789760782.342360:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342372:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342381:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342388:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.342393:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342403:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342563:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.342571:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e1d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72314880->72318975] (req 72314880->72318975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.342764:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565490304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7835us (8133us total) trans 4294984963 rc 0/0 00000100:00100000:1.0:1789760782.342775:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17666 00000100:00100000:1.0:1789760782.342785:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720582769769 time 720595203475 state 0x2 ref 0 00000100:00100000:0.0:1789760782.350824:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.350935:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490432 00000100:00100000:1.0:1789760782.350946:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490432 00000100:00100000:1.0:1789760782.351001:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720582769769 time 720595203475 state 0x0 ref 1 00000100:00100000:1.0:1789760782.351018:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720595463891 time 720595203475 state 0x1 ref 1 00000100:00100000:1.0:1789760782.351087:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720595463891 time 720611378513 state 0x0 ref 1 00000100:00100000:1.0:1789760782.351100:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.351152:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72318976, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227d8 00010000:00010000:1.0:1789760782.351161:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.351176:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.351181:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.351186:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.351199:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.356467:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984964 is committed 00002000:00010000:1.0:1789760782.356672:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72318976 -> 72323072 00002000:00010000:1.0:1789760782.356678:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141272 -> 141280 00010000:00010000:1.0:1789760782.356692:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356841:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356850:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356857:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.356862:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356871:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356892:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.356904:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72318976->72323071] (req 72318976->72323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.357216:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6113us (6395us total) trans 4294984964 rc 0/0 00000100:00100000:1.0:1789760782.357227:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17667 00000100:00100000:1.0:1789760782.357237:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720595463891 time 720611378513 state 0x2 ref 0 00000100:00100000:2.0:1789760782.361064:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.361197:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490560 00000100:00100000:0.0:1789760782.361206:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490560 00000100:00100000:0.0:1789760782.361263:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720595463891 time 720611378513 state 0x0 ref 1 00000100:00100000:0.0:1789760782.361278:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720611638929 time 720611378513 state 0x1 ref 1 00000100:00100000:0.0:1789760782.361311:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720611638929 time 720621602164 state 0x0 ref 1 00000100:00100000:0.0:1789760782.361323:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565490560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.361370:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72323072, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227e0 00010000:00010000:0.0:1789760782.361379:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.361395:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.361400:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.361407:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.361420:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.365489:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984965 is committed 00002000:00010000:0.0:1789760782.365849:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72323072 -> 72327168 00002000:00010000:0.0:1789760782.365854:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141280 -> 141288 00010000:00010000:0.0:1789760782.365868:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365881:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365890:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365896:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.365902:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365915:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365936:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.365943:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72323072->72327167] (req 72323072->72327167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.366089:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565490560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4763us (5029us total) trans 4294984965 rc 0/0 00000100:00100000:0.0:1789760782.366100:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17668 00000100:00100000:0.0:1789760782.366109:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720611638929 time 720621602164 state 0x2 ref 0 00000100:00100000:2.0:1789760782.370385:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.370516:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490688 00000100:00100000:1.0:1789760782.370527:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490688 00000100:00100000:1.0:1789760782.370584:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720611638929 time 720621602164 state 0x0 ref 1 00000100:00100000:1.0:1789760782.370599:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720621862580 time 720621602164 state 0x1 ref 1 00000100:00100000:1.0:1789760782.370752:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720621862580 time 720631042918 state 0x0 ref 1 00000100:00100000:1.0:1789760782.370765:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565490688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.370965:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72327168, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227e8 00010000:00010000:1.0:1789760782.370975:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.370992:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.370997:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.371004:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.371024:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.376848:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984966 is committed 00002000:00010000:1.0:1789760782.377112:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72327168 -> 72331264 00002000:00010000:1.0:1789760782.377117:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141288 -> 141296 00010000:00010000:1.0:1789760782.377129:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377141:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377149:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377156:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.377160:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377167:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377184:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.377191:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e1e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72327168->72331263] (req 72327168->72331263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.377312:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565490688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6543us (6932us total) trans 4294984966 rc 0/0 00000100:00100000:1.0:1789760782.377324:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17669 00000100:00100000:1.0:1789760782.377338:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720621862580 time 720631042918 state 0x2 ref 0 00000100:00100000:2.0:1789760782.381946:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.382026:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490816 00000100:00100000:0.0:1789760782.382035:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490816 00000100:00100000:0.0:1789760782.382099:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720621862580 time 720631042918 state 0x0 ref 1 00000100:00100000:0.0:1789760782.382114:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720631303334 time 720631042918 state 0x1 ref 1 00000100:00100000:0.0:1789760782.382145:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720631303334 time 720642437873 state 0x0 ref 1 00000100:00100000:0.0:1789760782.382157:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.382212:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72331264, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227f0 00010000:00010000:0.0:1789760782.382221:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.382236:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.382242:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.382247:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.382261:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.387940:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984967 is committed 00002000:00010000:1.0:1789760782.388017:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72331264 -> 72335360 00002000:00010000:1.0:1789760782.388022:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141296 -> 141304 00010000:00010000:1.0:1789760782.388036:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388060:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388070:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388077:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.388082:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388091:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388110:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.388123:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e1ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72331264->72335359] (req 72331264->72335359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.388612:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565490816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6452us (6671us total) trans 4294984967 rc 0/0 00000100:00100000:1.0:1789760782.388620:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17670 00000100:00100000:1.0:1789760782.388628:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720631303334 time 720642437873 state 0x2 ref 0 00000100:00100000:2.0:1789760782.393157:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.393394:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565490944 00000100:00100000:0.0:1789760782.393404:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565490944 00000100:00100000:0.0:1789760782.393466:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720631303334 time 720642437873 state 0x0 ref 1 00000100:00100000:0.0:1789760782.393481:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720642698289 time 720642437873 state 0x1 ref 1 00000100:00100000:0.0:1789760782.393510:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720642698289 time 720653802628 state 0x0 ref 1 00000100:00100000:0.0:1789760782.393522:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565490944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.393568:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72335360, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x227f8 00010000:00010000:0.0:1789760782.393579:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.393595:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.393599:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.393606:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.393620:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.399558:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984968 is committed 00002000:00010000:2.0:1789760782.400611:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72335360 -> 72339456 00002000:00010000:2.0:1789760782.400619:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141304 -> 141312 00010000:00010000:2.0:1789760782.400642:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400656:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400664:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400671:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.400683:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400692:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400743:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.400750:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e1f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72335360->72339455] (req 72335360->72339455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.400954:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565490944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7429us (7803us total) trans 4294984968 rc 0/0 00000100:00100000:2.0:1789760782.400966:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17671 00000100:00100000:2.0:1789760782.400975:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720642698289 time 720653802628 state 0x2 ref 0 00000100:00100000:2.0:1789760782.406114:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.406241:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491072 00000100:00100000:3.0:1789760782.406250:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491072 00000100:00100000:3.0:1789760782.406305:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720642698289 time 720653802628 state 0x0 ref 1 00000100:00100000:3.0:1789760782.406321:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720654063044 time 720653802628 state 0x1 ref 1 00000100:00100000:3.0:1789760782.406352:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720654063044 time 720666644721 state 0x0 ref 1 00000100:00100000:3.0:1789760782.406365:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.406413:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72339456, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22800 00010000:00010000:3.0:1789760782.406423:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.406439:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.406443:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.406448:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.406461:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.411280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984969 is committed 00002000:00010000:3.0:1789760782.411398:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72339456 -> 72343552 00002000:00010000:3.0:1789760782.411403:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141312 -> 141320 00010000:00010000:3.0:1789760782.411417:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411429:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411437:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411444:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760782.411448:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411461:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411480:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.411487:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e1fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72339456->72343551] (req 72339456->72343551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.411628:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5261us (5520us total) trans 4294984969 rc 0/0 00000100:00100000:3.0:1789760782.411652:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17672 00000100:00100000:3.0:1789760782.411661:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720654063044 time 720666644721 state 0x2 ref 0 00000100:00100000:0.0:1789760782.417087:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.417573:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491200 00000100:00100000:1.0:1789760782.417583:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491200 00000100:00100000:1.0:1789760782.417647:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720654063044 time 720666644721 state 0x0 ref 1 00000100:00100000:1.0:1789760782.417663:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720666905137 time 720666644721 state 0x1 ref 1 00000100:00100000:1.0:1789760782.417692:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720666905137 time 720677983922 state 0x0 ref 1 00000100:00100000:1.0:1789760782.417751:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565491200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.417807:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72343552, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22808 00010000:00010000:1.0:1789760782.417821:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.417837:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.417841:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.417847:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.417862:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.423463:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984970 is committed 00002000:00010000:1.0:1789760782.423577:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72343552 -> 72347648 00002000:00010000:1.0:1789760782.423582:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141320 -> 141328 00010000:00010000:1.0:1789760782.423596:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423609:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423619:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423625:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.423630:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423648:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423668:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.423675:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e202 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72343552->72347647] (req 72343552->72347647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.424206:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565491200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6451us (7120us total) trans 4294984970 rc 0/0 00000100:00100000:1.0:1789760782.424217:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17673 00000100:00100000:1.0:1789760782.424227:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720666905137 time 720677983922 state 0x2 ref 0 00000100:00100000:2.0:1789760782.429453:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.429548:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491328 00000100:00100000:0.0:1789760782.429557:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491328 00000100:00100000:0.0:1789760782.429612:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720666905137 time 720677983922 state 0x0 ref 1 00000100:00100000:0.0:1789760782.429627:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720678244338 time 720677983922 state 0x1 ref 1 00000100:00100000:0.0:1789760782.429656:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720678244338 time 720689948377 state 0x0 ref 1 00000100:00100000:0.0:1789760782.429669:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.429755:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72347648, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22810 00010000:00010000:0.0:1789760782.429765:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.429794:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.429799:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.429805:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.429819:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.434526:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984971 is committed 00002000:00010000:0.0:1789760782.435496:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72347648 -> 72351744 00002000:00010000:0.0:1789760782.435504:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141328 -> 141336 00010000:00010000:0.0:1789760782.435518:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435531:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435540:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435546:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.435551:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435560:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435580:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.435587:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e209 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72347648->72351743] (req 72347648->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.435804:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6133us (6431us total) trans 4294984971 rc 0/0 00000100:00100000:0.0:1789760782.435815:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17674 00000100:00100000:0.0:1789760782.435826:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720678244338 time 720689948377 state 0x2 ref 0 00000100:00100000:2.0:1789760782.446088:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.446499:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491456 00000100:00100000:3.0:1789760782.446509:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491456 00000100:00100000:3.0:1789760782.446562:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720678244338 time 720689948377 state 0x0 ref 1 00000100:00100000:3.0:1789760782.446577:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720690208793 time 720689948377 state 0x1 ref 1 00000100:00100000:3.0:1789760782.446610:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720690208793 time 720706902763 state 0x0 ref 1 00000100:00100000:3.0:1789760782.446622:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565491456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.446681:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72351744, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22818 00010000:00010000:3.0:1789760782.446690:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.446758:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.446762:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.446769:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.446783:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.455935:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984972 is committed 00002000:00010000:3.0:1789760782.456205:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72351744 -> 72355840 00002000:00010000:3.0:1789760782.456210:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141336 -> 141344 00010000:00010000:3.0:1789760782.456225:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456237:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456306:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456315:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760782.456321:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456330:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456354:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.456361:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e210 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->72355839] (req 72351744->72355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.456522:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565491456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9897us (10439us total) trans 4294984972 rc 0/0 00000100:00100000:3.0:1789760782.456533:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17675 00000100:00100000:3.0:1789760782.456542:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720690208793 time 720706902763 state 0x2 ref 0 00000100:00100000:2.0:1789760782.462106:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.462626:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491584 00000100:00100000:1.0:1789760782.462643:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491584 00000100:00100000:1.0:1789760782.462738:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720690208793 time 720706902763 state 0x0 ref 1 00000100:00100000:1.0:1789760782.462754:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720707163179 time 720706902763 state 0x1 ref 1 00000100:00100000:1.0:1789760782.462883:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720707163179 time 720723173881 state 0x0 ref 1 00000100:00100000:1.0:1789760782.462896:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.463646:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72355840, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22820 00010000:00010000:1.0:1789760782.463657:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.463672:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.463676:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.463683:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.463737:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.469777:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984973 is committed 00002000:00010000:1.0:1789760782.469885:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72355840 -> 72359936 00002000:00010000:1.0:1789760782.469889:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141344 -> 141352 00010000:00010000:1.0:1789760782.469901:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469913:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469922:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469929:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.469933:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469943:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469963:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.469971:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e217 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72355840->72359935] (req 72355840->72359935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.470115:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7216us (8013us total) trans 4294984973 rc 0/0 00000100:00100000:1.0:1789760782.470126:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17676 00000100:00100000:1.0:1789760782.470135:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720707163179 time 720723173881 state 0x2 ref 0 00000100:00100000:2.0:1789760782.479735:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.479817:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491712 00000100:00100000:0.0:1789760782.479827:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491712 00000100:00100000:0.0:1789760782.479878:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720707163179 time 720723173881 state 0x0 ref 1 00000100:00100000:0.0:1789760782.479892:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720723434297 time 720723173881 state 0x1 ref 1 00000100:00100000:0.0:1789760782.479921:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720723434297 time 720740213009 state 0x0 ref 1 00000100:00100000:0.0:1789760782.479933:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.479977:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72359936, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22828 00010000:00010000:0.0:1789760782.479986:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.480001:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.480005:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.480011:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.480026:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.487251:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984974 is committed 00002000:00010000:2.0:1789760782.487367:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72359936 -> 72364032 00002000:00010000:2.0:1789760782.487373:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141352 -> 141360 00010000:00010000:2.0:1789760782.487396:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487409:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487422:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487429:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.487433:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487442:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487464:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.487472:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e21e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72359936->72364031] (req 72359936->72364031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.487581:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7646us (7888us total) trans 4294984974 rc 0/0 00000100:00100000:2.0:1789760782.487591:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17677 00000100:00100000:2.0:1789760782.487599:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720723434297 time 720740213009 state 0x2 ref 0 00000100:00100000:2.0:1789760782.491820:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.491892:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491840 00000100:00100000:3.0:1789760782.491901:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491840 00000100:00100000:3.0:1789760782.491952:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720723434297 time 720740213009 state 0x0 ref 1 00000100:00100000:3.0:1789760782.491968:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720740473425 time 720740213009 state 0x1 ref 1 00000100:00100000:3.0:1789760782.491996:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720740473425 time 720752288604 state 0x0 ref 1 00000100:00100000:3.0:1789760782.492009:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.492063:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72364032, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22830 00010000:00010000:3.0:1789760782.492072:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.492088:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.492198:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.492206:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.492221:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.497334:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984975 is committed 00002000:00010000:0.0:1789760782.498271:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72364032 -> 72368128 00002000:00010000:0.0:1789760782.498278:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141360 -> 141368 00010000:00010000:0.0:1789760782.498290:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498304:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498313:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498320:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.498325:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498334:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498354:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.498362:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e225 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72364032->72368127] (req 72364032->72368127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.498570:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565491840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6558us (6754us total) trans 4294984975 rc 0/0 00000100:00100000:0.0:1789760782.498582:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17678 00000100:00100000:0.0:1789760782.498592:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720740473425 time 720752288604 state 0x2 ref 0 00000100:00100000:0.0:1789760782.503850:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.503992:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565491968 00000100:00100000:1.0:1789760782.504001:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565491968 00000100:00100000:1.0:1789760782.504054:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720740473425 time 720752288604 state 0x0 ref 1 00000100:00100000:1.0:1789760782.504068:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720752549020 time 720752288604 state 0x1 ref 1 00000100:00100000:1.0:1789760782.504099:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720752549020 time 720764391534 state 0x0 ref 1 00000100:00100000:1.0:1789760782.504112:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e75b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565491968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.504153:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72368128, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22838 00010000:00010000:1.0:1789760782.504163:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.504179:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.504183:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.504190:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.504204:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.508885:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984976 is committed 00002000:00010000:1.0:1789760782.509041:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72368128 -> 72372224 00002000:00010000:1.0:1789760782.509046:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141368 -> 141376 00010000:00010000:1.0:1789760782.509060:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509073:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509081:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509088:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.509093:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509101:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509119:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.509126:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e22c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72368128->72372223] (req 72368128->72372223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.509215:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e75b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565491968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5101us (5369us total) trans 4294984976 rc 0/0 00000100:00100000:1.0:1789760782.509226:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17679 00000100:00100000:1.0:1789760782.509235:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720752549020 time 720764391534 state 0x2 ref 0 00000100:00100000:2.0:1789760782.525371:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.525551:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492096 00000100:00100000:0.0:1789760782.525562:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492096 00000100:00100000:0.0:1789760782.525615:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720752549020 time 720764391534 state 0x0 ref 1 00000100:00100000:0.0:1789760782.525630:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720764651950 time 720764391534 state 0x1 ref 1 00000100:00100000:0.0:1789760782.525743:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720764651950 time 720786034973 state 0x0 ref 1 00000100:00100000:0.0:1789760782.525757:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.525802:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72372224, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22840 00010000:00010000:0.0:1789760782.525811:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.525826:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.525830:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.525837:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.525850:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.529736:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984977 is committed 00002000:00010000:0.0:1789760782.529841:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72372224 -> 72376320 00002000:00010000:0.0:1789760782.529847:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141376 -> 141384 00010000:00010000:0.0:1789760782.529860:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529873:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529882:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529890:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.529894:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529903:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529921:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.529929:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e233 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72372224->72376319] (req 72372224->72376319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.530017:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4259us (4651us total) trans 4294984977 rc 0/0 00000100:00100000:0.0:1789760782.530028:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17680 00000100:00100000:0.0:1789760782.530047:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720764651950 time 720786034973 state 0x2 ref 0 00000100:00100000:2.0:1789760782.534154:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.534892:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492224 00000100:00100000:0.0:1789760782.534901:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492224 00000100:00100000:0.0:1789760782.534955:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720764651950 time 720786034973 state 0x0 ref 1 00000100:00100000:0.0:1789760782.534969:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720786295389 time 720786034973 state 0x1 ref 1 00000100:00100000:0.0:1789760782.534998:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720786295389 time 720795289669 state 0x0 ref 1 00000100:00100000:0.0:1789760782.535011:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.535065:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72376320, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22848 00010000:00010000:0.0:1789760782.535073:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.535088:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.535093:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.535100:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.535115:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.538516:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984978 is committed 00010000:00010000:2.0:1789760782.540018:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789760782.542424:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72376320 -> 72380416 00002000:00010000:0.0:1789760782.542434:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141384 -> 141392 00010000:00010000:0.0:1789760782.542450:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.542463:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.542471:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.542477:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.542644:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.542655:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.542674:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.543194:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e23a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72376320->72380415] (req 72376320->72380415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.543299:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8286us (9150us total) trans 4294984978 rc 0/0 00000100:00100000:0.0:1789760782.543310:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17681 00000100:00100000:0.0:1789760782.543319:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720786295389 time 720795289669 state 0x2 ref 0 00000100:00100000:2.0:1789760782.547472:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.547558:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492352 00000100:00100000:1.0:1789760782.547567:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492352 00000100:00100000:1.0:1789760782.547958:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720786295389 time 720795289669 state 0x0 ref 1 00000100:00100000:1.0:1789760782.547974:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720795550085 time 720795289669 state 0x1 ref 1 00000100:00100000:1.0:1789760782.548009:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720795550085 time 720808301284 state 0x0 ref 1 00000100:00100000:1.0:1789760782.548022:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.548067:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72380416, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22850 00010000:00010000:1.0:1789760782.548076:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.548093:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.548097:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.548104:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.548120:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.551483:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984979 is committed 00002000:00010000:0.0:1789760782.551586:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72380416 -> 72384512 00002000:00010000:0.0:1789760782.551592:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141392 -> 141400 00010000:00010000:0.0:1789760782.551606:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551619:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551628:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551636:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.551641:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551650:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551670:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.551678:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72380416->72384511] (req 72380416->72384511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.552107:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4083us (4641us total) trans 4294984979 rc 0/0 00000100:00100000:0.0:1789760782.552119:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17682 00000100:00100000:0.0:1789760782.552128:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720795550085 time 720808301284 state 0x2 ref 0 00000100:00100000:2.0:1789760782.556975:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.557007:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492480 00000100:00100000:0.0:1789760782.557017:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492480 00000100:00100000:0.0:1789760782.557069:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720795550085 time 720808301284 state 0x0 ref 1 00000100:00100000:0.0:1789760782.557083:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720808561700 time 720808301284 state 0x1 ref 1 00000100:00100000:0.0:1789760782.557110:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720808561700 time 720817402436 state 0x0 ref 1 00000100:00100000:0.0:1789760782.557121:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.557160:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72384512, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22858 00010000:00010000:0.0:1789760782.557169:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.557184:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.557188:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.557194:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.557209:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.564997:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984980 is committed 00002000:00010000:2.0:1789760782.565189:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72384512 -> 72388608 00002000:00010000:2.0:1789760782.565195:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141400 -> 141408 00010000:00010000:2.0:1789760782.565207:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565219:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565227:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565234:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.565238:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565247:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565266:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.565273:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72384512->72388607] (req 72384512->72388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.565395:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8272us (8425us total) trans 4294984980 rc 0/0 00000100:00100000:2.0:1789760782.565403:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17683 00000100:00100000:2.0:1789760782.565410:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720808561700 time 720817402436 state 0x2 ref 0 00000100:00100000:2.0:1789760782.572297:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.572468:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492608 00000100:00100000:0.0:1789760782.572477:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492608 00000100:00100000:0.0:1789760782.572534:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720808561700 time 720817402436 state 0x0 ref 1 00000100:00100000:0.0:1789760782.572549:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720817662852 time 720817402436 state 0x1 ref 1 00000100:00100000:0.0:1789760782.572583:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720817662852 time 720832874534 state 0x0 ref 1 00000100:00100000:0.0:1789760782.572597:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.572641:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72388608, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22860 00010000:00010000:0.0:1789760782.572651:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.572666:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.572671:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.572678:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.572691:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.578998:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984981 is committed 00002000:00010000:3.0:1789760782.581817:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72388608 -> 72392704 00002000:00010000:3.0:1789760782.581825:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141408 -> 141416 00010000:00010000:3.0:1789760782.581840:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581851:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581860:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581867:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760782.581872:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581880:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581899:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.581913:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e24f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72388608->72392703] (req 72388608->72392703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.582018:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565492608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9419us (9725us total) trans 4294984981 rc 0/0 00000100:00100000:3.0:1789760782.582028:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17684 00000100:00100000:3.0:1789760782.582037:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720817662852 time 720832874534 state 0x2 ref 0 00000100:00100000:0.0:1789760782.590755:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.590897:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492736 00000100:00100000:1.0:1789760782.590907:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492736 00000100:00100000:1.0:1789760782.590963:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720817662852 time 720832874534 state 0x0 ref 1 00000100:00100000:1.0:1789760782.590979:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720833134950 time 720832874534 state 0x1 ref 1 00000100:00100000:1.0:1789760782.591012:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720833134950 time 720851303580 state 0x0 ref 1 00000100:00100000:1.0:1789760782.591024:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.591297:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72392704, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22868 00010000:00010000:1.0:1789760782.591307:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.591322:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.591326:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.591332:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.591346:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.598930:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984982 is committed 00002000:00010000:0.0:1789760782.599172:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72392704 -> 72396800 00002000:00010000:0.0:1789760782.599177:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141416 -> 141424 00010000:00010000:0.0:1789760782.599189:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599207:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599216:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599223:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.599227:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599236:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599255:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.599263:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e256 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72392704->72396799] (req 72392704->72396799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.599412:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565492736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8385us (8715us total) trans 4294984982 rc 0/0 00000100:00100000:0.0:1789760782.599423:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17685 00000100:00100000:0.0:1789760782.599432:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720833134950 time 720851303580 state 0x2 ref 0 00000100:00100000:2.0:1789760782.602798:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.602964:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492864 00000100:00100000:0.0:1789760782.602974:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492864 00000100:00100000:0.0:1789760782.603027:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720833134950 time 720851303580 state 0x0 ref 1 00000100:00100000:0.0:1789760782.603043:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720851563996 time 720851303580 state 0x1 ref 1 00000100:00100000:0.0:1789760782.603115:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720851563996 time 720863406374 state 0x0 ref 1 00000100:00100000:0.0:1789760782.603139:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565492864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.603188:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72396800, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22870 00010000:00010000:0.0:1789760782.603197:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.603211:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.603216:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.603222:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.603235:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.604824:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760782.604844:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580067072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760782.604904:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760782.604970:0:13530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067072 00000100:00100000:2.0:1789760782.604976:0:13530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067072 00000100:00100000:2.0:1789760782.605026:0:13530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760782.605034:0:13530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580067072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760782.605051:0:13530:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484946496 pending 28672 free 3851505664 avail 3618263040 00000100:00100000:2.0:1789760782.605103:0:13530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580067072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760782.605110:0:13530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1789760782.605138:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760782.605177:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580067072:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789760782.608639:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984983 is committed 00002000:00010000:1.0:1789760782.609343:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72396800 -> 72400896 00002000:00010000:1.0:1789760782.609350:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141424 -> 141432 00010000:00010000:1.0:1789760782.609364:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609377:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609386:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609394:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.609399:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609409:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609429:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.609437:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e25d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72396800->72400895] (req 72396800->72400895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.609564:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565492864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6433us (6770us total) trans 4294984983 rc 0/0 00000100:00100000:1.0:1789760782.609575:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17686 00000100:00100000:1.0:1789760782.609584:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720851563996 time 720863406374 state 0x2 ref 0 00000100:00100000:2.0:1789760782.615486:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760782.615758:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565492992 00000100:00100000:3.0:1789760782.615769:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565492992 00000100:00100000:3.0:1789760782.615892:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720851563996 time 720863406374 state 0x0 ref 1 00000100:00100000:3.0:1789760782.615909:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720863666790 time 720863406374 state 0x1 ref 1 00000100:00100000:3.0:1789760782.615977:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720863666790 time 720876268440 state 0x0 ref 1 00000100:00100000:3.0:1789760782.615991:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565492992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760782.616041:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72400896, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22878 00010000:00010000:3.0:1789760782.616050:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.616067:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:3.0:1789760782.616071:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760782.616077:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.616095:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.621242:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984984 is committed 00002000:00010000:2.0:1789760782.621367:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72400896 -> 72404992 00002000:00010000:2.0:1789760782.621372:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141432 -> 141440 00010000:00010000:2.0:1789760782.621386:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621397:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621406:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621413:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.621418:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621426:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621451:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.621460:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e264 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72400896->72404991] (req 72400896->72404991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.621592:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565492992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5600us (6110us total) trans 4294984984 rc 0/0 00000100:00100000:2.0:1789760782.621603:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17687 00000100:00100000:2.0:1789760782.621612:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720863666790 time 720876268440 state 0x2 ref 0 00000100:00100000:1.0:1789760782.629225:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.629310:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493120 00000100:00100000:0.0:1789760782.629319:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493120 00000100:00100000:0.0:1789760782.629376:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720863666790 time 720876268440 state 0x0 ref 1 00000100:00100000:0.0:1789760782.629392:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720876528856 time 720876268440 state 0x1 ref 1 00000100:00100000:0.0:1789760782.629423:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720876528856 time 720889715276 state 0x0 ref 1 00000100:00100000:0.0:1789760782.629440:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565493120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.629492:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72404992, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22880 00010000:00010000:0.0:1789760782.629503:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.629522:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.629526:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.629533:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.629548:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.635395:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984985 is committed 00002000:00010000:1.0:1789760782.635542:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72404992 -> 72409088 00002000:00010000:1.0:1789760782.635548:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141440 -> 141448 00010000:00010000:1.0:1789760782.635561:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635573:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635581:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635587:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.635592:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635600:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635617:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.635624:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e26b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72404992->72409087] (req 72404992->72409087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.635908:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565493120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6466us (6687us total) trans 4294984985 rc 0/0 00000100:00100000:1.0:1789760782.635918:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17688 00000100:00100000:1.0:1789760782.635926:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720876528856 time 720889715276 state 0x2 ref 0 00000100:00100000:1.0:1789760782.640245:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.640399:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493248 00000100:00100000:2.0:1789760782.640410:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493248 00000100:00100000:2.0:1789760782.640466:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720876528856 time 720889715276 state 0x0 ref 1 00000100:00100000:2.0:1789760782.640483:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720889975692 time 720889715276 state 0x1 ref 1 00000100:00100000:2.0:1789760782.640514:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720889975692 time 720900806573 state 0x0 ref 1 00000100:00100000:2.0:1789760782.640525:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565493248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.640574:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72409088, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22888 00010000:00010000:2.0:1789760782.640584:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.640601:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.640606:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.640612:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.640624:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.645383:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984986 is committed 00002000:00010000:2.0:1789760782.645761:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72409088 -> 72413184 00002000:00010000:2.0:1789760782.645767:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141448 -> 141456 00010000:00010000:2.0:1789760782.645781:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645793:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645872:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645880:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.645947:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645959:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645977:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.645990:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e272 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72409088->72413183] (req 72409088->72413183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.646148:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565493248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5619us (5909us total) trans 4294984986 rc 0/0 00000100:00100000:2.0:1789760782.646159:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17689 00000100:00100000:2.0:1789760782.646169:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720889975692 time 720900806573 state 0x2 ref 0 00000100:00100000:2.0:1789760782.651964:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.652068:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493376 00000100:00100000:0.0:1789760782.652078:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493376 00000100:00100000:0.0:1789760782.652197:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720889975692 time 720900806573 state 0x0 ref 1 00000100:00100000:0.0:1789760782.652215:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720901066989 time 720900806573 state 0x1 ref 1 00000100:00100000:0.0:1789760782.652287:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720901066989 time 720912577597 state 0x0 ref 1 00000100:00100000:0.0:1789760782.652302:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.652354:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72413184, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22890 00010000:00010000:0.0:1789760782.652365:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.652381:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.652384:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.652390:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.652403:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.659022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984987 is committed 00002000:00010000:2.0:1789760782.659245:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72413184 -> 72417280 00002000:00010000:2.0:1789760782.659250:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141456 -> 141464 00010000:00010000:2.0:1789760782.659262:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659273:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659281:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659287:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.659291:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659299:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659318:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.659325:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e279 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72413184->72417279] (req 72413184->72417279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.659464:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7161us (7504us total) trans 4294984987 rc 0/0 00000100:00100000:2.0:1789760782.659476:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17690 00000100:00100000:2.0:1789760782.659484:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720901066989 time 720912577597 state 0x2 ref 0 00000100:00100000:0.0:1789760782.665254:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.665347:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493504 00000100:00100000:1.0:1789760782.665357:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493504 00000100:00100000:1.0:1789760782.665411:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720901066989 time 720912577597 state 0x0 ref 1 00000100:00100000:1.0:1789760782.665425:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720912838013 time 720912577597 state 0x1 ref 1 00000100:00100000:1.0:1789760782.665457:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720912838013 time 720925748666 state 0x0 ref 1 00000100:00100000:1.0:1789760782.665468:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.665516:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72417280, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22898 00010000:00010000:1.0:1789760782.665525:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.665541:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.665546:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.665552:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.665567:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.670914:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984988 is committed 00002000:00010000:1.0:1789760782.671027:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72417280 -> 72421376 00002000:00010000:1.0:1789760782.671033:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141464 -> 141472 00010000:00010000:1.0:1789760782.671284:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671299:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671309:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671316:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.671321:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671330:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671350:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.671358:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e280 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72417280->72421375] (req 72417280->72421375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.671449:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5977us (6200us total) trans 4294984988 rc 0/0 00000100:00100000:1.0:1789760782.671460:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17691 00000100:00100000:1.0:1789760782.671469:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720912838013 time 720925748666 state 0x2 ref 0 00000100:00100000:1.0:1789760782.676690:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760782.677321:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493632 00000100:00100000:2.0:1789760782.677331:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493632 00000100:00100000:2.0:1789760782.677384:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720912838013 time 720925748666 state 0x0 ref 1 00000100:00100000:2.0:1789760782.677399:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720926009082 time 720925748666 state 0x1 ref 1 00000100:00100000:2.0:1789760782.677428:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720926009082 time 720937720330 state 0x0 ref 1 00000100:00100000:2.0:1789760782.677441:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565493632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.677487:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72421376, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228a0 00010000:00010000:2.0:1789760782.677497:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.677512:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1789760782.677517:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.677524:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.677540:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.683293:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984989 is committed 00002000:00010000:2.0:1789760782.683406:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72421376 -> 72425472 00002000:00010000:2.0:1789760782.683412:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141472 -> 141480 00010000:00010000:2.0:1789760782.683426:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683440:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683449:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683457:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.683462:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683471:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683494:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.683507:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72421376->72425471] (req 72421376->72425471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.683604:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565493632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6159us (6918us total) trans 4294984989 rc 0/0 00000100:00100000:2.0:1789760782.683615:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17692 00000100:00100000:2.0:1789760782.683624:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720926009082 time 720937720330 state 0x2 ref 0 00000100:00100000:2.0:1789760782.689136:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.689188:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493760 00000100:00100000:0.0:1789760782.689198:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493760 00000100:00100000:0.0:1789760782.689254:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720926009082 time 720937720330 state 0x0 ref 1 00000100:00100000:0.0:1789760782.689269:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720937980746 time 720937720330 state 0x1 ref 1 00000100:00100000:0.0:1789760782.689303:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720937980746 time 720949595911 state 0x0 ref 1 00000100:00100000:0.0:1789760782.689313:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.689356:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72425472, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228a8 00010000:00010000:0.0:1789760782.689364:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.689385:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1789760782.689390:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.689396:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.689410:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.694624:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984990 is committed 00002000:00010000:0.0:1789760782.694760:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72425472 -> 72429568 00002000:00010000:0.0:1789760782.694765:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141480 -> 141488 00010000:00010000:0.0:1789760782.694792:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694806:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694815:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694823:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.694827:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694836:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694866:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694873:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e28e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72425472->72429567] (req 72425472->72429567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.696147:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565493760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6825us (7016us total) trans 4294984990 rc 0/0 00000100:00100000:1.0:1789760782.696173:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17693 00000100:00100000:1.0:1789760782.696183:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720937980746 time 720949595911 state 0x2 ref 0 00000100:00100000:0.0:1789760782.699018:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.699924:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565493888 00000100:00100000:1.0:1789760782.699934:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565493888 00000100:00100000:1.0:1789760782.699987:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720937980746 time 720949595911 state 0x0 ref 1 00000100:00100000:1.0:1789760782.700000:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720949856327 time 720949595911 state 0x1 ref 1 00000100:00100000:1.0:1789760782.700027:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720949856327 time 720960318787 state 0x0 ref 1 00000100:00100000:1.0:1789760782.700038:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565493888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.700082:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72429568, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228b0 00010000:00010000:1.0:1789760782.700091:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.700107:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.700111:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.700117:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.700132:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.705386:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984991 is committed 00002000:00010000:1.0:1789760782.705509:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72429568 -> 72433664 00002000:00010000:1.0:1789760782.705515:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141488 -> 141496 00010000:00010000:1.0:1789760782.705528:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705540:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705549:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705556:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.705561:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705570:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705599:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.705608:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e295 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72429568->72433663] (req 72429568->72433663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.705829:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565493888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5787us (6814us total) trans 4294984991 rc 0/0 00000100:00100000:1.0:1789760782.705841:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17694 00000100:00100000:1.0:1789760782.705851:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720949856327 time 720960318787 state 0x2 ref 0 00000100:00100000:2.0:1789760782.709255:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.709349:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494016 00000100:00100000:1.0:1789760782.709358:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494016 00000100:00100000:1.0:1789760782.709411:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720949856327 time 720960318787 state 0x0 ref 1 00000100:00100000:1.0:1789760782.709426:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720960579203 time 720960318787 state 0x1 ref 1 00000100:00100000:1.0:1789760782.709495:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720960579203 time 720969786617 state 0x0 ref 1 00000100:00100000:1.0:1789760782.709508:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565494016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.709555:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72433664, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228b8 00010000:00010000:1.0:1789760782.709564:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.709580:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.709584:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.709590:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.709603:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.719792:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984992 is committed 00002000:00010000:1.0:1789760782.722990:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72433664 -> 72437760 00002000:00010000:1.0:1789760782.722999:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141496 -> 141504 00010000:00010000:1.0:1789760782.723013:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723027:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723036:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723044:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.723049:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723058:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723090:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.723098:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e29c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72433664->72437759] (req 72433664->72437759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.723366:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565494016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13854us (14113us total) trans 4294984992 rc 0/0 00000100:00100000:1.0:1789760782.724043:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17695 00000100:00100000:1.0:1789760782.724054:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720960579203 time 720969786617 state 0x2 ref 0 00000100:00100000:2.0:1789760782.729199:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.729910:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494144 00000100:00100000:1.0:1789760782.729920:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494144 00000100:00100000:1.0:1789760782.729970:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720960579203 time 720969786617 state 0x0 ref 1 00000100:00100000:1.0:1789760782.729984:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720970047033 time 720969786617 state 0x1 ref 1 00000100:00100000:1.0:1789760782.730016:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720970047033 time 720990308088 state 0x0 ref 1 00000100:00100000:1.0:1789760782.730027:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.730072:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72437760, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228c0 00010000:00010000:1.0:1789760782.730081:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.730096:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1789760782.730100:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.730106:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.730130:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.737192:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984993 is committed 00002000:00010000:1.0:1789760782.737352:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72437760 -> 72441856 00002000:00010000:1.0:1789760782.737357:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141504 -> 141512 00010000:00010000:1.0:1789760782.737370:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737389:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737398:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737405:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.737410:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737419:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737464:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.737472:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72437760->72441855] (req 72437760->72441855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.737565:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7535us (8370us total) trans 4294984993 rc 0/0 00000100:00100000:1.0:1789760782.737575:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17696 00000100:00100000:1.0:1789760782.737585:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720970047033 time 720990308088 state 0x2 ref 0 00000100:00100000:0.0:1789760782.740528:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.740684:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494272 00000100:00100000:1.0:1789760782.740723:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494272 00000100:00100000:1.0:1789760782.740785:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720970047033 time 720990308088 state 0x0 ref 1 00000100:00100000:1.0:1789760782.740800:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720990568504 time 720990308088 state 0x1 ref 1 00000100:00100000:1.0:1789760782.740822:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720990568504 time 721001114887 state 0x0 ref 1 00000100:00100000:1.0:1789760782.740834:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.740879:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72441856, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228c8 00010000:00010000:1.0:1789760782.740889:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.740905:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.740909:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.740915:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.740937:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.747106:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984994 is committed 00002000:00010000:1.0:1789760782.747398:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72441856 -> 72445952 00002000:00010000:1.0:1789760782.747403:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141512 -> 141520 00010000:00010000:1.0:1789760782.747416:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747428:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747443:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747451:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.747516:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747526:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747544:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.747553:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72441856->72445951] (req 72441856->72445951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.747739:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6857us (7170us total) trans 4294984994 rc 0/0 00000100:00100000:1.0:1789760782.747749:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17697 00000100:00100000:1.0:1789760782.747760:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720990568504 time 721001114887 state 0x2 ref 0 00000100:00100000:2.0:1789760782.755998:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.756080:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494400 00000100:00100000:1.0:1789760782.756090:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494400 00000100:00100000:1.0:1789760782.756142:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 720990568504 time 721001114887 state 0x0 ref 1 00000100:00100000:1.0:1789760782.756157:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721001375303 time 721001114887 state 0x1 ref 1 00000100:00100000:1.0:1789760782.756187:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721001375303 time 721016479264 state 0x0 ref 1 00000100:00100000:1.0:1789760782.756199:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.756246:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72445952, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228d0 00010000:00010000:1.0:1789760782.756255:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.756270:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.756275:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.756281:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.756295:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.761200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984995 is committed 00002000:00010000:1.0:1789760782.762225:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72445952 -> 72450048 00002000:00010000:1.0:1789760782.762233:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141520 -> 141528 00010000:00010000:1.0:1789760782.762249:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762262:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762272:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762284:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.762293:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762303:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762321:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.762329:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72445952->72450047] (req 72445952->72450047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.763881:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7673us (7884us total) trans 4294984995 rc 0/0 00000100:00100000:1.0:1789760782.763894:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17698 00000100:00100000:1.0:1789760782.763904:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721001375303 time 721016479264 state 0x2 ref 0 00000100:00100000:2.0:1789760782.770417:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.770692:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494528 00000100:00100000:1.0:1789760782.770746:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494528 00000100:00100000:1.0:1789760782.770807:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721001375303 time 721016479264 state 0x0 ref 1 00000100:00100000:1.0:1789760782.770822:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721016739680 time 721016479264 state 0x1 ref 1 00000100:00100000:1.0:1789760782.770851:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721016739680 time 721031143587 state 0x0 ref 1 00000100:00100000:1.0:1789760782.770868:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760782.770989:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72450048, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228d8 00010000:00010000:2.0:1789760782.770999:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.771015:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760782.771019:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.771026:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.771050:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.777658:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984996 is committed 00002000:00010000:0.0:1789760782.778006:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72450048 -> 72454144 00002000:00010000:0.0:1789760782.778012:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141528 -> 141536 00010000:00010000:0.0:1789760782.778025:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778038:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778056:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778070:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.778075:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778084:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778104:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.778111:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e2b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72450048->72454143] (req 72450048->72454143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.778505:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7634us (8090us total) trans 4294984996 rc 0/0 00000100:00100000:0.0:1789760782.778516:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17699 00000100:00100000:0.0:1789760782.778527:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721016739680 time 721031143587 state 0x2 ref 0 00000100:00100000:0.0:1789760782.790372:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.790749:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494656 00000100:00100000:1.0:1789760782.790758:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494656 00000100:00100000:1.0:1789760782.790823:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721016739680 time 721031143587 state 0x0 ref 1 00000100:00100000:1.0:1789760782.790838:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721031404003 time 721031143587 state 0x1 ref 1 00000100:00100000:1.0:1789760782.790869:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721031404003 time 721051161413 state 0x0 ref 1 00000100:00100000:1.0:1789760782.790881:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.790929:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72454144, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228e0 00010000:00010000:1.0:1789760782.790938:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.790954:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.790959:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.790965:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.790988:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.802847:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984997 is committed 00002000:00010000:1.0:1789760782.803142:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72454144 -> 72458240 00002000:00010000:1.0:1789760782.803148:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141536 -> 141544 00010000:00010000:1.0:1789760782.803161:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803182:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803192:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803207:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.803212:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803222:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803242:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.803250:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72454144->72458239] (req 72454144->72458239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.803343:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565494656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12458us (12974us total) trans 4294984997 rc 0/0 00000100:00100000:1.0:1789760782.803354:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17700 00000100:00100000:1.0:1789760782.803363:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721031404003 time 721051161413 state 0x2 ref 0 00000100:00100000:2.0:1789760782.807951:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.808048:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494784 00000100:00100000:1.0:1789760782.808058:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494784 00000100:00100000:1.0:1789760782.808111:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721031404003 time 721051161413 state 0x0 ref 1 00000100:00100000:1.0:1789760782.808126:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721051421829 time 721051161413 state 0x1 ref 1 00000100:00100000:1.0:1789760782.808155:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721051421829 time 721068447548 state 0x0 ref 1 00000100:00100000:1.0:1789760782.808177:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.808229:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72458240, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228e8 00010000:00010000:1.0:1789760782.808238:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.808254:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.808258:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.808265:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.808278:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.819538:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984998 is committed 00002000:00010000:1.0:1789760782.819688:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72458240 -> 72462336 00002000:00010000:1.0:1789760782.819856:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141544 -> 141552 00010000:00010000:1.0:1789760782.819870:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819883:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819898:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819906:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.819911:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819919:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819950:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.819959:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72458240->72462335] (req 72458240->72462335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.820090:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565494784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11920us (12397us total) trans 4294984998 rc 0/0 00000100:00100000:1.0:1789760782.820100:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17701 00000100:00100000:1.0:1789760782.820109:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721051421829 time 721068447548 state 0x2 ref 0 00000100:00100000:2.0:1789760782.828273:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.828406:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565494912 00000100:00100000:0.0:1789760782.828415:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565494912 00000100:00100000:0.0:1789760782.828464:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721051421829 time 721068447548 state 0x0 ref 1 00000100:00100000:0.0:1789760782.828478:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721068707964 time 721068447548 state 0x1 ref 1 00000100:00100000:0.0:1789760782.828507:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721068707964 time 721088799522 state 0x0 ref 1 00000100:00100000:0.0:1789760782.828518:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565494912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.828561:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72462336, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228f0 00010000:00010000:0.0:1789760782.828570:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.828821:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760782.828827:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.829073:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.829090:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.837431:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294984999 is committed 00002000:00010000:0.0:1789760782.837629:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72462336 -> 72466432 00002000:00010000:0.0:1789760782.837634:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141552 -> 141560 00010000:00010000:0.0:1789760782.837648:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837661:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837670:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837678:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.837683:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837738:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837762:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.837770:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e2cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72462336->72466431] (req 72462336->72466431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.838315:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565494912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9793us (10045us total) trans 4294984999 rc 0/0 00000100:00100000:0.0:1789760782.838327:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17702 00000100:00100000:0.0:1789760782.838338:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721068707964 time 721088799522 state 0x2 ref 0 00000100:00100000:0.0:1789760782.845620:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.845845:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495040 00000100:00100000:1.0:1789760782.845871:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495040 00000100:00100000:1.0:1789760782.845926:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721068707964 time 721088799522 state 0x0 ref 1 00000100:00100000:1.0:1789760782.845941:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721089059938 time 721088799522 state 0x1 ref 1 00000100:00100000:1.0:1789760782.845968:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721089059938 time 721106260551 state 0x0 ref 1 00000100:00100000:1.0:1789760782.845980:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.846029:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72466432, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x228f8 00010000:00010000:1.0:1789760782.846038:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.846054:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.846059:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.846065:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.846079:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.853539:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985000 is committed 00002000:00010000:1.0:1789760782.854109:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72466432 -> 72470528 00002000:00010000:1.0:1789760782.854115:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141560 -> 141568 00010000:00010000:1.0:1789760782.854131:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854144:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854152:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854164:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.854169:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854178:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854197:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.854204:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72466432->72470527] (req 72466432->72470527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.854340:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8356us (8726us total) trans 4294985000 rc 0/0 00000100:00100000:1.0:1789760782.854352:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17703 00000100:00100000:1.0:1789760782.854362:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721089059938 time 721106260551 state 0x2 ref 0 00000100:00100000:3.0:1789760782.859608:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.859742:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495168 00000100:00100000:1.0:1789760782.859752:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495168 00000100:00100000:1.0:1789760782.859806:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721089059938 time 721106260551 state 0x0 ref 1 00000100:00100000:1.0:1789760782.859821:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721106520967 time 721106260551 state 0x1 ref 1 00000100:00100000:1.0:1789760782.859852:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721106520967 time 721120143970 state 0x0 ref 1 00000100:00100000:1.0:1789760782.859868:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.859916:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72470528, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22900 00010000:00010000:1.0:1789760782.859925:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.859942:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.859946:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.859952:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.859966:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760782.866612:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985001 is committed 00002000:00010000:1.0:1789760782.866766:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72470528 -> 72474624 00002000:00010000:1.0:1789760782.866772:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141568 -> 141576 00010000:00010000:1.0:1789760782.866786:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866800:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866810:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866817:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.866824:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866832:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866856:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.866864:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72470528->72474623] (req 72470528->72474623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.866968:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7097us (7363us total) trans 4294985001 rc 0/0 00000100:00100000:1.0:1789760782.866981:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17704 00000100:00100000:1.0:1789760782.866991:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721106520967 time 721120143970 state 0x2 ref 0 00000100:00100000:2.0:1789760782.872848:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.872942:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495296 00000100:00100000:0.0:1789760782.872951:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495296 00000100:00100000:0.0:1789760782.873008:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721106520967 time 721120143970 state 0x0 ref 1 00000100:00100000:0.0:1789760782.873023:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721120404386 time 721120143970 state 0x1 ref 1 00000100:00100000:0.0:1789760782.873059:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721120404386 time 721133350838 state 0x0 ref 1 00000100:00100000:0.0:1789760782.873073:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.873120:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72474624, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22908 00010000:00010000:0.0:1789760782.873129:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.873150:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760782.873155:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.873161:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.873175:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.881543:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985002 is committed 00002000:00010000:0.0:1789760782.881861:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72474624 -> 72478720 00002000:00010000:0.0:1789760782.881867:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141576 -> 141584 00010000:00010000:0.0:1789760782.881880:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881892:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881901:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881908:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.881913:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881922:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881947:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.881954:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e2e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72474624->72478719] (req 72474624->72478719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.882133:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9058us (9288us total) trans 4294985002 rc 0/0 00000100:00100000:0.0:1789760782.882144:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17705 00000100:00100000:0.0:1789760782.882153:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721120404386 time 721133350838 state 0x2 ref 0 00000100:00100000:0.0:1789760782.890039:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.890121:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495424 00000100:00100000:1.0:1789760782.890130:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495424 00000100:00100000:1.0:1789760782.890187:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721120404386 time 721133350838 state 0x0 ref 1 00000100:00100000:1.0:1789760782.890202:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721133611254 time 721133350838 state 0x1 ref 1 00000100:00100000:1.0:1789760782.890245:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721133611254 time 721150536182 state 0x0 ref 1 00000100:00100000:1.0:1789760782.890258:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.890307:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72478720, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22910 00010000:00010000:1.0:1789760782.890316:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.890333:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.890338:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.890345:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.890358:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.896180:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985003 is committed 00002000:00010000:1.0:1789760782.896330:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72478720 -> 72482816 00002000:00010000:1.0:1789760782.896335:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141584 -> 141592 00010000:00010000:1.0:1789760782.896348:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896360:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896369:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896376:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.896380:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896390:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896410:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.896418:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e2e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72478720->72482815] (req 72478720->72482815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.896562:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6302us (6528us total) trans 4294985003 rc 0/0 00000100:00100000:1.0:1789760782.896582:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17706 00000100:00100000:1.0:1789760782.896592:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721133611254 time 721150536182 state 0x2 ref 0 00000100:00100000:3.0:1789760782.900350:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.900829:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495552 00000100:00100000:1.0:1789760782.900838:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495552 00000100:00100000:1.0:1789760782.902940:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721133611254 time 721150536182 state 0x0 ref 1 00000100:00100000:1.0:1789760782.902960:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721150796598 time 721150536182 state 0x1 ref 1 00000100:00100000:1.0:1789760782.902999:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721150796598 time 721163291113 state 0x0 ref 1 00000100:00100000:1.0:1789760782.903171:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.903221:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72482816, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22918 00010000:00010000:1.0:1789760782.903230:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.903245:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.903250:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.903256:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.903269:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.910013:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985004 is committed 00002000:00010000:1.0:1789760782.910230:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72482816 -> 72486912 00002000:00010000:1.0:1789760782.910235:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141592 -> 141600 00010000:00010000:1.0:1789760782.910249:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910262:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910276:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910284:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.910289:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910297:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910317:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.910329:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72482816->72486911] (req 72482816->72486911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.910422:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7407us (10075us total) trans 4294985004 rc 0/0 00000100:00100000:1.0:1789760782.910432:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17707 00000100:00100000:1.0:1789760782.910441:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721150796598 time 721163291113 state 0x2 ref 0 00000100:00100000:2.0:1789760782.915593:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.915685:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495680 00000100:00100000:0.0:1789760782.915739:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495680 00000100:00100000:0.0:1789760782.915795:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721150796598 time 721163291113 state 0x0 ref 1 00000100:00100000:0.0:1789760782.915811:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721163551529 time 721163291113 state 0x1 ref 1 00000100:00100000:0.0:1789760782.915840:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721163551529 time 721176131851 state 0x0 ref 1 00000100:00100000:0.0:1789760782.915853:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565495680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.915899:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72486912, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22920 00010000:00010000:0.0:1789760782.915908:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.915930:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760782.915934:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.915941:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.915955:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.921479:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985005 is committed 00002000:00010000:0.0:1789760782.921589:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72486912 -> 72491008 00002000:00010000:0.0:1789760782.921594:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141600 -> 141608 00010000:00010000:0.0:1789760782.921607:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921619:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921628:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921645:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.921651:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921660:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921685:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.921701:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e2f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72486912->72491007] (req 72486912->72491007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.921822:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565495680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5966us (6234us total) trans 4294985005 rc 0/0 00000100:00100000:0.0:1789760782.921833:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17708 00000100:00100000:0.0:1789760782.921842:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721163551529 time 721176131851 state 0x2 ref 0 00000100:00100000:0.0:1789760782.926088:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.926176:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495808 00000100:00100000:1.0:1789760782.926186:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495808 00000100:00100000:1.0:1789760782.926245:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721163551529 time 721176131851 state 0x0 ref 1 00000100:00100000:1.0:1789760782.926262:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721176392267 time 721176131851 state 0x1 ref 1 00000100:00100000:1.0:1789760782.926297:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721176392267 time 721186588904 state 0x0 ref 1 00000100:00100000:1.0:1789760782.926310:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.926364:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72491008, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22928 00010000:00010000:1.0:1789760782.926373:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.926390:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.926394:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.926400:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.926420:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.932457:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985006 is committed 00002000:00010000:1.0:1789760782.932667:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72491008 -> 72495104 00002000:00010000:1.0:1789760782.932673:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141608 -> 141616 00010000:00010000:1.0:1789760782.932688:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.932953:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.932962:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.932970:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.932975:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.932984:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.933006:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.933120:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e2fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72491008->72495103] (req 72491008->72495103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.933271:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565495808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6957us (7188us total) trans 4294985006 rc 0/0 00000100:00100000:1.0:1789760782.933282:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17709 00000100:00100000:1.0:1789760782.933292:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721176392267 time 721186588904 state 0x2 ref 0 00000100:00100000:3.0:1789760782.936845:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.936971:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565495936 00000100:00100000:1.0:1789760782.936982:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565495936 00000100:00100000:1.0:1789760782.937052:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721176392267 time 721186588904 state 0x0 ref 1 00000100:00100000:1.0:1789760782.937067:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721186849320 time 721186588904 state 0x1 ref 1 00000100:00100000:1.0:1789760782.937099:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721186849320 time 721197390397 state 0x0 ref 1 00000100:00100000:1.0:1789760782.937112:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.937158:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72495104, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0x22930 00010000:00010000:1.0:1789760782.937169:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.937185:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.937190:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.937196:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.937210:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.942257:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985007 is committed 00002000:00010000:1.0:1789760782.942370:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72495104 -> 72499200 00002000:00010000:1.0:1789760782.942375:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760782 -> 1789760783 00002000:00010000:1.0:1789760782.942377:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760782 -> 1789760783 00002000:00010000:1.0:1789760782.942380:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141616 -> 141624 00010000:00010000:1.0:1789760782.942394:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942406:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942415:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942423:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.942428:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942437:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942456:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.942464:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72495104->72499199] (req 72495104->72499199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.942609:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565495936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5495us (5770us total) trans 4294985007 rc 0/0 00000100:00100000:1.0:1789760782.942620:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17710 00000100:00100000:1.0:1789760782.942629:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721186849320 time 721197390397 state 0x2 ref 0 00000100:00100000:2.0:1789760782.946902:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.947024:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496064 00000100:00100000:0.0:1789760782.947034:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496064 00000100:00100000:0.0:1789760782.947159:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721186849320 time 721197390397 state 0x0 ref 1 00000100:00100000:0.0:1789760782.947179:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721197650813 time 721197390397 state 0x1 ref 1 00000100:00100000:0.0:1789760782.947280:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721197650813 time 721207569541 state 0x0 ref 1 00000100:00100000:0.0:1789760782.947298:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.947347:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72499200, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22938 00010000:00010000:0.0:1789760782.947357:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.947378:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760782.947383:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.947390:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.947403:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.952198:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985008 is committed 00002000:00010000:0.0:1789760782.952344:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72499200 -> 72503296 00002000:00010000:0.0:1789760782.952348:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141624 -> 141632 00010000:00010000:0.0:1789760782.952359:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952369:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952375:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952379:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.952383:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952389:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952407:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.952413:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e30c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72499200->72503295] (req 72499200->72503295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.952490:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5193us (5593us total) trans 4294985008 rc 0/0 00000100:00100000:0.0:1789760782.952500:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17711 00000100:00100000:0.0:1789760782.952510:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721197650813 time 721207569541 state 0x2 ref 0 00000100:00100000:0.0:1789760782.958563:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.958892:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496192 00000100:00100000:1.0:1789760782.958903:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496192 00000100:00100000:1.0:1789760782.958965:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721197650813 time 721207569541 state 0x0 ref 1 00000100:00100000:1.0:1789760782.958983:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721207829957 time 721207569541 state 0x1 ref 1 00000100:00100000:1.0:1789760782.959069:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721207829957 time 721219359991 state 0x0 ref 1 00000100:00100000:1.0:1789760782.959083:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.959137:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72503296, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22940 00010000:00010000:1.0:1789760782.959147:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.959164:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.959169:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.959175:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.959192:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760782.966843:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985009 is committed 00002000:00010000:1.0:1789760782.967150:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72503296 -> 72507392 00002000:00010000:1.0:1789760782.967155:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141632 -> 141640 00010000:00010000:1.0:1789760782.967167:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967180:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967188:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967194:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760782.967199:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967207:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967236:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.967245:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e313 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72503296->72507391] (req 72503296->72507391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.967338:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8253us (8781us total) trans 4294985009 rc 0/0 00000100:00100000:1.0:1789760782.967350:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17712 00000100:00100000:1.0:1789760782.967358:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721207829957 time 721219359991 state 0x2 ref 0 00000100:00100000:3.0:1789760782.970440:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760782.970684:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496320 00000100:00100000:1.0:1789760782.970702:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496320 00000100:00100000:1.0:1789760782.970792:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721207829957 time 721219359991 state 0x0 ref 1 00000100:00100000:1.0:1789760782.970806:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721219620407 time 721219359991 state 0x1 ref 1 00000100:00100000:1.0:1789760782.971829:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721219620407 time 721232113691 state 0x0 ref 1 00000100:00100000:1.0:1789760782.971851:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565496320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760782.971900:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72507392, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22948 00010000:00010000:1.0:1789760782.971909:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.971926:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760782.971930:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.971937:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.971951:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760782.981809:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985010 is committed 00002000:00010000:2.0:1789760782.982293:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72507392 -> 72511488 00002000:00010000:2.0:1789760782.982299:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141640 -> 141648 00010000:00010000:2.0:1789760782.982313:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982326:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982334:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982341:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760782.982346:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982355:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982379:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.982387:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e31a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72507392->72511487] (req 72507392->72511487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.983258:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565496320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11406us (12818us total) trans 4294985010 rc 0/0 00000100:00100000:2.0:1789760782.983272:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17713 00000100:00100000:2.0:1789760782.983282:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721219620407 time 721232113691 state 0x2 ref 0 00000100:00100000:2.0:1789760782.988566:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760782.988798:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496448 00000100:00100000:0.0:1789760782.988808:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496448 00000100:00100000:0.0:1789760782.988863:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721219620407 time 721232113691 state 0x0 ref 1 00000100:00100000:0.0:1789760782.988878:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721232374107 time 721232113691 state 0x1 ref 1 00000100:00100000:0.0:1789760782.988946:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721232374107 time 721249237388 state 0x0 ref 1 00000100:00100000:0.0:1789760782.988960:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565496448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760782.989021:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72511488, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22950 00010000:00010000:0.0:1789760782.989031:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.989054:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760782.989058:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.989064:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.989078:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760782.994822:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985011 is committed 00002000:00010000:0.0:1789760782.996683:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72511488 -> 72515584 00002000:00010000:0.0:1789760782.996715:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141648 -> 141656 00010000:00010000:0.0:1789760782.996742:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996756:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996766:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996924:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760782.996930:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996940:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996965:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.996973:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e321 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72511488->72515583] (req 72511488->72515583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.997065:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565496448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8104us (8505us total) trans 4294985011 rc 0/0 00000100:00100000:0.0:1789760782.997076:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17714 00000100:00100000:0.0:1789760782.997090:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721232374107 time 721249237388 state 0x2 ref 0 00000100:00100000:1.0:1789760783.001286:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.002480:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496576 00000100:00100000:0.0:1789760783.002496:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496576 00000100:00100000:0.0:1789760783.002569:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721232374107 time 721249237388 state 0x0 ref 1 00000100:00100000:0.0:1789760783.002587:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721249497804 time 721249237388 state 0x1 ref 1 00000100:00100000:0.0:1789760783.002678:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721249497804 time 721262968219 state 0x0 ref 1 00000100:00100000:0.0:1789760783.002702:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.002779:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72515584, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22958 00010000:00010000:0.0:1789760783.002788:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.003000:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.003006:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.003013:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.003028:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.009745:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985012 is committed 00002000:00010000:0.0:1789760783.009913:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72515584 -> 72519680 00002000:00010000:0.0:1789760783.009918:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141656 -> 141664 00010000:00010000:0.0:1789760783.009931:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.009943:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.009952:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.010026:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.010031:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.010099:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.010120:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.010134:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72515584->72519679] (req 72515584->72519679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.010227:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565496576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7534us (8945us total) trans 4294985012 rc 0/0 00000100:00100000:0.0:1789760783.010238:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17715 00000100:00100000:0.0:1789760783.010248:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721249497804 time 721262968219 state 0x2 ref 0 00000100:00100000:3.0:1789760783.017646:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.017733:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496704 00000100:00100000:2.0:1789760783.017743:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496704 00000100:00100000:2.0:1789760783.017797:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721249497804 time 721262968219 state 0x0 ref 1 00000100:00100000:2.0:1789760783.017812:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721263228635 time 721262968219 state 0x1 ref 1 00000100:00100000:3.0:1789760783.017959:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721263228635 time 721278248482 state 0x0 ref 1 00000100:00100000:3.0:1789760783.017977:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565496704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760783.018025:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72519680, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22960 00010000:00010000:3.0:1789760783.018034:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.018051:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1789760783.018056:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.018062:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.018077:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.025539:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985013 is committed 00002000:00010000:1.0:1789760783.025800:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72519680 -> 72523776 00002000:00010000:1.0:1789760783.025805:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141664 -> 141672 00010000:00010000:1.0:1789760783.025819:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025832:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025842:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025849:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.025855:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025865:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025885:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.025893:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e32f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72519680->72523775] (req 72519680->72523775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.025980:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565496704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8004us (8352us total) trans 4294985013 rc 0/0 00000100:00100000:1.0:1789760783.025992:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17716 00000100:00100000:1.0:1789760783.026003:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721263228635 time 721278248482 state 0x2 ref 0 00000100:00100000:2.0:1789760783.030863:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.030907:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496832 00000100:00100000:0.0:1789760783.030917:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496832 00000100:00100000:0.0:1789760783.030975:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721263228635 time 721278248482 state 0x0 ref 1 00000100:00100000:0.0:1789760783.030991:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721278508898 time 721278248482 state 0x1 ref 1 00000100:00100000:0.0:1789760783.031066:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721278508898 time 721291357008 state 0x0 ref 1 00000100:00100000:0.0:1789760783.031079:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565496832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.031129:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72523776, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22968 00010000:00010000:0.0:1789760783.031137:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.031152:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.031156:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.031163:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.031181:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.036624:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985014 is committed 00002000:00010000:0.0:1789760783.036799:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72523776 -> 72527872 00002000:00010000:0.0:1789760783.036804:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141672 -> 141680 00010000:00010000:0.0:1789760783.036817:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036830:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036840:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036847:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.036852:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036862:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036881:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.036888:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e336 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72523776->72527871] (req 72523776->72527871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.036983:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565496832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5901us (6124us total) trans 4294985014 rc 0/0 00000100:00100000:0.0:1789760783.036993:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17717 00000100:00100000:0.0:1789760783.037003:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721278508898 time 721291357008 state 0x2 ref 0 00000100:00100000:0.0:1789760783.040788:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.040863:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565496960 00000100:00100000:1.0:1789760783.040872:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565496960 00000100:00100000:1.0:1789760783.040924:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721278508898 time 721291357008 state 0x0 ref 1 00000100:00100000:1.0:1789760783.040939:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721291617424 time 721291357008 state 0x1 ref 1 00000100:00100000:1.0:1789760783.040967:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721291617424 time 721301259497 state 0x0 ref 1 00000100:00100000:1.0:1789760783.040979:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565496960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.041032:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72527872, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22970 00010000:00010000:1.0:1789760783.041052:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.041207:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.041214:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.041221:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.041234:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.046250:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985015 is committed 00002000:00010000:1.0:1789760783.046366:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72527872 -> 72531968 00002000:00010000:1.0:1789760783.046372:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141680 -> 141688 00010000:00010000:1.0:1789760783.046384:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046396:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046405:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046412:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.046416:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046426:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046444:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.046452:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674e33d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72527872->72531967] (req 72527872->72531967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.046594:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565496960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5611us (5809us total) trans 4294985015 rc 0/0 00000100:00100000:1.0:1789760783.046604:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17718 00000100:00100000:1.0:1789760783.046614:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721291617424 time 721301259497 state 0x2 ref 0 00000100:00100000:1.0:1789760783.052475:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760783.052583:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497088 00000100:00100000:3.0:1789760783.052593:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497088 00000100:00100000:3.0:1789760783.052728:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721291617424 time 721301259497 state 0x0 ref 1 00000100:00100000:3.0:1789760783.052743:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721301519913 time 721301259497 state 0x1 ref 1 00000100:00100000:2.0:1789760783.052865:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721301519913 time 721313154443 state 0x0 ref 1 00000100:00100000:2.0:1789760783.052880:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.052930:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72531968, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22978 00010000:00010000:2.0:1789760783.052940:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.052956:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.052961:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.052968:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.052982:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.059547:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985016 is committed 00002000:00010000:3.0:1789760783.060263:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72531968 -> 72536064 00002000:00010000:3.0:1789760783.060269:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141688 -> 141696 00010000:00010000:3.0:1789760783.060281:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060293:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060303:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060310:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.060315:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060326:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060345:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.060354:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e344 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72531968->72536063] (req 72531968->72536063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.060495:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7614us (8024us total) trans 4294985016 rc 0/0 00000100:00100000:3.0:1789760783.060506:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17719 00000100:00100000:3.0:1789760783.060515:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721301519913 time 721313154443 state 0x2 ref 0 00000100:00100000:2.0:1789760783.067522:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.067633:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497216 00000100:00100000:0.0:1789760783.067642:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497216 00000100:00100000:0.0:1789760783.067725:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721301519913 time 721313154443 state 0x0 ref 1 00000100:00100000:0.0:1789760783.067742:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721313414859 time 721313154443 state 0x1 ref 1 00000100:00100000:0.0:1789760783.067808:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721313414859 time 721328099169 state 0x0 ref 1 00000100:00100000:0.0:1789760783.067821:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.067879:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72536064, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22980 00010000:00010000:0.0:1789760783.067889:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.067905:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.067909:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.067916:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.067930:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.073109:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985017 is committed 00002000:00010000:0.0:1789760783.073290:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72536064 -> 72540160 00002000:00010000:0.0:1789760783.073295:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141696 -> 141704 00010000:00010000:0.0:1789760783.073309:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073322:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073330:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073337:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.073342:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073350:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073369:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.073377:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e34b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72536064->72540159] (req 72536064->72540159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.073474:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5650us (5956us total) trans 4294985017 rc 0/0 00000100:00100000:0.0:1789760783.073486:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17720 00000100:00100000:0.0:1789760783.073495:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721313414859 time 721328099169 state 0x2 ref 0 00000100:00100000:0.0:1789760783.077428:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.077574:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497344 00000100:00100000:1.0:1789760783.077584:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497344 00000100:00100000:1.0:1789760783.077640:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721313414859 time 721328099169 state 0x0 ref 1 00000100:00100000:1.0:1789760783.077655:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721328359585 time 721328099169 state 0x1 ref 1 00000100:00100000:1.0:1789760783.077686:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721328359585 time 721337978003 state 0x0 ref 1 00000100:00100000:1.0:1789760783.077740:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.077800:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72540160, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22988 00010000:00010000:1.0:1789760783.077809:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.077825:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.077830:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.077837:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.077861:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.084480:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985018 is committed 00002000:00010000:1.0:1789760783.084591:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72540160 -> 72544256 00002000:00010000:1.0:1789760783.084596:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141704 -> 141712 00010000:00010000:1.0:1789760783.084610:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084622:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084631:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084638:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.084643:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084652:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084683:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.084699:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674e352 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72540160->72544255] (req 72540160->72544255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.084823:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7113us (7401us total) trans 4294985018 rc 0/0 00000100:00100000:1.0:1789760783.084833:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17721 00000100:00100000:1.0:1789760783.084842:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721328359585 time 721337978003 state 0x2 ref 0 00000100:00100000:1.0:1789760783.091674:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760783.091836:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497472 00000100:00100000:3.0:1789760783.091846:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497472 00000100:00100000:3.0:1789760783.091899:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721328359585 time 721337978003 state 0x0 ref 1 00000100:00100000:3.0:1789760783.091914:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721338238419 time 721337978003 state 0x1 ref 1 00000100:00100000:3.0:1789760783.091947:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721338238419 time 721352238998 state 0x0 ref 1 00000100:00100000:3.0:1789760783.091960:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760783.092007:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72544256, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22990 00010000:00010000:3.0:1789760783.092017:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.092034:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1789760783.092038:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.092054:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.092068:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.098085:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985019 is committed 00002000:00010000:2.0:1789760783.098360:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72544256 -> 72548352 00002000:00010000:2.0:1789760783.098365:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141712 -> 141720 00010000:00010000:2.0:1789760783.098379:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098392:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098401:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098408:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.098413:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098422:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098443:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.098451:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674e359 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72544256->72548351] (req 72544256->72548351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.098546:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6584us (6876us total) trans 4294985019 rc 0/0 00000100:00100000:2.0:1789760783.098556:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17722 00000100:00100000:2.0:1789760783.098566:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721338238419 time 721352238998 state 0x2 ref 0 00000100:00100000:2.0:1789760783.109365:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.109465:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497600 00000100:00100000:0.0:1789760783.109476:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497600 00000100:00100000:0.0:1789760783.109535:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721338238419 time 721352238998 state 0x0 ref 1 00000100:00100000:0.0:1789760783.109549:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721352499414 time 721352238998 state 0x1 ref 1 00000100:00100000:0.0:1789760783.109579:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721352499414 time 721369871061 state 0x0 ref 1 00000100:00100000:0.0:1789760783.109593:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.109641:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72548352, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22998 00010000:00010000:0.0:1789760783.109651:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.109667:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.109671:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.109677:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.109701:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.120776:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985020 is committed 00002000:00010000:0.0:1789760783.120928:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72548352 -> 72552448 00002000:00010000:0.0:1789760783.120934:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141720 -> 141728 00010000:00010000:0.0:1789760783.120949:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.120962:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.120971:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.120978:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.120983:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.120993:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.121012:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.121021:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e360 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72548352->72552447] (req 72548352->72552447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.121509:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11912us (12148us total) trans 4294985020 rc 0/0 00000100:00100000:0.0:1789760783.121522:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17723 00000100:00100000:0.0:1789760783.121532:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721352499414 time 721369871061 state 0x2 ref 0 00000100:00100000:0.0:1789760783.135001:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.135388:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497728 00000100:00100000:1.0:1789760783.135397:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497728 00000100:00100000:1.0:1789760783.135448:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721352499414 time 721369871061 state 0x0 ref 1 00000100:00100000:1.0:1789760783.135466:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721370131477 time 721369871061 state 0x1 ref 1 00000100:00100000:1.0:1789760783.135496:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721370131477 time 721395788062 state 0x0 ref 1 00000100:00100000:1.0:1789760783.135507:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.135554:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72552448, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229a0 00010000:00010000:1.0:1789760783.135563:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.135579:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.135584:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.135590:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.135602:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.147931:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985021 is committed 00002000:00010000:1.0:1789760783.148332:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72552448 -> 72556544 00002000:00010000:1.0:1789760783.148338:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141728 -> 141736 00010000:00010000:1.0:1789760783.148350:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148363:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148371:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148379:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.148384:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148392:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148409:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.148416:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e367 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72552448->72556543] (req 72552448->72556543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.148580:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13062us (13576us total) trans 4294985021 rc 0/0 00000100:00100000:1.0:1789760783.148591:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17724 00000100:00100000:1.0:1789760783.148601:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721370131477 time 721395788062 state 0x2 ref 0 00000100:00100000:1.0:1789760783.155755:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.156112:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497856 00000100:00100000:2.0:1789760783.156122:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497856 00000100:00100000:2.0:1789760783.156191:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721370131477 time 721395788062 state 0x0 ref 1 00000100:00100000:2.0:1789760783.156207:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721396048478 time 721395788062 state 0x1 ref 1 00000100:00100000:2.0:1789760783.156236:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721396048478 time 721416527877 state 0x0 ref 1 00000100:00100000:2.0:1789760783.156248:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.156299:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72556544, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229a8 00010000:00010000:2.0:1789760783.156308:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.156325:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.156330:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.156336:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.156349:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.168063:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985022 is committed 00002000:00010000:2.0:1789760783.168220:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72556544 -> 72560640 00002000:00010000:2.0:1789760783.168225:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141736 -> 141744 00010000:00010000:2.0:1789760783.168239:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168251:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168261:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168279:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.168285:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168300:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168319:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.168326:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e36e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72556544->72560639] (req 72556544->72560639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.168414:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12164us (12665us total) trans 4294985022 rc 0/0 00000100:00100000:2.0:1789760783.168424:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17725 00000100:00100000:2.0:1789760783.168434:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721396048478 time 721416527877 state 0x2 ref 0 00000100:00100000:2.0:1789760783.173222:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.173308:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565497984 00000100:00100000:0.0:1789760783.173317:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565497984 00000100:00100000:0.0:1789760783.173372:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721396048478 time 721416527877 state 0x0 ref 1 00000100:00100000:0.0:1789760783.173386:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721416788293 time 721416527877 state 0x1 ref 1 00000100:00100000:0.0:1789760783.173417:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721416788293 time 721433709454 state 0x0 ref 1 00000100:00100000:0.0:1789760783.173429:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.173474:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72560640, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229b0 00010000:00010000:0.0:1789760783.173484:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.173501:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.173506:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.173513:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.173527:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.184758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985023 is committed 00002000:00010000:0.0:1789760783.184920:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72560640 -> 72564736 00002000:00010000:0.0:1789760783.184926:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141744 -> 141752 00010000:00010000:0.0:1789760783.184939:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.184958:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.184967:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.184975:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.184979:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.184988:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.185007:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.185015:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e375 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72560640->72564735] (req 72560640->72564735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.185201:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565497984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11769us (11985us total) trans 4294985023 rc 0/0 00000100:00100000:0.0:1789760783.185212:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17726 00000100:00100000:0.0:1789760783.185222:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721416788293 time 721433709454 state 0x2 ref 0 00000100:00100000:0.0:1789760783.194841:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.194956:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498112 00000100:00100000:1.0:1789760783.194966:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498112 00000100:00100000:1.0:1789760783.195020:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721416788293 time 721433709454 state 0x0 ref 1 00000100:00100000:1.0:1789760783.195094:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721433969870 time 721433709454 state 0x1 ref 1 00000100:00100000:1.0:1789760783.195159:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721433969870 time 721455449964 state 0x0 ref 1 00000100:00100000:1.0:1789760783.195173:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.195229:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72564736, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229b8 00010000:00010000:1.0:1789760783.195238:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.195253:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.195257:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.195274:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.195289:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.201941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985024 is committed 00002000:00010000:1.0:1789760783.202063:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72564736 -> 72568832 00002000:00010000:1.0:1789760783.202069:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141752 -> 141760 00010000:00010000:1.0:1789760783.202083:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202097:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202106:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202114:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.202120:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202129:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202148:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.202156:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e37c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72564736->72568831] (req 72564736->72568831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.202303:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7127us (7465us total) trans 4294985024 rc 0/0 00000100:00100000:1.0:1789760783.202314:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17727 00000100:00100000:1.0:1789760783.202323:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721433969870 time 721455449964 state 0x2 ref 0 00000100:00100000:1.0:1789760783.208921:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.209002:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498240 00000100:00100000:2.0:1789760783.209012:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498240 00000100:00100000:2.0:1789760783.209076:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721433969870 time 721455449964 state 0x0 ref 1 00000100:00100000:2.0:1789760783.209091:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721455710380 time 721455449964 state 0x1 ref 1 00000100:00100000:2.0:1789760783.209120:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721455710380 time 721469412082 state 0x0 ref 1 00000100:00100000:2.0:1789760783.209133:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.209179:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72568832, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229c0 00010000:00010000:2.0:1789760783.209188:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.209202:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.209518:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.209526:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.209542:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.216462:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985025 is committed 00002000:00010000:2.0:1789760783.216944:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72568832 -> 72572928 00002000:00010000:2.0:1789760783.216950:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141760 -> 141768 00010000:00010000:2.0:1789760783.216962:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.216975:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.216985:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.216993:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.216997:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.217012:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.217030:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.217142:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72568832->72572927] (req 72568832->72572927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.217396:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8261us (8480us total) trans 4294985025 rc 0/0 00000100:00100000:2.0:1789760783.217407:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17728 00000100:00100000:2.0:1789760783.217417:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721455710380 time 721469412082 state 0x2 ref 0 00000100:00100000:2.0:1789760783.229914:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.230314:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498368 00000100:00100000:0.0:1789760783.230325:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498368 00000100:00100000:0.0:1789760783.230382:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721455710380 time 721469412082 state 0x0 ref 1 00000100:00100000:0.0:1789760783.230398:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721469672498 time 721469412082 state 0x1 ref 1 00000100:00100000:0.0:1789760783.230468:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721469672498 time 721490758922 state 0x0 ref 1 00000100:00100000:0.0:1789760783.230481:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.230527:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72572928, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229c8 00010000:00010000:0.0:1789760783.230536:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.230551:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.230555:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.230562:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.230575:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.238399:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985026 is committed 00002000:00010000:0.0:1789760783.238538:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72572928 -> 72577024 00002000:00010000:0.0:1789760783.238544:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141768 -> 141776 00010000:00010000:0.0:1789760783.238557:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238569:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238579:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238587:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.238592:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238602:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238622:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.238629:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e38a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72572928->72577023] (req 72572928->72577023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.238863:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8379us (8966us total) trans 4294985026 rc 0/0 00000100:00100000:0.0:1789760783.238874:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17729 00000100:00100000:0.0:1789760783.238883:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721469672498 time 721490758922 state 0x2 ref 0 00000100:00100000:0.0:1789760783.246114:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.246499:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498496 00000100:00100000:1.0:1789760783.246510:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498496 00000100:00100000:1.0:1789760783.246566:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721469672498 time 721490758922 state 0x0 ref 1 00000100:00100000:1.0:1789760783.246581:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721491019338 time 721490758922 state 0x1 ref 1 00000100:00100000:1.0:1789760783.246621:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721491019338 time 721506912497 state 0x0 ref 1 00000100:00100000:1.0:1789760783.246647:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.246924:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72577024, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229d0 00010000:00010000:1.0:1789760783.246934:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.246951:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.246955:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.246961:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.246975:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.252134:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985027 is committed 00002000:00010000:1.0:1789760783.257790:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72577024 -> 72581120 00002000:00010000:1.0:1789760783.257800:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141776 -> 141784 00010000:00010000:1.0:1789760783.257815:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257829:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257838:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257845:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.257851:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257859:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257878:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.257885:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e391 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72577024->72581119] (req 72577024->72581119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.258672:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565498496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12020us (12560us total) trans 4294985027 rc 0/0 00000100:00100000:1.0:1789760783.258684:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17730 00000100:00100000:1.0:1789760783.258743:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721491019338 time 721506912497 state 0x2 ref 0 00000100:00100000:1.0:1789760783.273211:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.274848:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498624 00000100:00100000:2.0:1789760783.274861:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498624 00000100:00100000:2.0:1789760783.274928:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721491019338 time 721506912497 state 0x0 ref 1 00000100:00100000:2.0:1789760783.274944:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721507172913 time 721506912497 state 0x1 ref 1 00000100:00100000:2.0:1789760783.274981:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721507172913 time 721535272005 state 0x0 ref 1 00000100:00100000:2.0:1789760783.274994:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565498624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.275045:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72581120, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229d8 00010000:00010000:2.0:1789760783.275054:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.275069:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.275073:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.275080:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.275094:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.280144:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985028 is committed 00002000:00010000:3.0:1789760783.280311:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72581120 -> 72585216 00002000:00010000:3.0:1789760783.280316:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141784 -> 141792 00010000:00010000:3.0:1789760783.280330:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280343:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280352:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280359:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.280364:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280378:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280396:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.280404:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72581120->72585215] (req 72581120->72585215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.280567:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565498624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5570us (7362us total) trans 4294985028 rc 0/0 00000100:00100000:3.0:1789760783.280579:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17731 00000100:00100000:3.0:1789760783.280588:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721507172913 time 721535272005 state 0x2 ref 0 00000100:00100000:2.0:1789760783.286154:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.286924:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498752 00000100:00100000:0.0:1789760783.286935:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498752 00000100:00100000:0.0:1789760783.287089:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721507172913 time 721535272005 state 0x0 ref 1 00000100:00100000:0.0:1789760783.287108:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721535532421 time 721535272005 state 0x1 ref 1 00000100:00100000:0.0:1789760783.287141:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721535532421 time 721547432739 state 0x0 ref 1 00000100:00100000:0.0:1789760783.287155:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565498752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.287208:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72585216, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229e0 00010000:00010000:0.0:1789760783.287217:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.287234:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.287238:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.287245:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.287263:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.291654:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985029 is committed 00002000:00010000:0.0:1789760783.294791:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72585216 -> 72589312 00002000:00010000:0.0:1789760783.294800:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141792 -> 141800 00010000:00010000:0.0:1789760783.294812:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294826:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294836:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294844:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.294848:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294912:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294930:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.294935:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e39f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72585216->72589311] (req 72585216->72589311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.295116:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565498752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7961us (8969us total) trans 4294985029 rc 0/0 00000100:00100000:0.0:1789760783.295126:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17732 00000100:00100000:0.0:1789760783.295136:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721535532421 time 721547432739 state 0x2 ref 0 00000100:00100000:0.0:1789760783.298639:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.298828:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565498880 00000100:00100000:1.0:1789760783.298837:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565498880 00000100:00100000:1.0:1789760783.298954:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721535532421 time 721547432739 state 0x0 ref 1 00000100:00100000:1.0:1789760783.298970:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721547693155 time 721547432739 state 0x1 ref 1 00000100:00100000:3.0:1789760783.299060:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721547693155 time 721559349813 state 0x0 ref 1 00000100:00100000:3.0:1789760783.299077:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565498880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760783.299131:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72589312, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229e8 00010000:00010000:3.0:1789760783.299140:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.299155:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1789760783.299160:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.299166:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.299180:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.305225:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985030 is committed 00002000:00010000:3.0:1789760783.305378:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72589312 -> 72593408 00002000:00010000:3.0:1789760783.305384:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141800 -> 141808 00010000:00010000:3.0:1789760783.305399:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305414:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305424:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305432:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.305437:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305446:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305465:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.305472:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72589312->72593407] (req 72589312->72593407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.305577:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565498880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6500us (6942us total) trans 4294985030 rc 0/0 00000100:00100000:3.0:1789760783.305596:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17733 00000100:00100000:3.0:1789760783.305606:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721547693155 time 721559349813 state 0x2 ref 0 00000100:00100000:3.0:1789760783.310783:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.310870:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499008 00000100:00100000:2.0:1789760783.310880:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499008 00000100:00100000:2.0:1789760783.310938:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721547693155 time 721559349813 state 0x0 ref 1 00000100:00100000:2.0:1789760783.310954:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721559610229 time 721559349813 state 0x1 ref 1 00000100:00100000:2.0:1789760783.310998:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721559610229 time 721571290058 state 0x0 ref 1 00000100:00100000:2.0:1789760783.311011:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.311065:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72593408, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229f0 00010000:00010000:2.0:1789760783.311078:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.311094:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.311098:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.311105:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.311181:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.317113:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985031 is committed 00002000:00010000:3.0:1789760783.317417:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72593408 -> 72597504 00002000:00010000:3.0:1789760783.317424:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141808 -> 141816 00010000:00010000:3.0:1789760783.320446:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320468:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320477:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320484:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.320489:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320499:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320521:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.320530:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e3ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72593408->72597503] (req 72593408->72597503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.321785:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10766us (11002us total) trans 4294985031 rc 0/0 00000100:00100000:2.0:1789760783.321807:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17734 00000100:00100000:2.0:1789760783.321817:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721559610229 time 721571290058 state 0x2 ref 0 00000100:00100000:0.0:1789760783.327957:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.328595:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499136 00000100:00100000:2.0:1789760783.328608:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499136 00000100:00100000:2.0:1789760783.328893:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721559610229 time 721571290058 state 0x0 ref 1 00000100:00100000:2.0:1789760783.328908:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721571550474 time 721571290058 state 0x1 ref 1 00000100:00100000:2.0:1789760783.328985:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721571550474 time 721589277109 state 0x0 ref 1 00000100:00100000:2.0:1789760783.329000:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.329060:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72597504, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x229f8 00010000:00010000:2.0:1789760783.329070:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.329094:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.329098:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.329105:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.329119:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.334536:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985032 is committed 00002000:00010000:0.0:1789760783.334735:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72597504 -> 72601600 00002000:00010000:0.0:1789760783.334740:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141816 -> 141824 00010000:00010000:0.0:1789760783.334753:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.334770:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.334778:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.334785:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.335207:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.335219:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.335239:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.335247:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674e3b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72597504->72601599] (req 72597504->72601599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.335446:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6444us (7493us total) trans 4294985032 rc 0/0 00000100:00100000:0.0:1789760783.335457:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17735 00000100:00100000:0.0:1789760783.335466:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721571550474 time 721589277109 state 0x2 ref 0 00000100:00100000:0.0:1789760783.342980:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760783.343073:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499264 00000100:00100000:3.0:1789760783.343091:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499264 00000100:00100000:3.0:1789760783.343155:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721571550474 time 721589277109 state 0x0 ref 1 00000100:00100000:3.0:1789760783.343172:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721589537525 time 721589277109 state 0x1 ref 1 00000100:00100000:3.0:1789760783.343205:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721589537525 time 721603497075 state 0x0 ref 1 00000100:00100000:3.0:1789760783.343218:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c95a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760783.343264:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72601600, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a00 00010000:00010000:3.0:1789760783.343274:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.343288:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1789760783.343292:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.343299:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.343312:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.350444:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985033 is committed 00002000:00010000:2.0:1789760783.350582:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72601600 -> 72605696 00002000:00010000:2.0:1789760783.350587:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141824 -> 141832 00010000:00010000:2.0:1789760783.350600:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350612:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350621:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350770:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.350776:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350791:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350811:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.350819:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674e3bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72601600->72605695] (req 72601600->72605695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.350950:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7729us (7974us total) trans 4294985033 rc 0/0 00000100:00100000:2.0:1789760783.350961:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17736 00000100:00100000:2.0:1789760783.350970:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721589537525 time 721603497075 state 0x2 ref 0 00000100:00100000:0.0:1789760783.356007:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.357961:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499392 00000100:00100000:2.0:1789760783.357975:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499392 00000100:00100000:2.0:1789760783.358127:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721589537525 time 721603497075 state 0x0 ref 1 00000100:00100000:2.0:1789760783.358143:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721603757491 time 721603497075 state 0x1 ref 1 00000100:00100000:2.0:1789760783.358226:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721603757491 time 721618517690 state 0x0 ref 1 00000100:00100000:2.0:1789760783.358239:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.358284:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72605696, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a08 00010000:00010000:2.0:1789760783.358293:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.358309:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.358313:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.358371:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.358386:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.364456:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985034 is committed 00002000:00010000:2.0:1789760783.364588:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72605696 -> 72609792 00002000:00010000:2.0:1789760783.364593:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141832 -> 141840 00010000:00010000:2.0:1789760783.364610:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364624:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364633:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364650:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.364654:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364662:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364699:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.364726:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72605696->72609791] (req 72605696->72609791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.364867:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6625us (8866us total) trans 4294985034 rc 0/0 00000100:00100000:2.0:1789760783.364878:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17737 00000100:00100000:2.0:1789760783.364888:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721603757491 time 721618517690 state 0x2 ref 0 00000100:00100000:0.0:1789760783.370884:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.371522:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499520 00000100:00100000:2.0:1789760783.371533:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499520 00000100:00100000:2.0:1789760783.371594:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721603757491 time 721618517690 state 0x0 ref 1 00000100:00100000:2.0:1789760783.371610:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721618778106 time 721618517690 state 0x1 ref 1 00000100:00100000:2.0:1789760783.371919:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721618778106 time 721632208725 state 0x0 ref 1 00000100:00100000:2.0:1789760783.371934:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.372190:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72609792, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a10 00010000:00010000:2.0:1789760783.372201:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.372216:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.372221:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.372226:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.372239:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.379700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985035 is committed 00002000:00010000:2.0:1789760783.380178:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72609792 -> 72613888 00002000:00010000:2.0:1789760783.380184:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141840 -> 141848 00010000:00010000:2.0:1789760783.380197:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380210:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380220:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380228:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.380234:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380244:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380266:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.380279:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72609792->72613887] (req 72609792->72613887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.380380:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8443us (9500us total) trans 4294985035 rc 0/0 00000100:00100000:2.0:1789760783.380390:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17738 00000100:00100000:2.0:1789760783.380399:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721618778106 time 721632208725 state 0x2 ref 0 00000100:00100000:0.0:1789760783.390075:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.390163:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499648 00000100:00100000:2.0:1789760783.390172:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499648 00000100:00100000:2.0:1789760783.390224:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721618778106 time 721632208725 state 0x0 ref 1 00000100:00100000:2.0:1789760783.390237:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721632469141 time 721632208725 state 0x1 ref 1 00000100:00100000:2.0:1789760783.390265:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721632469141 time 721650557515 state 0x0 ref 1 00000100:00100000:2.0:1789760783.390275:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.390318:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72613888, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a18 00010000:00010000:2.0:1789760783.390327:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.390353:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.390357:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.390363:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.390382:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.398759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985036 is committed 00002000:00010000:2.0:1789760783.399123:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72613888 -> 72617984 00002000:00010000:2.0:1789760783.399129:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141848 -> 141856 00010000:00010000:2.0:1789760783.399143:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399157:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399166:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399173:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.399178:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399187:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399207:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.399215:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72613888->72617983] (req 72613888->72617983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.399678:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565499648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9399us (9607us total) trans 4294985036 rc 0/0 00000100:00100000:2.0:1789760783.399700:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17739 00000100:00100000:2.0:1789760783.399765:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721632469141 time 721650557515 state 0x2 ref 0 00000100:00100000:0.0:1789760783.404503:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.405093:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499776 00000100:00100000:2.0:1789760783.405104:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499776 00000100:00100000:2.0:1789760783.405164:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721632469141 time 721650557515 state 0x0 ref 1 00000100:00100000:2.0:1789760783.405180:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721650817931 time 721650557515 state 0x1 ref 1 00000100:00100000:2.0:1789760783.405210:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721650817931 time 721665502259 state 0x0 ref 1 00000100:00100000:2.0:1789760783.405223:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.405272:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72617984, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a20 00010000:00010000:2.0:1789760783.405282:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.405299:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.405303:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.405309:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.405323:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.411356:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985037 is committed 00002000:00010000:1.0:1789760783.411912:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72617984 -> 72622080 00002000:00010000:1.0:1789760783.411917:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141856 -> 141864 00010000:00010000:1.0:1789760783.411931:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411943:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411951:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411958:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.411962:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411970:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411990:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.411997:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674e3d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72617984->72622079] (req 72617984->72622079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.412207:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565499776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6980us (7708us total) trans 4294985037 rc 0/0 00000100:00100000:1.0:1789760783.412217:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17740 00000100:00100000:1.0:1789760783.412228:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721650817931 time 721665502259 state 0x2 ref 0 00000100:00100000:1.0:1789760783.421670:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.421874:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565499904 00000100:00100000:2.0:1789760783.421884:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565499904 00000100:00100000:2.0:1789760783.421941:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721650817931 time 721665502259 state 0x0 ref 1 00000100:00100000:2.0:1789760783.421957:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721665762675 time 721665502259 state 0x1 ref 1 00000100:00100000:2.0:1789760783.421990:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721665762675 time 721682282064 state 0x0 ref 1 00000100:00100000:2.0:1789760783.422002:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565499904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.422051:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72622080, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a28 00010000:00010000:2.0:1789760783.422060:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.422085:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.422089:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.422095:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.422110:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.426919:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985038 is committed 00002000:00010000:2.0:1789760783.427045:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72622080 -> 72626176 00002000:00010000:2.0:1789760783.427050:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141864 -> 141872 00010000:00010000:2.0:1789760783.427064:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427083:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427091:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427098:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.427103:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427111:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427131:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.427140:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72622080->72626175] (req 72622080->72626175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.427228:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565499904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5223us (5562us total) trans 4294985038 rc 0/0 00000100:00100000:2.0:1789760783.427238:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17741 00000100:00100000:2.0:1789760783.427248:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721665762675 time 721682282064 state 0x2 ref 0 00000100:00100000:1.0:1789760783.433023:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.433144:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500032 00000100:00100000:2.0:1789760783.433154:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500032 00000100:00100000:2.0:1789760783.433204:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721665762675 time 721682282064 state 0x0 ref 1 00000100:00100000:2.0:1789760783.433219:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721682542480 time 721682282064 state 0x1 ref 1 00000100:00100000:2.0:1789760783.433257:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721682542480 time 721693548080 state 0x0 ref 1 00000100:00100000:2.0:1789760783.433270:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565500032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.433317:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72626176, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a30 00010000:00010000:2.0:1789760783.433327:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.433343:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.433347:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.433353:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.433366:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.440211:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985039 is committed 00002000:00010000:2.0:1789760783.440605:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72626176 -> 72630272 00002000:00010000:2.0:1789760783.440611:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141872 -> 141880 00010000:00010000:2.0:1789760783.440625:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440638:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440654:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440661:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.440666:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440676:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440724:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.440733:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e3e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72626176->72630271] (req 72626176->72630271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.440840:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565500032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7566us (7820us total) trans 4294985039 rc 0/0 00000100:00100000:2.0:1789760783.440850:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17742 00000100:00100000:2.0:1789760783.440860:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721682542480 time 721693548080 state 0x2 ref 0 00000100:00100000:0.0:1789760783.447094:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.447190:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500160 00000100:00100000:1.0:1789760783.447200:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500160 00000100:00100000:1.0:1789760783.447267:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721682542480 time 721693548080 state 0x0 ref 1 00000100:00100000:1.0:1789760783.447283:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721693808496 time 721693548080 state 0x1 ref 1 00000100:00100000:1.0:1789760783.447313:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721693808496 time 721707605091 state 0x0 ref 1 00000100:00100000:1.0:1789760783.447326:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565500160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.447373:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72630272, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a38 00010000:00010000:1.0:1789760783.447382:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.447398:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.447402:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.447409:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.447422:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.452589:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985040 is committed 00002000:00010000:1.0:1789760783.452763:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72630272 -> 72634368 00002000:00010000:1.0:1789760783.452780:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141880 -> 141888 00010000:00010000:1.0:1789760783.452797:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452811:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452820:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452828:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.452833:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452842:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452861:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.452869:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e3ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72630272->72634367] (req 72630272->72634367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.452973:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565500160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5638us (5875us total) trans 4294985040 rc 0/0 00000100:00100000:1.0:1789760783.452983:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17743 00000100:00100000:1.0:1789760783.452994:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721693808496 time 721707605091 state 0x2 ref 0 00000100:00100000:1.0:1789760783.456652:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.457296:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500288 00000100:00100000:2.0:1789760783.457306:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500288 00000100:00100000:2.0:1789760783.457360:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721693808496 time 721707605091 state 0x0 ref 1 00000100:00100000:2.0:1789760783.457380:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721707865507 time 721707605091 state 0x1 ref 1 00000100:00100000:2.0:1789760783.457441:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721707865507 time 721717732501 state 0x0 ref 1 00000100:00100000:2.0:1789760783.457454:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565500288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.457503:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72634368, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a40 00010000:00010000:2.0:1789760783.457512:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.457527:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.457531:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.457536:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.457549:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.462244:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985041 is committed 00002000:00010000:2.0:1789760783.462358:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72634368 -> 72638464 00002000:00010000:2.0:1789760783.462363:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141888 -> 141896 00010000:00010000:2.0:1789760783.462376:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462388:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462397:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462406:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.462410:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462419:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462436:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.462445:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e3f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72634368->72638463] (req 72634368->72638463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.462536:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565500288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5081us (5889us total) trans 4294985041 rc 0/0 00000100:00100000:2.0:1789760783.462546:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17744 00000100:00100000:2.0:1789760783.462556:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721707865507 time 721717732501 state 0x2 ref 0 00000100:00100000:2.0:1789760783.468359:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.469678:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500416 00000100:00100000:1.0:1789760783.469716:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500416 00000100:00100000:1.0:1789760783.469783:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721707865507 time 721717732501 state 0x0 ref 1 00000100:00100000:1.0:1789760783.469798:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721717992917 time 721717732501 state 0x1 ref 1 00000100:00100000:0.0:1789760783.469883:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721717992917 time 721730172286 state 0x0 ref 1 00000100:00100000:0.0:1789760783.469902:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.469948:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72638464, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a48 00010000:00010000:0.0:1789760783.469957:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.469973:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.469977:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.469983:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.469998:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.476007:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985042 is committed 00002000:00010000:0.0:1789760783.476124:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72638464 -> 72642560 00002000:00010000:0.0:1789760783.476130:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141896 -> 141904 00010000:00010000:0.0:1789760783.476143:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476156:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476165:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476172:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.476177:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476185:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476205:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.476213:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e3fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72638464->72642559] (req 72638464->72642559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.476312:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6411us (7957us total) trans 4294985042 rc 0/0 00000100:00100000:0.0:1789760783.476323:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17745 00000100:00100000:0.0:1789760783.476451:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721717992917 time 721730172286 state 0x2 ref 0 00000100:00100000:0.0:1789760783.487334:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.487445:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500544 00000100:00100000:1.0:1789760783.487454:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500544 00000100:00100000:1.0:1789760783.487507:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721717992917 time 721730172286 state 0x0 ref 1 00000100:00100000:1.0:1789760783.487523:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721730432702 time 721730172286 state 0x1 ref 1 00000100:00100000:1.0:1789760783.487554:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721730432702 time 721747845878 state 0x0 ref 1 00000100:00100000:1.0:1789760783.487567:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565500544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.487614:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72642560, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a50 00010000:00010000:1.0:1789760783.487623:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.490173:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1789760783.490179:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.490187:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.490204:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.495813:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985043 is committed 00002000:00010000:0.0:1789760783.502952:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72642560 -> 72646656 00002000:00010000:0.0:1789760783.502962:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141904 -> 141912 00010000:00010000:0.0:1789760783.502974:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.502987:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.502997:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.503004:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.503009:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.503018:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.503047:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.503055:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72642560->72646655] (req 72642560->72646655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.503152:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565500544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15582us (15822us total) trans 4294985043 rc 0/0 00000100:00100000:0.0:1789760783.503171:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17746 00000100:00100000:0.0:1789760783.503182:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721730432702 time 721747845878 state 0x2 ref 0 00000100:00100000:1.0:1789760783.513505:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.513613:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500672 00000100:00100000:2.0:1789760783.513623:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500672 00000100:00100000:2.0:1789760783.513678:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721730432702 time 721747845878 state 0x0 ref 1 00000100:00100000:2.0:1789760783.513753:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721748106294 time 721747845878 state 0x1 ref 1 00000100:00100000:2.0:1789760783.513793:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721748106294 time 721774084422 state 0x0 ref 1 00000100:00100000:2.0:1789760783.513806:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.513851:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72646656, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a58 00010000:00010000:2.0:1789760783.513861:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.513877:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.513882:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.513889:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.513903:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.517984:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985044 is committed 00002000:00010000:2.0:1789760783.518099:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72646656 -> 72650752 00002000:00010000:2.0:1789760783.518104:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141912 -> 141920 00010000:00010000:2.0:1789760783.518118:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518131:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518141:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518154:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.518159:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518280:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518302:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.518311:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72646656->72650751] (req 72646656->72650751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.518401:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4593us (4906us total) trans 4294985044 rc 0/0 00000100:00100000:2.0:1789760783.518411:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17747 00000100:00100000:2.0:1789760783.518420:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721748106294 time 721774084422 state 0x2 ref 0 00000100:00100000:2.0:1789760783.525065:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.525203:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500800 00000100:00100000:0.0:1789760783.525212:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500800 00000100:00100000:0.0:1789760783.525266:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721748106294 time 721774084422 state 0x0 ref 1 00000100:00100000:0.0:1789760783.525282:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721774344838 time 721774084422 state 0x1 ref 1 00000100:00100000:0.0:1789760783.525313:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721774344838 time 721785605099 state 0x0 ref 1 00000100:00100000:0.0:1789760783.525326:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.525373:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72650752, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a60 00010000:00010000:0.0:1789760783.525382:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.525398:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.525403:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.525409:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.525425:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.532952:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985045 is committed 00002000:00010000:0.0:1789760783.533130:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72650752 -> 72654848 00002000:00010000:0.0:1789760783.533136:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141920 -> 141928 00010000:00010000:0.0:1789760783.533150:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533223:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533232:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533239:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.533243:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533252:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533272:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.533279:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674e40f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72650752->72654847] (req 72650752->72654847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.533420:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565500800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8091us (8359us total) trans 4294985045 rc 0/0 00000100:00100000:0.0:1789760783.533430:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17748 00000100:00100000:0.0:1789760783.533439:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721774344838 time 721785605099 state 0x2 ref 0 00000100:00100000:0.0:1789760783.541978:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.542108:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565500928 00000100:00100000:2.0:1789760783.542117:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565500928 00000100:00100000:2.0:1789760783.542173:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721774344838 time 721785605099 state 0x0 ref 1 00000100:00100000:2.0:1789760783.542189:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721785865515 time 721785605099 state 0x1 ref 1 00000100:00100000:2.0:1789760783.542213:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721785865515 time 721802505939 state 0x0 ref 1 00000100:00100000:2.0:1789760783.542225:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565500928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.542270:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72654848, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a68 00010000:00010000:2.0:1789760783.542279:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.542296:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.542301:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.542307:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.542321:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.550211:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985046 is committed 00002000:00010000:2.0:1789760783.550378:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72654848 -> 72658944 00002000:00010000:2.0:1789760783.550383:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141928 -> 141936 00010000:00010000:2.0:1789760783.550396:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550408:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550418:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550426:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.550431:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550440:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550460:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.550468:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72654848->72658943] (req 72654848->72658943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.550564:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565500928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8336us (8593us total) trans 4294985046 rc 0/0 00000100:00100000:2.0:1789760783.550574:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17749 00000100:00100000:2.0:1789760783.550583:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721785865515 time 721802505939 state 0x2 ref 0 00000100:00100000:1.0:1789760783.556381:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.556485:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501056 00000100:00100000:2.0:1789760783.556495:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501056 00000100:00100000:2.0:1789760783.556549:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721785865515 time 721802505939 state 0x0 ref 1 00000100:00100000:2.0:1789760783.556565:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721802766355 time 721802505939 state 0x1 ref 1 00000100:00100000:2.0:1789760783.556627:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721802766355 time 721816918024 state 0x0 ref 1 00000100:00100000:2.0:1789760783.556640:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.556698:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72658944, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a70 00010000:00010000:2.0:1789760783.556726:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.556743:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.556748:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.556755:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.556770:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.563273:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985047 is committed 00002000:00010000:2.0:1789760783.563532:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72658944 -> 72663040 00002000:00010000:2.0:1789760783.563538:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141936 -> 141944 00010000:00010000:2.0:1789760783.563551:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563564:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563573:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563580:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.563584:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563591:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563610:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.563617:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e41d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72658944->72663039] (req 72658944->72663039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.563751:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7108us (7376us total) trans 4294985047 rc 0/0 00000100:00100000:2.0:1789760783.563763:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17750 00000100:00100000:2.0:1789760783.563773:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721802766355 time 721816918024 state 0x2 ref 0 00010000:00010000:1.0:1789760783.564417:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760783.567844:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.568087:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501184 00000100:00100000:0.0:1789760783.568097:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501184 00000100:00100000:0.0:1789760783.568154:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721802766355 time 721816918024 state 0x0 ref 1 00000100:00100000:0.0:1789760783.568171:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721817178440 time 721816918024 state 0x1 ref 1 00000100:00100000:0.0:1789760783.568205:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721817178440 time 721828496755 state 0x0 ref 1 00000100:00100000:0.0:1789760783.568218:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.568276:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72663040, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a78 00010000:00010000:0.0:1789760783.568287:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.568303:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.568307:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.568313:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.568327:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.583004:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985048 is committed 00002000:00010000:0.0:1789760783.583343:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72663040 -> 72667136 00002000:00010000:0.0:1789760783.583349:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141944 -> 141952 00010000:00010000:0.0:1789760783.583364:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583455:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583464:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583471:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.583476:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583484:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583503:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.583512:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72663040->72667135] (req 72663040->72667135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.584200:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15970us (16352us total) trans 4294985048 rc 0/0 00000100:00100000:0.0:1789760783.584211:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17751 00000100:00100000:0.0:1789760783.584219:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721817178440 time 721828496755 state 0x2 ref 0 00000100:00100000:0.0:1789760783.591154:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.591357:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501312 00000100:00100000:2.0:1789760783.591380:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501312 00000100:00100000:2.0:1789760783.591446:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721817178440 time 721828496755 state 0x0 ref 1 00000100:00100000:2.0:1789760783.591460:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721828757171 time 721828496755 state 0x1 ref 1 00000100:00100000:2.0:1789760783.591480:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721828757171 time 721851772872 state 0x0 ref 1 00000100:00100000:2.0:1789760783.591491:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.591537:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72667136, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a80 00010000:00010000:2.0:1789760783.591546:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.591563:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.591568:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.591574:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.591587:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.600495:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985049 is committed 00002000:00010000:2.0:1789760783.600658:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72667136 -> 72671232 00002000:00010000:2.0:1789760783.600662:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141952 -> 141960 00010000:00010000:2.0:1789760783.600673:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.600683:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.600955:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.600965:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.600969:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.600978:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.601000:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.601180:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e42b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72667136->72671231] (req 72667136->72671231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.601384:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9889us (10234us total) trans 4294985049 rc 0/0 00000100:00100000:2.0:1789760783.601395:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17752 00000100:00100000:2.0:1789760783.601404:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721828757171 time 721851772872 state 0x2 ref 0 00000100:00100000:1.0:1789760783.605547:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.605891:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501440 00000100:00100000:2.0:1789760783.605901:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501440 00000100:00100000:2.0:1789760783.605948:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721828757171 time 721851772872 state 0x0 ref 1 00000100:00100000:2.0:1789760783.605962:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721852033288 time 721851772872 state 0x1 ref 1 00000100:00100000:2.0:1789760783.606330:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721852033288 time 721866620252 state 0x0 ref 1 00000100:00100000:2.0:1789760783.606345:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.606404:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72671232, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a88 00010000:00010000:2.0:1789760783.606413:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.606429:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.606433:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.606440:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.606461:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.614368:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985050 is committed 00002000:00010000:2.0:1789760783.614555:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72671232 -> 72675328 00002000:00010000:2.0:1789760783.614560:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141960 -> 141968 00010000:00010000:2.0:1789760783.614575:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614588:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614598:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614605:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.614610:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614619:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614638:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.614646:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72671232->72675327] (req 72671232->72675327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.614877:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8530us (9334us total) trans 4294985050 rc 0/0 00000100:00100000:2.0:1789760783.614898:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17753 00000100:00100000:2.0:1789760783.614908:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721852033288 time 721866620252 state 0x2 ref 0 00000100:00100000:1.0:1789760783.620460:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.620592:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501568 00000100:00100000:0.0:1789760783.620603:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501568 00000100:00100000:0.0:1789760783.620658:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721852033288 time 721866620252 state 0x0 ref 1 00000100:00100000:0.0:1789760783.620676:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721866880668 time 721866620252 state 0x1 ref 1 00000100:00100000:0.0:1789760783.620745:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721866880668 time 721881036869 state 0x0 ref 1 00000100:00100000:0.0:1789760783.620758:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.620803:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72675328, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a90 00010000:00010000:0.0:1789760783.620813:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.620829:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.620834:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.620841:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.620857:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.630825:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985051 is committed 00002000:00010000:1.0:1789760783.631270:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72675328 -> 72679424 00002000:00010000:1.0:1789760783.631275:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141968 -> 141976 00010000:00010000:1.0:1789760783.631287:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631300:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631310:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631319:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.631323:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631333:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631359:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.631367:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72675328->72679423] (req 72675328->72679423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.631515:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565501568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10754us (11058us total) trans 4294985051 rc 0/0 00000100:00100000:1.0:1789760783.631525:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17754 00000100:00100000:1.0:1789760783.631535:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721866880668 time 721881036869 state 0x2 ref 0 00000100:00100000:3.0:1789760783.638447:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.638981:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501696 00000100:00100000:2.0:1789760783.638994:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501696 00000100:00100000:2.0:1789760783.639068:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721866880668 time 721881036869 state 0x0 ref 1 00000100:00100000:2.0:1789760783.639093:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721881297285 time 721881036869 state 0x1 ref 1 00000100:00100000:2.0:1789760783.639124:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721881297285 time 721899415584 state 0x0 ref 1 00000100:00100000:2.0:1789760783.639138:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565501696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.639200:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72679424, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22a98 00010000:00010000:2.0:1789760783.639210:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.639228:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.639233:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.639239:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.639254:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.650573:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985052 is committed 00002000:00010000:2.0:1789760783.651531:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72679424 -> 72683520 00002000:00010000:2.0:1789760783.651538:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141976 -> 141984 00010000:00010000:2.0:1789760783.651552:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651566:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651576:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651583:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.651588:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651596:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651615:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.651622:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72679424->72683519] (req 72679424->72683519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.651774:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565501696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12634us (13333us total) trans 4294985052 rc 0/0 00000100:00100000:2.0:1789760783.651786:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17755 00000100:00100000:2.0:1789760783.651795:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721881297285 time 721899415584 state 0x2 ref 0 00000100:00100000:2.0:1789760783.657819:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.657932:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501824 00000100:00100000:0.0:1789760783.657941:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501824 00000100:00100000:0.0:1789760783.658007:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721881297285 time 721899415584 state 0x0 ref 1 00000100:00100000:0.0:1789760783.658022:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721899676000 time 721899415584 state 0x1 ref 1 00000100:00100000:0.0:1789760783.658065:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721899676000 time 721918357199 state 0x0 ref 1 00000100:00100000:0.0:1789760783.658079:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565501824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.658128:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72683520, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22aa0 00010000:00010000:0.0:1789760783.658137:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.658154:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.658159:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.658168:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.658181:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.667481:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985053 is committed 00002000:00010000:0.0:1789760783.667763:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72683520 -> 72687616 00002000:00010000:0.0:1789760783.667769:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141984 -> 141992 00010000:00010000:0.0:1789760783.667781:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667792:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667801:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667809:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.667813:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667827:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667846:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.667854:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72683520->72687615] (req 72683520->72687615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.667950:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565501824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9869us (10134us total) trans 4294985053 rc 0/0 00000100:00100000:0.0:1789760783.667959:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17756 00000100:00100000:0.0:1789760783.667975:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721899676000 time 721918357199 state 0x2 ref 0 00000100:00100000:1.0:1789760783.676317:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.676789:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565501952 00000100:00100000:2.0:1789760783.676799:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565501952 00000100:00100000:2.0:1789760783.676856:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721899676000 time 721918357199 state 0x0 ref 1 00000100:00100000:2.0:1789760783.676873:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721918617615 time 721918357199 state 0x1 ref 1 00000100:00100000:2.0:1789760783.676906:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721918617615 time 721937197950 state 0x0 ref 1 00000100:00100000:2.0:1789760783.676919:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.676966:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72687616, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22aa8 00010000:00010000:2.0:1789760783.676975:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.676992:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.676997:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.677004:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.677019:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.682967:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985054 is committed 00002000:00010000:2.0:1789760783.683180:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72687616 -> 72691712 00002000:00010000:2.0:1789760783.683186:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141992 -> 142000 00010000:00010000:2.0:1789760783.683200:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683212:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683220:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683227:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.683232:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683242:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683262:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.683270:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e44e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72687616->72691711] (req 72687616->72691711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.683398:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565501952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6476us (7085us total) trans 4294985054 rc 0/0 00000100:00100000:2.0:1789760783.683409:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17757 00000100:00100000:2.0:1789760783.683419:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721918617615 time 721937197950 state 0x2 ref 0 00000100:00100000:3.0:1789760783.688845:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.688946:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502080 00000100:00100000:2.0:1789760783.688956:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502080 00000100:00100000:2.0:1789760783.689009:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721918617615 time 721937197950 state 0x0 ref 1 00000100:00100000:2.0:1789760783.689024:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721937458366 time 721937197950 state 0x1 ref 1 00000100:00100000:2.0:1789760783.689065:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721937458366 time 721949356307 state 0x0 ref 1 00000100:00100000:2.0:1789760783.689078:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565502080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.689124:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72691712, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ab0 00010000:00010000:2.0:1789760783.689133:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.689148:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.689153:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.689159:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.689174:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.694762:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985055 is committed 00002000:00010000:2.0:1789760783.694875:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72691712 -> 72695808 00002000:00010000:2.0:1789760783.694880:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142000 -> 142008 00010000:00010000:2.0:1789760783.694894:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694911:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694920:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694928:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.694933:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694942:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694962:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.694969:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72691712->72695807] (req 72691712->72695807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.695070:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565502080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5990us (6229us total) trans 4294985055 rc 0/0 00000100:00100000:2.0:1789760783.695081:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17758 00000100:00100000:2.0:1789760783.695091:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721937458366 time 721949356307 state 0x2 ref 0 00000100:00100000:1.0:1789760783.699088:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.699187:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502208 00000100:00100000:0.0:1789760783.699197:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502208 00000100:00100000:0.0:1789760783.699251:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721937458366 time 721949356307 state 0x0 ref 1 00000100:00100000:0.0:1789760783.699266:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721949616723 time 721949356307 state 0x1 ref 1 00000100:00100000:0.0:1789760783.699297:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721949616723 time 721959588786 state 0x0 ref 1 00000100:00100000:0.0:1789760783.699311:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565502208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.699359:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72695808, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ab8 00010000:00010000:0.0:1789760783.699369:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.699385:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.699389:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.699396:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.699410:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.704557:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985056 is committed 00002000:00010000:0.0:1789760783.704855:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72695808 -> 72699904 00002000:00010000:0.0:1789760783.704861:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142008 -> 142016 00010000:00010000:0.0:1789760783.704874:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704887:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704897:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704905:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.704910:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704920:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704945:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.704953:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e45c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72695808->72699903] (req 72695808->72699903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.705094:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565502208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5781us (6010us total) trans 4294985056 rc 0/0 00000100:00100000:0.0:1789760783.705105:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17759 00000100:00100000:0.0:1789760783.705114:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721949616723 time 721959588786 state 0x2 ref 0 00000100:00100000:1.0:1789760783.709455:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.709556:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502336 00000100:00100000:2.0:1789760783.709565:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502336 00000100:00100000:2.0:1789760783.709616:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721949616723 time 721959588786 state 0x0 ref 1 00000100:00100000:2.0:1789760783.709641:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721959849202 time 721959588786 state 0x1 ref 1 00000100:00100000:2.0:1789760783.709667:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721959849202 time 721969959458 state 0x0 ref 1 00000100:00100000:2.0:1789760783.709680:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565502336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.709768:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72699904, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ac0 00010000:00010000:2.0:1789760783.709777:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.709792:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.709796:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.709802:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.709816:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.714527:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985057 is committed 00002000:00010000:2.0:1789760783.715364:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72699904 -> 72704000 00002000:00010000:2.0:1789760783.715370:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142016 -> 142024 00010000:00010000:2.0:1789760783.715384:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715397:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715413:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715420:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.715425:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715435:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715526:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.715536:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72699904->72703999] (req 72699904->72703999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.715784:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565502336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6101us (6343us total) trans 4294985057 rc 0/0 00000100:00100000:2.0:1789760783.715795:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17760 00000100:00100000:2.0:1789760783.715803:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721959849202 time 721969959458 state 0x2 ref 0 00000100:00100000:3.0:1789760783.720287:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.720367:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502464 00000100:00100000:2.0:1789760783.720376:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502464 00000100:00100000:2.0:1789760783.720427:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721959849202 time 721969959458 state 0x0 ref 1 00000100:00100000:2.0:1789760783.720455:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721970219874 time 721969959458 state 0x1 ref 1 00000100:00100000:2.0:1789760783.720487:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721970219874 time 721980778536 state 0x0 ref 1 00000100:00100000:2.0:1789760783.720501:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.720553:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72704000, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ac8 00010000:00010000:2.0:1789760783.720563:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.720578:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789760783.720582:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.720588:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.720603:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.726873:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985058 is committed 00002000:00010000:2.0:1789760783.726991:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72704000 -> 72708096 00002000:00010000:2.0:1789760783.726996:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142024 -> 142032 00010000:00010000:2.0:1789760783.727008:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727021:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727029:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727042:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.727047:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727057:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727076:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.727083:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e46a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72704000->72708095] (req 72704000->72708095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.727333:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6830us (7051us total) trans 4294985058 rc 0/0 00000100:00100000:2.0:1789760783.727343:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17761 00000100:00100000:2.0:1789760783.727352:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721970219874 time 721980778536 state 0x2 ref 0 00000100:00100000:1.0:1789760783.733979:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.734112:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502592 00000100:00100000:0.0:1789760783.734122:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502592 00000100:00100000:0.0:1789760783.734251:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721970219874 time 721980778536 state 0x0 ref 1 00000100:00100000:0.0:1789760783.734267:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721981038952 time 721980778536 state 0x1 ref 1 00000100:00100000:0.0:1789760783.734332:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721981038952 time 721994623256 state 0x0 ref 1 00000100:00100000:0.0:1789760783.734345:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.734390:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72708096, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ad0 00010000:00010000:0.0:1789760783.734400:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.734415:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789760783.734420:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.734427:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.734441:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.740769:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985059 is committed 00002000:00010000:0.0:1789760783.740885:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72708096 -> 72712192 00002000:00010000:0.0:1789760783.740890:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142032 -> 142040 00010000:00010000:0.0:1789760783.740904:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740917:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740925:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740932:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.740936:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740945:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740965:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.740980:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72708096->72712191] (req 72708096->72712191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.741131:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6783us (7157us total) trans 4294985059 rc 0/0 00000100:00100000:0.0:1789760783.741143:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17762 00000100:00100000:0.0:1789760783.741153:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721981038952 time 721994623256 state 0x2 ref 0 00000100:00100000:3.0:1789760783.749528:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.753272:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502720 00000100:00100000:2.0:1789760783.753286:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502720 00000100:00100000:2.0:1789760783.753350:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721981038952 time 721994623256 state 0x0 ref 1 00000100:00100000:2.0:1789760783.753366:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721994883672 time 721994623256 state 0x1 ref 1 00000100:00100000:2.0:1789760783.753457:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721994883672 time 722013748539 state 0x0 ref 1 00000100:00100000:2.0:1789760783.753475:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565502720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.753521:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72712192, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ad8 00010000:00010000:2.0:1789760783.753529:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.753544:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.753548:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.753554:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.753568:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760783.759125:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985060 is committed 00002000:00010000:2.0:1789760783.759283:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72712192 -> 72716288 00002000:00010000:2.0:1789760783.759288:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142040 -> 142048 00010000:00010000:2.0:1789760783.759300:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759313:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759323:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759330:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.759335:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759345:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759364:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.759372:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72712192->72716287] (req 72712192->72716287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.759462:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565502720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5986us (9939us total) trans 4294985060 rc 0/0 00000100:00100000:2.0:1789760783.759472:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17763 00000100:00100000:2.0:1789760783.759481:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721994883672 time 722013748539 state 0x2 ref 0 00000100:00100000:1.0:1789760783.768552:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.768655:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502848 00000100:00100000:2.0:1789760783.768665:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502848 00000100:00100000:2.0:1789760783.768756:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 721994883672 time 722013748539 state 0x0 ref 1 00000100:00100000:2.0:1789760783.768772:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722014008955 time 722013748539 state 0x1 ref 1 00000100:00100000:2.0:1789760783.768800:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722014008955 time 722029091966 state 0x0 ref 1 00000100:00100000:2.0:1789760783.768813:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565502848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.768874:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72716288, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ae0 00010000:00010000:2.0:1789760783.768884:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.768900:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.768905:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.768915:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.768930:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.774293:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985061 is committed 00002000:00010000:0.0:1789760783.774431:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72716288 -> 72720384 00002000:00010000:0.0:1789760783.774436:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142048 -> 142056 00010000:00010000:0.0:1789760783.774448:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774462:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774471:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774477:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.774482:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774491:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774520:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.774527:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674e47f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72716288->72720383] (req 72716288->72720383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.774633:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565502848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5817us (6085us total) trans 4294985061 rc 0/0 00000100:00100000:0.0:1789760783.774642:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17764 00000100:00100000:0.0:1789760783.774650:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722014008955 time 722029091966 state 0x2 ref 0 00000100:00100000:1.0:1789760783.784969:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.785050:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565502976 00000100:00100000:0.0:1789760783.785060:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565502976 00000100:00100000:0.0:1789760783.785216:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722014008955 time 722029091966 state 0x0 ref 1 00000100:00100000:0.0:1789760783.785239:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722029352382 time 722029091966 state 0x1 ref 1 00000100:00100000:0.0:1789760783.785269:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722029352382 time 722045561439 state 0x0 ref 1 00000100:00100000:0.0:1789760783.785283:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.785331:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72720384, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22ae8 00010000:00010000:0.0:1789760783.785341:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.785355:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.787182:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.787193:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.787213:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.792100:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985062 is committed 00002000:00010000:0.0:1789760783.793952:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72720384 -> 72724480 00002000:00010000:0.0:1789760783.793961:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142056 -> 142064 00010000:00010000:0.0:1789760783.793975:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.793987:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.793996:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.794004:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.794008:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.794016:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.794034:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.794046:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72720384->72724479] (req 72720384->72724479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.794147:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565502976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8863us (9182us total) trans 4294985062 rc 0/0 00000100:00100000:0.0:1789760783.794158:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17765 00000100:00100000:0.0:1789760783.794167:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722029352382 time 722045561439 state 0x2 ref 0 00000100:00100000:3.0:1789760783.800077:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.800299:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503104 00000100:00100000:2.0:1789760783.800309:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503104 00000100:00100000:2.0:1789760783.800360:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722029352382 time 722045561439 state 0x0 ref 1 00000100:00100000:2.0:1789760783.800376:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722045821855 time 722045561439 state 0x1 ref 1 00000100:00100000:2.0:1789760783.800506:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722045821855 time 722060796886 state 0x0 ref 1 00000100:00100000:2.0:1789760783.800520:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565503104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.800567:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72724480, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22af0 00010000:00010000:2.0:1789760783.800577:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.800592:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.800597:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.800604:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.800618:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.807179:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985063 is committed 00002000:00010000:2.0:1789760783.807328:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72724480 -> 72728576 00002000:00010000:2.0:1789760783.807333:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142064 -> 142072 00010000:00010000:2.0:1789760783.807345:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807358:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807366:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807373:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.807378:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807387:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807405:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.807417:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72724480->72728575] (req 72724480->72728575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.807778:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565503104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7255us (7704us total) trans 4294985063 rc 0/0 00000100:00100000:2.0:1789760783.807789:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17766 00000100:00100000:2.0:1789760783.807800:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722045821855 time 722060796886 state 0x2 ref 0 00000100:00100000:1.0:1789760783.817429:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.817871:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503232 00000100:00100000:0.0:1789760783.817881:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503232 00000100:00100000:0.0:1789760783.817934:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722045821855 time 722060796886 state 0x0 ref 1 00000100:00100000:0.0:1789760783.817950:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722061057302 time 722060796886 state 0x1 ref 1 00000100:00100000:0.0:1789760783.817981:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722061057302 time 722078273526 state 0x0 ref 1 00000100:00100000:0.0:1789760783.817993:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565503232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.818048:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72728576, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22af8 00010000:00010000:0.0:1789760783.818057:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.818073:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.818077:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.818083:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.818102:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.825472:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985064 is committed 00002000:00010000:0.0:1789760783.825589:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72728576 -> 72732672 00002000:00010000:0.0:1789760783.825594:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142072 -> 142080 00010000:00010000:0.0:1789760783.825607:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825631:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825740:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825748:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.825753:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825763:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825784:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.825792:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72728576->72732671] (req 72728576->72732671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.825887:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565503232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7891us (8465us total) trans 4294985064 rc 0/0 00000100:00100000:0.0:1789760783.825898:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17767 00000100:00100000:0.0:1789760783.825908:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722061057302 time 722078273526 state 0x2 ref 0 00000100:00100000:1.0:1789760783.832008:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.832082:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503360 00000100:00100000:0.0:1789760783.832091:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503360 00000100:00100000:0.0:1789760783.832146:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722061057302 time 722078273526 state 0x0 ref 1 00000100:00100000:0.0:1789760783.832160:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722078533942 time 722078273526 state 0x1 ref 1 00000100:00100000:0.0:1789760783.832188:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722078533942 time 722092480822 state 0x0 ref 1 00000100:00100000:0.0:1789760783.832200:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565503360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.832244:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72732672, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b00 00010000:00010000:0.0:1789760783.832253:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.832268:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.832272:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.832278:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.832290:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.837906:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985065 is committed 00002000:00010000:0.0:1789760783.838094:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72732672 -> 72736768 00002000:00010000:0.0:1789760783.838099:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142080 -> 142088 00010000:00010000:0.0:1789760783.838112:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838124:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838132:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838139:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.838144:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838152:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838171:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.838178:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e49b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72732672->72736767] (req 72732672->72736767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.838279:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565503360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6076us (6276us total) trans 4294985065 rc 0/0 00000100:00100000:0.0:1789760783.838290:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17768 00000100:00100000:0.0:1789760783.838300:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722078533942 time 722092480822 state 0x2 ref 0 00000100:00100000:3.0:1789760783.844141:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.844285:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503488 00000100:00100000:2.0:1789760783.844295:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503488 00000100:00100000:2.0:1789760783.844350:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722078533942 time 722092480822 state 0x0 ref 1 00000100:00100000:2.0:1789760783.844366:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722092741238 time 722092480822 state 0x1 ref 1 00000100:00100000:2.0:1789760783.844401:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722092741238 time 722104692305 state 0x0 ref 1 00000100:00100000:2.0:1789760783.844427:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565503488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.844474:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72736768, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b08 00010000:00010000:2.0:1789760783.844483:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.844499:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.844503:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.844510:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.844529:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.849481:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985066 is committed 00002000:00010000:2.0:1789760783.849582:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72736768 -> 72740864 00002000:00010000:2.0:1789760783.849587:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142088 -> 142096 00010000:00010000:2.0:1789760783.849599:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849611:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849621:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849628:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.849633:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849643:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849660:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.849667:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72736768->72740863] (req 72736768->72740863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.849803:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565503488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5375us (5667us total) trans 4294985066 rc 0/0 00000100:00100000:2.0:1789760783.849814:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17769 00000100:00100000:2.0:1789760783.849823:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722092741238 time 722104692305 state 0x2 ref 0 00000100:00100000:1.0:1789760783.857903:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.858000:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503616 00000100:00100000:0.0:1789760783.858010:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503616 00000100:00100000:0.0:1789760783.858061:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722092741238 time 722104692305 state 0x0 ref 1 00000100:00100000:0.0:1789760783.858076:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722104952721 time 722104692305 state 0x1 ref 1 00000100:00100000:0.0:1789760783.858106:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722104952721 time 722118397867 state 0x0 ref 1 00000100:00100000:0.0:1789760783.858118:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565503616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.858165:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72740864, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b10 00010000:00010000:0.0:1789760783.858174:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.858189:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.858194:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.858200:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.858214:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.862222:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985067 is committed 00002000:00010000:0.0:1789760783.862373:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72740864 -> 72744960 00002000:00010000:0.0:1789760783.862379:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142096 -> 142104 00010000:00010000:0.0:1789760783.862393:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862406:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862415:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862423:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.862427:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862437:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862457:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.862465:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72740864->72744959] (req 72740864->72744959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.862561:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565503616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4441us (4663us total) trans 4294985067 rc 0/0 00000100:00100000:0.0:1789760783.862572:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17770 00000100:00100000:0.0:1789760783.862581:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722104952721 time 722118397867 state 0x2 ref 0 00000100:00100000:1.0:1789760783.869229:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.869372:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503744 00000100:00100000:0.0:1789760783.869381:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503744 00000100:00100000:0.0:1789760783.869434:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722104952721 time 722118397867 state 0x0 ref 1 00000100:00100000:0.0:1789760783.869449:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722118658283 time 722118397867 state 0x1 ref 1 00000100:00100000:0.0:1789760783.869477:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722118658283 time 722129769303 state 0x0 ref 1 00000100:00100000:0.0:1789760783.869499:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565503744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.869546:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72744960, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b18 00010000:00010000:0.0:1789760783.869556:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.869570:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.869575:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.869581:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.869594:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.879641:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985068 is committed 00002000:00010000:0.0:1789760783.879773:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72744960 -> 72749056 00002000:00010000:0.0:1789760783.879778:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142104 -> 142112 00010000:00010000:0.0:1789760783.879791:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879809:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879818:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879825:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760783.879829:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879838:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879858:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.879867:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72744960->72749055] (req 72744960->72749055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.879967:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565503744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10475us (10742us total) trans 4294985068 rc 0/0 00000100:00100000:0.0:1789760783.879978:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17771 00000100:00100000:0.0:1789760783.879988:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722118658283 time 722129769303 state 0x2 ref 0 00000100:00100000:3.0:1789760783.884272:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.884371:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565503872 00000100:00100000:2.0:1789760783.884381:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565503872 00000100:00100000:2.0:1789760783.884433:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722118658283 time 722129769303 state 0x0 ref 1 00000100:00100000:2.0:1789760783.884448:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722130029719 time 722129769303 state 0x1 ref 1 00000100:00100000:2.0:1789760783.884482:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722130029719 time 722144773644 state 0x0 ref 1 00000100:00100000:2.0:1789760783.884494:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565503872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.884542:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72749056, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b20 00010000:00010000:2.0:1789760783.884553:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.884568:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.884573:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.884579:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.884598:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.889178:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985069 is committed 00002000:00010000:2.0:1789760783.889300:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72749056 -> 72753152 00002000:00010000:2.0:1789760783.889306:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142112 -> 142120 00010000:00010000:2.0:1789760783.889319:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889333:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889343:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889351:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.889356:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889365:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889384:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.889392:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72749056->72753151] (req 72749056->72753151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.889533:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565503872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5037us (5266us total) trans 4294985069 rc 0/0 00000100:00100000:2.0:1789760783.889544:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17772 00000100:00100000:2.0:1789760783.889554:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722130029719 time 722144773644 state 0x2 ref 0 00000100:00100000:1.0:1789760783.894518:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.895870:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504000 00000100:00100000:0.0:1789760783.895893:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504000 00000100:00100000:0.0:1789760783.895956:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722130029719 time 722144773644 state 0x0 ref 1 00000100:00100000:0.0:1789760783.895971:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722145034060 time 722144773644 state 0x1 ref 1 00000100:00100000:0.0:1789760783.896006:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722145034060 time 722156297334 state 0x0 ref 1 00000100:00100000:0.0:1789760783.896019:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565504000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.896065:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72753152, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b28 00010000:00010000:0.0:1789760783.896074:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.896090:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.896094:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.896101:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.896116:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760783.901024:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985070 is committed 00002000:00010000:2.0:1789760783.901658:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72753152 -> 72757248 00002000:00010000:2.0:1789760783.901666:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142120 -> 142128 00010000:00010000:2.0:1789760783.901842:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901859:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901869:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901879:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.901885:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901897:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901925:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.901940:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e4be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72753152->72757247] (req 72753152->72757247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.902562:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565504000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6535us (8042us total) trans 4294985070 rc 0/0 00000100:00100000:2.0:1789760783.902578:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17773 00000100:00100000:2.0:1789760783.902591:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722145034060 time 722156297334 state 0x2 ref 0 00000100:00100000:1.0:1789760783.908494:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760783.908595:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504128 00000100:00100000:0.0:1789760783.908607:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504128 00000100:00100000:0.0:1789760783.908694:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722145034060 time 722156297334 state 0x0 ref 1 00000100:00100000:0.0:1789760783.908740:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722156557750 time 722156297334 state 0x1 ref 1 00000100:00100000:0.0:1789760783.908770:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722156557750 time 722169062793 state 0x0 ref 1 00000100:00100000:0.0:1789760783.908784:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760783.908845:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72757248, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b30 00010000:00010000:0.0:1789760783.908857:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.908876:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760783.908881:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760783.908889:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.908907:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.919661:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985071 is committed 00002000:00010000:3.0:1789760783.921499:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72757248 -> 72761344 00002000:00010000:3.0:1789760783.921513:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142128 -> 142136 00010000:00010000:3.0:1789760783.921531:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921549:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921559:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921568:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.921574:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921592:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921620:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.921629:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e4c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72757248->72761343] (req 72757248->72761343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.922114:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13322us (13623us total) trans 4294985071 rc 0/0 00000100:00100000:3.0:1789760783.922129:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17774 00000100:00100000:3.0:1789760783.922142:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722156557750 time 722169062793 state 0x2 ref 0 00000100:00100000:3.0:1789760783.924808:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.924945:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504256 00000100:00100000:2.0:1789760783.924962:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504256 00000100:00100000:2.0:1789760783.925040:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722156557750 time 722169062793 state 0x0 ref 1 00000100:00100000:2.0:1789760783.925060:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722169323209 time 722169062793 state 0x1 ref 1 00000100:00100000:2.0:1789760783.925147:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722169323209 time 722185437960 state 0x0 ref 1 00000100:00100000:2.0:1789760783.925162:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565504256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.925223:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72761344, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b38 00010000:00010000:2.0:1789760783.925235:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.925255:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.925260:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.925268:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.925285:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.933789:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985072 is committed 00002000:00010000:1.0:1789760783.933947:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72761344 -> 72765440 00002000:00010000:1.0:1789760783.933953:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142136 -> 142144 00010000:00010000:1.0:1789760783.933972:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.933988:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.933998:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.934006:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.934011:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.934021:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.934043:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.934051:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674e4cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72761344->72765439] (req 72761344->72765439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.934181:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565504256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9014us (9377us total) trans 4294985072 rc 0/0 00000100:00100000:1.0:1789760783.934193:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17775 00000100:00100000:1.0:1789760783.934204:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722169323209 time 722185437960 state 0x2 ref 0 00000100:00100000:1.0:1789760783.938694:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.938903:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504384 00000100:00100000:2.0:1789760783.938916:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504384 00000100:00100000:2.0:1789760783.938990:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722169323209 time 722185437960 state 0x0 ref 1 00000100:00100000:2.0:1789760783.939009:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722185698376 time 722185437960 state 0x1 ref 1 00000100:00100000:2.0:1789760783.939050:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722185698376 time 722199341322 state 0x0 ref 1 00000100:00100000:2.0:1789760783.939064:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565504384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.939127:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72765440, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0x22b40 00010000:00010000:2.0:1789760783.939139:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.939159:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.939164:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.939172:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.939188:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.948022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985073 is committed 00002000:00010000:2.0:1789760783.948283:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72765440 -> 72769536 00002000:00010000:2.0:1789760783.948287:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760783 -> 1789760784 00002000:00010000:2.0:1789760783.948290:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760783 -> 1789760784 00002000:00010000:2.0:1789760783.948293:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142144 -> 142152 00010000:00010000:2.0:1789760783.948307:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.948321:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.948329:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.948337:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.948342:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.948351:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.949323:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.949338:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674e4d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72765440->72769535] (req 72765440->72769535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.949904:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565504384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10837us (11234us total) trans 4294985073 rc 0/0 00000100:00100000:2.0:1789760783.949916:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17776 00000100:00100000:2.0:1789760783.949924:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722185698376 time 722199341322 state 0x2 ref 0 00000100:00100000:2.0:1789760783.955134:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760783.955316:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504512 00000100:00100000:3.0:1789760783.955326:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504512 00000100:00100000:3.0:1789760783.955379:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722185698376 time 722199341322 state 0x0 ref 1 00000100:00100000:3.0:1789760783.955395:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722199601738 time 722199341322 state 0x1 ref 1 00000100:00100000:3.0:1789760783.955428:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722199601738 time 722215719858 state 0x0 ref 1 00000100:00100000:3.0:1789760783.955439:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760783.955489:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72769536, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b48 00010000:00010000:3.0:1789760783.955501:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.955519:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760783.955524:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.955530:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.955545:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.965702:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985074 is committed 00002000:00010000:3.0:1789760783.965901:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72769536 -> 72773632 00002000:00010000:3.0:1789760783.965905:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142152 -> 142160 00010000:00010000:3.0:1789760783.965919:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.965932:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.965992:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.966001:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760783.966007:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.966016:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.966038:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.966046:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72769536->72773631] (req 72769536->72773631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.966138:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10696us (11007us total) trans 4294985074 rc 0/0 00000100:00100000:3.0:1789760783.966149:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17777 00000100:00100000:3.0:1789760783.966230:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722199601738 time 722215719858 state 0x2 ref 0 00000100:00100000:3.0:1789760783.972472:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760783.972673:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504640 00000100:00100000:1.0:1789760783.972694:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504640 00000100:00100000:1.0:1789760783.973083:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722199601738 time 722215719858 state 0x0 ref 1 00000100:00100000:1.0:1789760783.973103:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722215980274 time 722215719858 state 0x1 ref 1 00000100:00100000:1.0:1789760783.973145:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722215980274 time 722233437076 state 0x0 ref 1 00000100:00100000:1.0:1789760783.973161:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565504640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760783.973223:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72773632, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b50 00010000:00010000:1.0:1789760783.973235:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.973254:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:1.0:1789760783.973260:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.973268:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.973284:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760783.980345:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985075 is committed 00002000:00010000:1.0:1789760783.980817:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72773632 -> 72777728 00002000:00010000:1.0:1789760783.980822:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142160 -> 142168 00010000:00010000:1.0:1789760783.980834:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980845:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980854:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980860:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760783.980864:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980880:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980898:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.980910:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674e4e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72773632->72777727] (req 72773632->72777727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.981116:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565504640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7954us (8654us total) trans 4294985075 rc 0/0 00000100:00100000:1.0:1789760783.981125:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17778 00000100:00100000:1.0:1789760783.981135:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722215980274 time 722233437076 state 0x2 ref 0 00000100:00100000:1.0:1789760783.987942:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760783.988096:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504768 00000100:00100000:2.0:1789760783.988105:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504768 00000100:00100000:2.0:1789760783.988157:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722215980274 time 722233437076 state 0x0 ref 1 00000100:00100000:2.0:1789760783.988231:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722233697492 time 722233437076 state 0x1 ref 1 00000100:00100000:2.0:1789760783.988294:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722233697492 time 722248585095 state 0x0 ref 1 00000100:00100000:2.0:1789760783.988307:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565504768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760783.988356:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72777728, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b58 00010000:00010000:2.0:1789760783.988365:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.988380:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760783.988385:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.988391:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.988410:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760783.996478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985076 is committed 00002000:00010000:2.0:1789760783.996803:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72777728 -> 72781824 00002000:00010000:2.0:1789760783.996808:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142168 -> 142176 00010000:00010000:2.0:1789760783.996822:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996835:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996845:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996852:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760783.996856:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996866:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996884:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.996892:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674e4e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72777728->72781823] (req 72777728->72781823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.000636:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565504768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12319us (12692us total) trans 4294985076 rc 0/0 00000100:00100000:2.0:1789760784.000653:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17779 00000100:00100000:2.0:1789760784.000663:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722233697492 time 722248585095 state 0x2 ref 0 00000100:00100000:2.0:1789760784.005635:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.005745:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565504896 00000100:00100000:3.0:1789760784.005755:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565504896 00000100:00100000:3.0:1789760784.005822:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722233697492 time 722248585095 state 0x0 ref 1 00000100:00100000:3.0:1789760784.005837:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722248845511 time 722248585095 state 0x1 ref 1 00000100:00080000:2.0:1789760784.005912:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760784.005996:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722248845511 time 722266286465 state 0x0 ref 1 00000100:00100000:3.0:1789760784.006012:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.006059:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72781824, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b60 00010000:00010000:3.0:1789760784.006068:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.006090:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.006094:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.006100:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.006114:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.017202:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985077 is committed 00002000:00010000:3.0:1789760784.017323:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72781824 -> 72785920 00002000:00010000:3.0:1789760784.017327:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142176 -> 142184 00010000:00010000:3.0:1789760784.017339:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017351:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017361:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017367:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.017371:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017379:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017403:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.017411:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e4ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72781824->72785919] (req 72781824->72785919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.017501:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565504896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11490us (11872us total) trans 4294985077 rc 0/0 00000100:00100000:3.0:1789760784.017510:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17780 00000100:00100000:3.0:1789760784.017519:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722248845511 time 722266286465 state 0x2 ref 0 00000100:00100000:3.0:1789760784.023362:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760784.023589:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505024 00000100:00100000:1.0:1789760784.023599:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505024 00000100:00100000:1.0:1789760784.023660:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722248845511 time 722266286465 state 0x0 ref 1 00000100:00100000:1.0:1789760784.023674:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722266546881 time 722266286465 state 0x1 ref 1 00000100:00100000:1.0:1789760784.023748:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722266546881 time 722284039902 state 0x0 ref 1 00000100:00100000:1.0:1789760784.023761:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565505024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760784.023803:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72785920, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b68 00010000:00010000:1.0:1789760784.023812:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.023826:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:1.0:1789760784.023830:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760784.023837:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.023850:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.030416:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985078 is committed 00002000:00010000:0.0:1789760784.030572:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72785920 -> 72790016 00002000:00010000:0.0:1789760784.030576:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142184 -> 142192 00010000:00010000:0.0:1789760784.030587:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030596:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030602:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030610:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.030614:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030619:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030740:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.030748:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674e4f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72785920->72790015] (req 72785920->72790015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.031336:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565505024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7572us (7979us total) trans 4294985078 rc 0/0 00000100:00100000:0.0:1789760784.031347:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17781 00000100:00100000:0.0:1789760784.031356:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722266546881 time 722284039902 state 0x2 ref 0 00000100:00100000:1.0:1789760784.038425:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.038639:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505152 00000100:00100000:2.0:1789760784.038649:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505152 00000100:00100000:2.0:1789760784.038780:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722266546881 time 722284039902 state 0x0 ref 1 00000100:00100000:2.0:1789760784.038795:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722284300318 time 722284039902 state 0x1 ref 1 00000100:00100000:2.0:1789760784.038829:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722284300318 time 722299121346 state 0x0 ref 1 00000100:00100000:2.0:1789760784.038842:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.038891:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72790016, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b70 00010000:00010000:2.0:1789760784.038901:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.038916:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.038920:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.038927:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.038940:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.048213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985079 is committed 00002000:00010000:0.0:1789760784.048382:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72790016 -> 72794112 00002000:00010000:0.0:1789760784.048387:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142192 -> 142200 00010000:00010000:0.0:1789760784.048400:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048414:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048429:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048437:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.048442:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048451:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048472:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.048480:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674e4fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72790016->72794111] (req 72790016->72794111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.048578:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9734us (10157us total) trans 4294985079 rc 0/0 00000100:00100000:0.0:1789760784.048590:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17782 00000100:00100000:0.0:1789760784.048601:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722284300318 time 722299121346 state 0x2 ref 0 00000100:00100000:2.0:1789760784.056944:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.057049:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505280 00000100:00100000:3.0:1789760784.057060:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505280 00000100:00100000:3.0:1789760784.057205:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722284300318 time 722299121346 state 0x0 ref 1 00000100:00100000:3.0:1789760784.057221:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722299381762 time 722299121346 state 0x1 ref 1 00000100:00100000:3.0:1789760784.057396:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722299381762 time 722317683213 state 0x0 ref 1 00000100:00100000:3.0:1789760784.057412:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.057457:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72794112, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b78 00010000:00010000:3.0:1789760784.057466:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.057488:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.057492:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.057498:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.057512:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.064042:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985080 is committed 00002000:00010000:3.0:1789760784.064428:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72794112 -> 72798208 00002000:00010000:3.0:1789760784.064433:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142200 -> 142208 00010000:00010000:3.0:1789760784.064446:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064459:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064468:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064476:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.064481:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064490:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064525:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.064534:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72794112->72798207] (req 72794112->72798207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.064626:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7214us (7688us total) trans 4294985080 rc 0/0 00000100:00100000:3.0:1789760784.064635:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17783 00000100:00100000:3.0:1789760784.064644:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722299381762 time 722317683213 state 0x2 ref 0 00000100:00100000:3.0:1789760784.069140:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.069221:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505408 00000100:00100000:0.0:1789760784.069230:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505408 00000100:00100000:0.0:1789760784.069283:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722299381762 time 722317683213 state 0x0 ref 1 00000100:00100000:0.0:1789760784.069298:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722317943629 time 722317683213 state 0x1 ref 1 00000100:00100000:0.0:1789760784.069324:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722317943629 time 722329616543 state 0x0 ref 1 00000100:00100000:0.0:1789760784.069336:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.069383:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72798208, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b80 00010000:00010000:0.0:1789760784.069392:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.069408:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.069412:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.069418:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.069432:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.076476:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985081 is committed 00002000:00010000:0.0:1789760784.076806:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72798208 -> 72802304 00002000:00010000:0.0:1789760784.076811:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142208 -> 142216 00010000:00010000:0.0:1789760784.076824:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076846:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076854:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076866:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.076871:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076881:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076899:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.076906:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e50b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72798208->72802303] (req 72798208->72802303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.076997:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7658us (7861us total) trans 4294985081 rc 0/0 00000100:00100000:0.0:1789760784.077007:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17784 00000100:00100000:0.0:1789760784.077016:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722317943629 time 722329616543 state 0x2 ref 0 00000100:00100000:1.0:1789760784.083878:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.083970:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505536 00000100:00100000:0.0:1789760784.083980:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505536 00000100:00100000:0.0:1789760784.084030:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722317943629 time 722329616543 state 0x0 ref 1 00000100:00100000:0.0:1789760784.084045:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722329876959 time 722329616543 state 0x1 ref 1 00000100:00100000:0.0:1789760784.084079:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722329876959 time 722344370721 state 0x0 ref 1 00000100:00100000:0.0:1789760784.084095:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.084141:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72802304, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b88 00010000:00010000:0.0:1789760784.084150:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.084165:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.084170:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.084177:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.084191:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.093403:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985082 is committed 00002000:00010000:0.0:1789760784.093586:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72802304 -> 72806400 00002000:00010000:0.0:1789760784.093592:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142216 -> 142224 00010000:00010000:0.0:1789760784.093619:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.093632:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.093643:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.093651:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.093657:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.093666:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.093697:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.095469:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72802304->72806399] (req 72802304->72806399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.095586:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11488us (11711us total) trans 4294985082 rc 0/0 00000100:00100000:0.0:1789760784.095597:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17785 00000100:00100000:0.0:1789760784.095610:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722329876959 time 722344370721 state 0x2 ref 0 00000100:00100000:2.0:1789760784.101869:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.101965:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505664 00000100:00100000:3.0:1789760784.101975:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505664 00000100:00100000:3.0:1789760784.102310:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722329876959 time 722344370721 state 0x0 ref 1 00000100:00100000:3.0:1789760784.102336:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722344631137 time 722344370721 state 0x1 ref 1 00000100:00100000:3.0:1789760784.102421:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722344631137 time 722362711827 state 0x0 ref 1 00000100:00100000:3.0:1789760784.102436:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565505664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.102485:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72806400, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b90 00010000:00010000:3.0:1789760784.102495:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.102520:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.102525:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.102531:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.102546:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.109908:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985083 is committed 00002000:00010000:3.0:1789760784.110223:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72806400 -> 72810496 00002000:00010000:3.0:1789760784.110227:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142224 -> 142232 00010000:00010000:3.0:1789760784.110240:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110253:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110262:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110269:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.110274:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110283:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110307:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.110314:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72806400->72810495] (req 72806400->72810495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.110521:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565505664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8085us (8659us total) trans 4294985083 rc 0/0 00000100:00100000:3.0:1789760784.110531:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17786 00000100:00100000:3.0:1789760784.110541:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722344631137 time 722362711827 state 0x2 ref 0 00000100:00100000:3.0:1789760784.114758:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.114813:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505792 00000100:00100000:0.0:1789760784.114823:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505792 00000100:00100000:0.0:1789760784.114877:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722344631137 time 722362711827 state 0x0 ref 1 00000100:00100000:0.0:1789760784.114893:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722362972243 time 722362711827 state 0x1 ref 1 00000100:00100000:0.0:1789760784.114923:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722362972243 time 722375214140 state 0x0 ref 1 00000100:00100000:0.0:1789760784.114938:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.114988:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72810496, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22b98 00010000:00010000:0.0:1789760784.114998:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.115013:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.115018:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.115024:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.115052:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.121739:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985084 is committed 00002000:00010000:0.0:1789760784.123651:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72810496 -> 72814592 00002000:00010000:0.0:1789760784.123743:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142232 -> 142240 00010000:00010000:0.0:1789760784.123760:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123772:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123782:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123789:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.123795:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123804:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123827:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.123835:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72810496->72814591] (req 72810496->72814591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.123991:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565505792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9051us (9238us total) trans 4294985084 rc 0/0 00000100:00100000:0.0:1789760784.124001:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17787 00000100:00100000:0.0:1789760784.124021:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722362972243 time 722375214140 state 0x2 ref 0 00000100:00100000:1.0:1789760784.128937:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.130449:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565505920 00000100:00100000:0.0:1789760784.130462:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565505920 00000100:00100000:0.0:1789760784.130522:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722362972243 time 722375214140 state 0x0 ref 1 00000100:00100000:0.0:1789760784.130537:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722375474556 time 722375214140 state 0x1 ref 1 00000100:00100000:0.0:1789760784.130614:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722375474556 time 722390905546 state 0x0 ref 1 00000100:00100000:0.0:1789760784.130639:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.130699:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72814592, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ba0 00010000:00010000:0.0:1789760784.130723:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.130740:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.130744:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.130751:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.130765:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.139682:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985085 is committed 00002000:00010000:0.0:1789760784.139895:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72814592 -> 72818688 00002000:00010000:0.0:1789760784.139900:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142240 -> 142248 00010000:00010000:0.0:1789760784.139914:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139926:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139935:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139942:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.139946:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139955:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139973:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.139985:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e527 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72814592->72818687] (req 72814592->72818687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.140074:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565505920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9434us (11141us total) trans 4294985085 rc 0/0 00000100:00100000:0.0:1789760784.140083:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17788 00000100:00100000:0.0:1789760784.140094:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722375474556 time 722390905546 state 0x2 ref 0 00000100:00100000:2.0:1789760784.148484:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.150918:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506048 00000100:00100000:3.0:1789760784.150934:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506048 00000100:00100000:3.0:1789760784.151102:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722375474556 time 722390905546 state 0x0 ref 1 00000100:00100000:3.0:1789760784.151121:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722391165962 time 722390905546 state 0x1 ref 1 00000100:00100000:3.0:1789760784.151158:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722391165962 time 722411449588 state 0x0 ref 1 00000100:00100000:3.0:1789760784.151172:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.151231:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72818688, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ba8 00010000:00010000:3.0:1789760784.151241:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.151271:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.151276:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.151283:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.151297:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.160859:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985086 is committed 00002000:00010000:3.0:1789760784.161058:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72818688 -> 72822784 00002000:00010000:3.0:1789760784.161064:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142248 -> 142256 00010000:00010000:3.0:1789760784.161077:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161090:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161099:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161105:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.161111:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161119:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161145:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.161151:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e52e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72818688->72822783] (req 72818688->72822783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.161242:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10069us (12765us total) trans 4294985086 rc 0/0 00000100:00100000:3.0:1789760784.161252:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17789 00000100:00100000:3.0:1789760784.161261:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722391165962 time 722411449588 state 0x2 ref 0 00000100:00100000:3.0:1789760784.165928:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.166051:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506176 00000100:00100000:0.0:1789760784.166061:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506176 00000100:00100000:0.0:1789760784.166119:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722391165962 time 722411449588 state 0x0 ref 1 00000100:00100000:0.0:1789760784.166136:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722411710004 time 722411449588 state 0x1 ref 1 00000100:00100000:0.0:1789760784.166165:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722411710004 time 722426457466 state 0x0 ref 1 00000100:00100000:0.0:1789760784.166178:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565506176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.166233:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72822784, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bb0 00010000:00010000:0.0:1789760784.166242:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.166259:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.166263:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.166270:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.166288:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.174386:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985087 is committed 00002000:00010000:0.0:1789760784.174513:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72822784 -> 72826880 00002000:00010000:0.0:1789760784.174518:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142256 -> 142264 00010000:00010000:0.0:1789760784.174531:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174544:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174553:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174560:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.174565:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174574:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174657:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.174666:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e535 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72822784->72826879] (req 72822784->72826879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.174813:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565506176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8632us (8892us total) trans 4294985087 rc 0/0 00000100:00100000:0.0:1789760784.174824:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17790 00000100:00100000:0.0:1789760784.174833:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722411710004 time 722426457466 state 0x2 ref 0 00000100:00100000:1.0:1789760784.178784:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.178958:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506304 00000100:00100000:0.0:1789760784.178968:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506304 00000100:00100000:0.0:1789760784.179017:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722411710004 time 722426457466 state 0x0 ref 1 00000100:00100000:0.0:1789760784.179140:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722426717882 time 722426457466 state 0x1 ref 1 00000100:00100000:0.0:1789760784.179194:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722426717882 time 722439486014 state 0x0 ref 1 00000100:00100000:0.0:1789760784.179206:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.179249:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72826880, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bb8 00010000:00010000:0.0:1789760784.179258:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.179273:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.179277:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.179282:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.179295:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.188137:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985088 is committed 00002000:00010000:0.0:1789760784.189038:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72826880 -> 72830976 00002000:00010000:0.0:1789760784.189045:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142264 -> 142272 00010000:00010000:0.0:1789760784.189057:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189128:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189138:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189145:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.189149:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189158:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189177:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.189186:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e53c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72826880->72830975] (req 72826880->72830975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.189621:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10190us (10618us total) trans 4294985088 rc 0/0 00000100:00100000:0.0:1789760784.189635:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17791 00000100:00100000:0.0:1789760784.189645:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722426717882 time 722439486014 state 0x2 ref 0 00000100:00100000:2.0:1789760784.194489:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.194738:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506432 00000100:00100000:3.0:1789760784.194747:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506432 00000100:00100000:3.0:1789760784.194801:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722426717882 time 722439486014 state 0x0 ref 1 00000100:00100000:3.0:1789760784.194816:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722439746430 time 722439486014 state 0x1 ref 1 00000100:00100000:3.0:1789760784.194846:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722439746430 time 722455137963 state 0x0 ref 1 00000100:00100000:3.0:1789760784.194859:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565506432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.194905:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72830976, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bc0 00010000:00010000:3.0:1789760784.194915:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.194936:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.194941:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.194948:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.194963:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.206764:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985089 is committed 00002000:00010000:2.0:1789760784.208331:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72830976 -> 72835072 00002000:00010000:2.0:1789760784.208339:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142272 -> 142280 00010000:00010000:2.0:1789760784.208353:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.208365:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.208372:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.208379:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.208384:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.208393:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.211928:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.211941:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674e543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72830976->72835071] (req 72830976->72835071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.212054:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565506432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17192us (17570us total) trans 4294985089 rc 0/0 00000100:00100000:2.0:1789760784.212291:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17792 00000100:00100000:2.0:1789760784.212301:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722439746430 time 722455137963 state 0x2 ref 0 00000100:00100000:3.0:1789760784.217221:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.217319:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506560 00000100:00100000:0.0:1789760784.217329:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506560 00000100:00100000:0.0:1789760784.217383:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722439746430 time 722455137963 state 0x0 ref 1 00000100:00100000:0.0:1789760784.217397:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722455398379 time 722455137963 state 0x1 ref 1 00000100:00100000:0.0:1789760784.217430:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722455398379 time 722477721435 state 0x0 ref 1 00000100:00100000:0.0:1789760784.217498:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c95b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.217548:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72835072, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bc8 00010000:00010000:0.0:1789760784.217558:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.217573:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.217579:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.217586:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.217600:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.227149:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985090 is committed 00002000:00010000:0.0:1789760784.234181:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72835072 -> 72839168 00002000:00010000:0.0:1789760784.234192:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142280 -> 142288 00010000:00010000:0.0:1789760784.234208:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234220:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234229:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234237:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.234241:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234249:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234271:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.234279:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e54a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72835072->72839167] (req 72835072->72839167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.234381:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16937us (17165us total) trans 4294985090 rc 0/0 00000100:00100000:0.0:1789760784.234391:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17793 00000100:00100000:0.0:1789760784.234400:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722455398379 time 722477721435 state 0x2 ref 0 00000100:00100000:1.0:1789760784.253172:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.253328:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506688 00000100:00100000:0.0:1789760784.253339:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506688 00000100:00100000:0.0:1789760784.253395:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722455398379 time 722477721435 state 0x0 ref 1 00000100:00100000:0.0:1789760784.253410:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722477981851 time 722477721435 state 0x1 ref 1 00000100:00100000:0.0:1789760784.253477:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722477981851 time 722513768193 state 0x0 ref 1 00000100:00100000:0.0:1789760784.253500:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565506688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.253546:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72839168, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bd0 00010000:00010000:0.0:1789760784.253555:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.253571:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.253576:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.253582:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.253596:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.260202:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985091 is committed 00002000:00010000:0.0:1789760784.260372:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72839168 -> 72843264 00002000:00010000:0.0:1789760784.260378:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142288 -> 142296 00010000:00010000:0.0:1789760784.260393:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260412:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260421:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260429:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.260433:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260442:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260464:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.260478:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72839168->72843263] (req 72839168->72843263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.260580:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565506688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7078us (7412us total) trans 4294985091 rc 0/0 00000100:00100000:0.0:1789760784.260591:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17794 00000100:00100000:0.0:1789760784.260600:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722477981851 time 722513768193 state 0x2 ref 0 00000100:00100000:2.0:1789760784.265394:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.265560:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506816 00000100:00100000:0.0:1789760784.265571:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506816 00000100:00100000:0.0:1789760784.265634:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722477981851 time 722513768193 state 0x0 ref 1 00000100:00100000:0.0:1789760784.265651:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722514028609 time 722513768193 state 0x1 ref 1 00000100:00100000:0.0:1789760784.265695:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722514028609 time 722525986297 state 0x0 ref 1 00000100:00100000:0.0:1789760784.265748:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565506816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.265807:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72843264, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bd8 00010000:00010000:0.0:1789760784.265817:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.265834:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.265838:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.265845:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.265858:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.272402:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985092 is committed 00002000:00010000:0.0:1789760784.272772:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72843264 -> 72847360 00002000:00010000:0.0:1789760784.272778:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142296 -> 142304 00010000:00010000:0.0:1789760784.272792:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272803:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272818:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272827:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.272832:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272841:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272862:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.272870:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72843264->72847359] (req 72843264->72847359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.273100:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565506816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7389us (7708us total) trans 4294985092 rc 0/0 00000100:00100000:0.0:1789760784.273111:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17795 00000100:00100000:0.0:1789760784.273120:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722514028609 time 722525986297 state 0x2 ref 0 00000100:00100000:3.0:1789760784.279412:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.279508:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565506944 00000100:00100000:0.0:1789760784.279517:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565506944 00000100:00100000:0.0:1789760784.279569:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722514028609 time 722525986297 state 0x0 ref 1 00000100:00100000:0.0:1789760784.279582:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722526246713 time 722525986297 state 0x1 ref 1 00000100:00100000:0.0:1789760784.279663:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722526246713 time 722539954321 state 0x0 ref 1 00000100:00100000:0.0:1789760784.279676:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.279757:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72847360, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22be0 00010000:00010000:0.0:1789760784.279767:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.279784:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.279788:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.279794:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.279807:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.287017:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985093 is committed 00002000:00010000:0.0:1789760784.288122:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72847360 -> 72851456 00002000:00010000:0.0:1789760784.288130:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142304 -> 142312 00010000:00010000:0.0:1789760784.288143:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288155:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288164:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288177:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.288182:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288191:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288211:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.288219:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e55f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72847360->72851455] (req 72847360->72851455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.288322:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565506944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8643us (8913us total) trans 4294985093 rc 0/0 00000100:00100000:0.0:1789760784.288332:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17796 00000100:00100000:0.0:1789760784.288342:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722526246713 time 722539954321 state 0x2 ref 0 00000100:00100000:1.0:1789760784.293880:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.293983:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507072 00000100:00100000:0.0:1789760784.293993:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507072 00000100:00100000:0.0:1789760784.294050:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722526246713 time 722539954321 state 0x0 ref 1 00000100:00100000:0.0:1789760784.294076:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722540214737 time 722539954321 state 0x1 ref 1 00000100:00100000:0.0:1789760784.294096:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722540214737 time 722554388990 state 0x0 ref 1 00000100:00100000:0.0:1789760784.294111:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.294157:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72851456, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22be8 00010000:00010000:0.0:1789760784.294166:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.294182:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.294187:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.294193:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.294207:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.300061:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985094 is committed 00002000:00010000:0.0:1789760784.300259:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72851456 -> 72855552 00002000:00010000:0.0:1789760784.300265:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142312 -> 142320 00010000:00010000:0.0:1789760784.300278:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300291:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300300:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300308:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.300313:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300323:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300343:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.300351:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72851456->72855551] (req 72851456->72855551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.300445:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6331us (6569us total) trans 4294985094 rc 0/0 00000100:00100000:0.0:1789760784.300456:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17797 00000100:00100000:0.0:1789760784.300464:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722540214737 time 722554388990 state 0x2 ref 0 00000100:00100000:2.0:1789760784.305839:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.309428:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507200 00000100:00100000:0.0:1789760784.309443:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507200 00000100:00100000:0.0:1789760784.309504:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722540214737 time 722554388990 state 0x0 ref 1 00000100:00100000:0.0:1789760784.309519:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722554649406 time 722554388990 state 0x1 ref 1 00000100:00100000:0.0:1789760784.309542:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722554649406 time 722569834621 state 0x0 ref 1 00000100:00100000:0.0:1789760784.309566:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565507200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.309617:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72855552, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bf0 00010000:00010000:0.0:1789760784.309627:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.309643:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.309647:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.309653:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.309667:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.314623:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985095 is committed 00002000:00010000:0.0:1789760784.314995:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72855552 -> 72859648 00002000:00010000:0.0:1789760784.315000:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142320 -> 142328 00010000:00010000:0.0:1789760784.315013:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315026:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315035:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315043:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.315048:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315058:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315078:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.315086:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e56d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72855552->72859647] (req 72855552->72859647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.315186:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565507200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5627us (9348us total) trans 4294985095 rc 0/0 00000100:00100000:0.0:1789760784.315196:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17798 00000100:00100000:0.0:1789760784.315206:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722554649406 time 722569834621 state 0x2 ref 0 00000100:00100000:3.0:1789760784.320279:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.320739:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507328 00000100:00100000:0.0:1789760784.320750:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507328 00000100:00100000:0.0:1789760784.320805:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722554649406 time 722569834621 state 0x0 ref 1 00000100:00100000:0.0:1789760784.320819:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722570095037 time 722569834621 state 0x1 ref 1 00000100:00100000:0.0:1789760784.320839:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722570095037 time 722581131543 state 0x0 ref 1 00000100:00100000:0.0:1789760784.320851:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.320898:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72859648, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22bf8 00010000:00010000:0.0:1789760784.320908:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.320923:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.320928:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.320934:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.320947:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.328326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985096 is committed 00002000:00010000:0.0:1789760784.328555:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72859648 -> 72863744 00002000:00010000:0.0:1789760784.328561:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142328 -> 142336 00010000:00010000:0.0:1789760784.328573:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328585:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328595:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328603:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.328608:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328617:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328793:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.328809:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e574 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72859648->72863743] (req 72859648->72863743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.329001:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8147us (8737us total) trans 4294985096 rc 0/0 00000100:00100000:0.0:1789760784.329011:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17799 00000100:00100000:0.0:1789760784.329020:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722570095037 time 722581131543 state 0x2 ref 0 00000100:00100000:1.0:1789760784.334239:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.334330:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507456 00000100:00100000:0.0:1789760784.334341:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507456 00000100:00100000:0.0:1789760784.334397:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722570095037 time 722581131543 state 0x0 ref 1 00000100:00100000:0.0:1789760784.334412:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722581391959 time 722581131543 state 0x1 ref 1 00000100:00100000:0.0:1789760784.334442:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722581391959 time 722594733716 state 0x0 ref 1 00000100:00100000:0.0:1789760784.334454:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565507456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.334506:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72863744, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c00 00010000:00010000:0.0:1789760784.334516:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.334533:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.334537:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.334544:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.334564:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.345195:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985097 is committed 00002000:00010000:0.0:1789760784.345509:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72863744 -> 72867840 00002000:00010000:0.0:1789760784.345514:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142336 -> 142344 00010000:00010000:0.0:1789760784.345530:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345544:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345554:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345562:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.345567:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345576:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345595:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.345603:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e57b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72863744->72867839] (req 72863744->72867839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.346180:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565507456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11722us (11944us total) trans 4294985097 rc 0/0 00000100:00100000:0.0:1789760784.346192:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17800 00000100:00100000:0.0:1789760784.346201:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722581391959 time 722594733716 state 0x2 ref 0 00000100:00100000:2.0:1789760784.359475:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.359574:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507584 00000100:00100000:0.0:1789760784.359583:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507584 00000100:00100000:0.0:1789760784.359656:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722581391959 time 722594733716 state 0x0 ref 1 00000100:00100000:0.0:1789760784.359670:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722594994132 time 722594733716 state 0x1 ref 1 00000100:00100000:0.0:1789760784.359740:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722594994132 time 722620031872 state 0x0 ref 1 00000100:00100000:0.0:1789760784.359753:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565507584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.359798:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72867840, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c08 00010000:00010000:0.0:1789760784.359807:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.359821:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.359825:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.359832:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.359845:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.370750:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985098 is committed 00002000:00010000:0.0:1789760784.371203:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72867840 -> 72871936 00002000:00010000:0.0:1789760784.371207:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142344 -> 142352 00010000:00010000:0.0:1789760784.371220:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371231:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371239:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371245:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.371250:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371258:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371276:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.371284:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e582 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72867840->72871935] (req 72867840->72871935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.371376:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565507584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11621us (11906us total) trans 4294985098 rc 0/0 00000100:00100000:0.0:1789760784.371387:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17801 00000100:00100000:0.0:1789760784.371397:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722594994132 time 722620031872 state 0x2 ref 0 00000100:00100000:3.0:1789760784.380814:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.380950:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507712 00000100:00100000:0.0:1789760784.380960:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507712 00000100:00100000:0.0:1789760784.381013:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722594994132 time 722620031872 state 0x0 ref 1 00000100:00100000:0.0:1789760784.381028:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722620292288 time 722620031872 state 0x1 ref 1 00000100:00100000:0.0:1789760784.381067:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722620292288 time 722641358955 state 0x0 ref 1 00000100:00100000:0.0:1789760784.381079:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.381124:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72871936, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c10 00010000:00010000:0.0:1789760784.381133:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.381148:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.381153:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.381159:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.381173:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.389883:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985099 is committed 00002000:00010000:2.0:1789760784.391803:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72871936 -> 72876032 00002000:00010000:2.0:1789760784.391813:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142352 -> 142360 00010000:00010000:2.0:1789760784.391827:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391841:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391851:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391865:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.391870:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391880:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391900:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.391907:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674e589 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72871936->72876031] (req 72871936->72876031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.392013:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565507712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10931us (11204us total) trans 4294985099 rc 0/0 00000100:00100000:2.0:1789760784.392024:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17802 00000100:00100000:2.0:1789760784.392043:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722620292288 time 722641358955 state 0x2 ref 0 00000100:00100000:1.0:1789760784.400825:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.400965:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507840 00000100:00100000:3.0:1789760784.400975:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507840 00000100:00100000:3.0:1789760784.401040:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722620292288 time 722641358955 state 0x0 ref 1 00000100:00100000:3.0:1789760784.401056:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722641619371 time 722641358955 state 0x1 ref 1 00000100:00100000:3.0:1789760784.401083:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722641619371 time 722661375726 state 0x0 ref 1 00000100:00100000:3.0:1789760784.401096:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565507840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.401149:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72876032, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c18 00010000:00010000:3.0:1789760784.401159:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.401176:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.401180:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.401187:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.401200:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.408223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985100 is committed 00002000:00010000:3.0:1789760784.408392:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72876032 -> 72880128 00002000:00010000:3.0:1789760784.408397:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142360 -> 142368 00010000:00010000:3.0:1789760784.408411:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408424:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408434:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408441:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.408446:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408455:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408480:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.408488:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e590 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72876032->72880127] (req 72876032->72880127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.408583:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565507840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7484us (7762us total) trans 4294985100 rc 0/0 00000100:00100000:3.0:1789760784.408593:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17803 00000100:00100000:3.0:1789760784.408603:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722641619371 time 722661375726 state 0x2 ref 0 00000100:00100000:1.0:1789760784.415510:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.415617:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565507968 00000100:00100000:0.0:1789760784.415700:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565507968 00000100:00100000:0.0:1789760784.415956:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722641619371 time 722661375726 state 0x0 ref 1 00000100:00100000:0.0:1789760784.415972:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722661636142 time 722661375726 state 0x1 ref 1 00000100:00100000:0.0:1789760784.416049:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722661636142 time 722676341168 state 0x0 ref 1 00000100:00100000:0.0:1789760784.416064:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565507968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.416111:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72880128, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c20 00010000:00010000:0.0:1789760784.416121:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.416136:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.416141:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.416147:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.416171:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.421905:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985101 is committed 00002000:00010000:0.0:1789760784.422084:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72880128 -> 72884224 00002000:00010000:0.0:1789760784.422091:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142368 -> 142376 00010000:00010000:0.0:1789760784.422106:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422120:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422130:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422138:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.422143:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422153:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422174:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.422183:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e597 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72880128->72884223] (req 72880128->72884223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.422314:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565507968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6249us (6810us total) trans 4294985101 rc 0/0 00000100:00100000:0.0:1789760784.422325:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17804 00000100:00100000:0.0:1789760784.422334:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722661636142 time 722676341168 state 0x2 ref 0 00000100:00100000:0.0:1789760784.426577:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.426671:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508096 00000100:00100000:2.0:1789760784.426692:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508096 00000100:00100000:2.0:1789760784.426782:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722661636142 time 722676341168 state 0x0 ref 1 00000100:00100000:2.0:1789760784.426798:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722676601584 time 722676341168 state 0x1 ref 1 00000100:00100000:2.0:1789760784.426829:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722676601584 time 722687121666 state 0x0 ref 1 00000100:00100000:2.0:1789760784.426847:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.426894:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72884224, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c28 00010000:00010000:2.0:1789760784.426903:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.426921:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.426926:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.426933:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.426946:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.436088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985102 is committed 00002000:00010000:2.0:1789760784.436316:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72884224 -> 72888320 00002000:00010000:2.0:1789760784.436321:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142376 -> 142384 00010000:00010000:2.0:1789760784.436334:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436346:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436356:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436363:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.436369:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436378:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436397:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.436405:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e59e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72884224->72888319] (req 72884224->72888319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.436553:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9704us (9981us total) trans 4294985102 rc 0/0 00000100:00100000:2.0:1789760784.436563:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17805 00000100:00100000:2.0:1789760784.436573:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722676601584 time 722687121666 state 0x2 ref 0 00000100:00100000:1.0:1789760784.443520:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.443616:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508224 00000100:00100000:3.0:1789760784.443698:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508224 00000100:00100000:0.0:1789760784.444137:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722676601584 time 722687121666 state 0x0 ref 1 00000100:00100000:0.0:1789760784.444281:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722687382082 time 722687121666 state 0x1 ref 1 00000100:00100000:0.0:1789760784.444356:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722687382082 time 722704646186 state 0x0 ref 1 00000100:00100000:0.0:1789760784.444372:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.444420:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72888320, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c30 00010000:00010000:0.0:1789760784.444430:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.444445:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.444450:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.444456:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.444472:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.452085:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985103 is committed 00002000:00010000:0.0:1789760784.452160:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72888320 -> 72892416 00002000:00010000:0.0:1789760784.452166:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142384 -> 142392 00010000:00010000:0.0:1789760784.452181:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452194:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452203:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452217:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.452222:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452231:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452249:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.452256:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72888320->72892415] (req 72888320->72892415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.452917:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7991us (8850us total) trans 4294985103 rc 0/0 00000100:00100000:0.0:1789760784.452931:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17806 00000100:00100000:0.0:1789760784.452940:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722687382082 time 722704646186 state 0x2 ref 0 00000100:00100000:1.0:1789760784.463538:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.463618:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508352 00000100:00100000:0.0:1789760784.463637:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508352 00000100:00100000:0.0:1789760784.463734:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722687382082 time 722704646186 state 0x0 ref 1 00000100:00100000:0.0:1789760784.463751:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722704906602 time 722704646186 state 0x1 ref 1 00000100:00100000:0.0:1789760784.463919:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722704906602 time 722724209864 state 0x0 ref 1 00000100:00100000:0.0:1789760784.463937:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.463987:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72892416, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c38 00010000:00010000:0.0:1789760784.463996:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.464010:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.464015:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.464021:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.464044:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.471961:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985104 is committed 00002000:00010000:0.0:1789760784.478735:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72892416 -> 72896512 00002000:00010000:0.0:1789760784.478745:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142392 -> 142400 00010000:00010000:0.0:1789760784.478758:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478776:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478785:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478793:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.478798:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478807:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478827:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.478834:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72892416->72896511] (req 72892416->72896511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.478932:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14994us (15400us total) trans 4294985104 rc 0/0 00000100:00100000:0.0:1789760784.478944:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17807 00000100:00100000:0.0:1789760784.478953:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722704906602 time 722724209864 state 0x2 ref 0 00000100:00100000:3.0:1789760784.486575:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.486672:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508480 00000100:00100000:2.0:1789760784.486691:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508480 00000100:00100000:2.0:1789760784.486781:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722704906602 time 722724209864 state 0x0 ref 1 00000100:00100000:2.0:1789760784.486797:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722724470280 time 722724209864 state 0x1 ref 1 00000100:00100000:2.0:1789760784.486828:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722724470280 time 722747120767 state 0x0 ref 1 00000100:00100000:2.0:1789760784.486841:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565508480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.486890:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72896512, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c40 00010000:00010000:2.0:1789760784.486900:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.486915:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.486920:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.486925:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.486938:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.492122:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985105 is committed 00002000:00010000:0.0:1789760784.492333:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72896512 -> 72900608 00002000:00010000:0.0:1789760784.492339:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142400 -> 142408 00010000:00010000:0.0:1789760784.492353:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492366:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492375:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492388:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.492394:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492402:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492420:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.492486:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e5b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72896512->72900607] (req 72896512->72900607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.492844:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565508480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6001us (6275us total) trans 4294985105 rc 0/0 00000100:00100000:0.0:1789760784.492855:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17808 00000100:00100000:0.0:1789760784.492864:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722724470280 time 722747120767 state 0x2 ref 0 00000100:00100000:1.0:1789760784.500965:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.501061:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508608 00000100:00100000:0.0:1789760784.501072:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508608 00000100:00100000:0.0:1789760784.501129:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722724470280 time 722747120767 state 0x0 ref 1 00000100:00100000:0.0:1789760784.501142:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722747381183 time 722747120767 state 0x1 ref 1 00000100:00100000:0.0:1789760784.501174:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722747381183 time 722761466076 state 0x0 ref 1 00000100:00100000:0.0:1789760784.501190:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.501237:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72900608, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c48 00010000:00010000:0.0:1789760784.501246:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.501261:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.501265:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.501271:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.501285:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.507375:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985106 is committed 00002000:00010000:0.0:1789760784.507513:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72900608 -> 72904704 00002000:00010000:0.0:1789760784.507519:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142408 -> 142416 00010000:00010000:0.0:1789760784.507534:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507547:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507557:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507564:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.507570:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507579:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507599:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.507606:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72900608->72904703] (req 72900608->72904703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.507752:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6560us (6793us total) trans 4294985106 rc 0/0 00000100:00100000:0.0:1789760784.507763:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17809 00000100:00100000:0.0:1789760784.507773:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722747381183 time 722761466076 state 0x2 ref 0 00000100:00100000:1.0:1789760784.520857:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.521173:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508736 00000100:00100000:2.0:1789760784.521183:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508736 00000100:00100000:2.0:1789760784.521238:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722747381183 time 722761466076 state 0x0 ref 1 00000100:00100000:2.0:1789760784.521253:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722761726492 time 722761466076 state 0x1 ref 1 00000100:00100000:2.0:1789760784.521284:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722761726492 time 722781575708 state 0x0 ref 1 00000100:00100000:2.0:1789760784.521297:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.521345:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72904704, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c50 00010000:00010000:2.0:1789760784.521354:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.521377:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.521382:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.521387:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.521402:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.534191:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985107 is committed 00002000:00010000:2.0:1789760784.538948:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72904704 -> 72908800 00002000:00010000:2.0:1789760784.539026:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142416 -> 142424 00010000:00010000:2.0:1789760784.539041:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539054:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539063:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539071:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.539076:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539085:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539110:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.539118:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72904704->72908799] (req 72904704->72908799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.539218:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17919us (18368us total) trans 4294985107 rc 0/0 00000100:00100000:2.0:1789760784.539229:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17810 00000100:00100000:2.0:1789760784.539311:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722761726492 time 722781575708 state 0x2 ref 0 00000100:00100000:3.0:1789760784.542216:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.542986:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508864 00000100:00100000:0.0:1789760784.542996:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508864 00000100:00100000:3.0:1789760784.543245:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722761726492 time 722781575708 state 0x0 ref 1 00000100:00100000:3.0:1789760784.543261:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722781836124 time 722781575708 state 0x1 ref 1 00000100:00100000:3.0:1789760784.543328:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722781836124 time 722803619613 state 0x0 ref 1 00000100:00100000:3.0:1789760784.543343:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.543390:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72908800, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c58 00010000:00010000:3.0:1789760784.543399:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.543414:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.543418:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.543424:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.543437:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.549041:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985108 is committed 00002000:00010000:3.0:1789760784.549154:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72908800 -> 72912896 00002000:00010000:3.0:1789760784.549159:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142424 -> 142432 00010000:00010000:3.0:1789760784.549172:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549184:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549193:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549201:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.549206:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549216:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549235:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.549243:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72908800->72912895] (req 72908800->72912895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.549333:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5989us (7121us total) trans 4294985108 rc 0/0 00000100:00100000:3.0:1789760784.549344:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17811 00000100:00100000:3.0:1789760784.549354:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722781836124 time 722803619613 state 0x2 ref 0 00000100:00100000:1.0:1789760784.553199:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.553292:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565508992 00000100:00100000:0.0:1789760784.553302:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565508992 00000100:00100000:0.0:1789760784.553356:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722781836124 time 722803619613 state 0x0 ref 1 00000100:00100000:0.0:1789760784.553369:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722803880029 time 722803619613 state 0x1 ref 1 00000100:00100000:0.0:1789760784.553399:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722803880029 time 722813691329 state 0x0 ref 1 00000100:00100000:0.0:1789760784.553412:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.553471:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72912896, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c60 00010000:00010000:0.0:1789760784.553480:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.553495:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.553500:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.553505:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.553519:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.561410:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985109 is committed 00002000:00010000:0.0:1789760784.561533:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72912896 -> 72916992 00002000:00010000:0.0:1789760784.561538:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142432 -> 142440 00010000:00010000:0.0:1789760784.561551:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561564:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561573:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561581:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.561586:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561601:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561631:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.561640:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72912896->72916991] (req 72912896->72916991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.561797:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565508992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8382us (8602us total) trans 4294985109 rc 0/0 00000100:00100000:0.0:1789760784.561807:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17812 00000100:00100000:0.0:1789760784.561816:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722803880029 time 722813691329 state 0x2 ref 0 00000100:00100000:1.0:1789760784.570889:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.571572:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509120 00000100:00100000:2.0:1789760784.571584:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509120 00000100:00100000:2.0:1789760784.571642:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722803880029 time 722813691329 state 0x0 ref 1 00000100:00100000:2.0:1789760784.571656:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722813951745 time 722813691329 state 0x1 ref 1 00000100:00100000:2.0:1789760784.571698:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722813951745 time 722831989980 state 0x0 ref 1 00000100:00100000:2.0:1789760784.571747:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565509120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.571807:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72916992, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c68 00010000:00010000:2.0:1789760784.571816:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.571832:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.571837:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.571844:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.571857:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.579381:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985110 is committed 00002000:00010000:3.0:1789760784.579519:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72916992 -> 72921088 00002000:00010000:3.0:1789760784.579525:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142440 -> 142448 00010000:00010000:3.0:1789760784.579538:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579550:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579558:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579564:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.579569:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579582:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579600:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.579607:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674e5d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72916992->72921087] (req 72916992->72921087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.579748:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565509120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7999us (8867us total) trans 4294985110 rc 0/0 00000100:00100000:3.0:1789760784.579759:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17813 00000100:00100000:3.0:1789760784.579776:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722813951745 time 722831989980 state 0x2 ref 0 00000100:00100000:3.0:1789760784.585094:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.585312:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509248 00000100:00100000:2.0:1789760784.585322:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509248 00000100:00100000:2.0:1789760784.585374:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722813951745 time 722831989980 state 0x0 ref 1 00000100:00100000:2.0:1789760784.585388:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722832250396 time 722831989980 state 0x1 ref 1 00000100:00100000:2.0:1789760784.585408:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722832250396 time 722845701438 state 0x0 ref 1 00000100:00100000:2.0:1789760784.585421:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565509248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.585474:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72921088, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c70 00010000:00010000:2.0:1789760784.585483:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.585499:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.585503:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.585508:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.585521:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.588079:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760784.595414:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985111 is committed 00002000:00010000:3.0:1789760784.595668:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72921088 -> 72925184 00002000:00010000:3.0:1789760784.595674:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142448 -> 142456 00010000:00010000:3.0:1789760784.595699:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595733:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595743:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595752:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.595757:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595849:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595871:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.595880:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e5dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72921088->72925183] (req 72921088->72925183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.596142:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565509248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10718us (11052us total) trans 4294985111 rc 0/0 00000100:00100000:3.0:1789760784.596154:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17814 00000100:00100000:3.0:1789760784.596164:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722832250396 time 722845701438 state 0x2 ref 0 00000100:00100000:1.0:1789760784.599884:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.600046:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509376 00000100:00100000:0.0:1789760784.600057:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509376 00000100:00100000:0.0:1789760784.600115:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722832250396 time 722845701438 state 0x0 ref 1 00000100:00100000:0.0:1789760784.600129:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722845961854 time 722845701438 state 0x1 ref 1 00000100:00100000:0.0:1789760784.600160:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722845961854 time 722860452099 state 0x0 ref 1 00000100:00100000:0.0:1789760784.600172:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.600220:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72925184, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c78 00010000:00010000:0.0:1789760784.600230:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.600247:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1789760784.600251:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.600257:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.600273:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760784.607693:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985112 is committed 00002000:00010000:1.0:1789760784.607873:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72925184 -> 72929280 00002000:00010000:1.0:1789760784.607878:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142456 -> 142464 00010000:00010000:1.0:1789760784.607891:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.607910:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.607920:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.608079:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760784.608086:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.608096:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.608116:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.608125:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e5e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72925184->72929279] (req 72925184->72929279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.608253:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8079us (8376us total) trans 4294985112 rc 0/0 00000100:00100000:1.0:1789760784.608264:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17815 00000100:00100000:1.0:1789760784.608273:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722845961854 time 722860452099 state 0x2 ref 0 00000100:00100000:1.0:1789760784.614344:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.614442:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509504 00000100:00100000:3.0:1789760784.614452:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509504 00000100:00100000:3.0:1789760784.614510:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722845961854 time 722860452099 state 0x0 ref 1 00000100:00100000:3.0:1789760784.614526:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722860712515 time 722860452099 state 0x1 ref 1 00000100:00100000:3.0:1789760784.614558:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722860712515 time 722874849553 state 0x0 ref 1 00000100:00100000:3.0:1789760784.614572:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.614620:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72929280, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c80 00010000:00010000:3.0:1789760784.614640:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.614658:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.614662:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.614669:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.614694:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.623602:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985113 is committed 00002000:00010000:3.0:1789760784.623864:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72929280 -> 72933376 00002000:00010000:3.0:1789760784.623870:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142464 -> 142472 00010000:00010000:3.0:1789760784.623885:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623899:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623909:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623917:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.623923:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623932:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623952:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.623960:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e5eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72929280->72933375] (req 72929280->72933375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.624211:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9637us (9871us total) trans 4294985113 rc 0/0 00000100:00100000:3.0:1789760784.624221:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17816 00000100:00100000:3.0:1789760784.624231:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722860712515 time 722874849553 state 0x2 ref 0 00000100:00100000:0.0:1789760784.627400:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.627690:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509632 00000100:00100000:3.0:1789760784.627701:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509632 00000100:00100000:3.0:1789760784.628138:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722860712515 time 722874849553 state 0x0 ref 1 00000100:00100000:3.0:1789760784.628156:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722875109969 time 722874849553 state 0x1 ref 1 00000100:00100000:3.0:1789760784.628189:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722875109969 time 722888481248 state 0x0 ref 1 00000100:00100000:3.0:1789760784.628203:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565509632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.628257:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72933376, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c88 00010000:00010000:3.0:1789760784.628268:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.628285:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.628290:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.628297:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.628311:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.632477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985114 is committed 00002000:00010000:3.0:1789760784.632595:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72933376 -> 72937472 00002000:00010000:3.0:1789760784.632600:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142472 -> 142480 00010000:00010000:3.0:1789760784.632612:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632626:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632635:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632642:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.632647:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632656:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632676:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.632694:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e5f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72933376->72937471] (req 72933376->72937471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.632995:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565509632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4792us (5601us total) trans 4294985114 rc 0/0 00000100:00100000:3.0:1789760784.633006:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17817 00000100:00100000:3.0:1789760784.633014:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722875109969 time 722888481248 state 0x2 ref 0 00000100:00100000:1.0:1789760784.642104:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.642260:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509760 00000100:00100000:2.0:1789760784.642269:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509760 00000100:00100000:2.0:1789760784.642323:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722875109969 time 722888481248 state 0x0 ref 1 00000100:00100000:2.0:1789760784.642339:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722888741664 time 722888481248 state 0x1 ref 1 00000100:00100000:2.0:1789760784.642371:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722888741664 time 722902663155 state 0x0 ref 1 00000100:00100000:2.0:1789760784.642385:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.642430:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72937472, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c90 00010000:00010000:2.0:1789760784.642440:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.642456:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.642460:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.642467:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.642481:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.648146:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985115 is committed 00002000:00010000:2.0:1789760784.648490:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72937472 -> 72941568 00002000:00010000:2.0:1789760784.648496:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142480 -> 142488 00010000:00010000:2.0:1789760784.648510:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648524:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648533:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648541:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.648546:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648554:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648573:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.648581:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e5f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72937472->72941567] (req 72937472->72941567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.649001:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565509760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6613us (6902us total) trans 4294985115 rc 0/0 00000100:00100000:2.0:1789760784.649013:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17818 00000100:00100000:2.0:1789760784.649022:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722888741664 time 722902663155 state 0x2 ref 0 00000100:00100000:1.0:1789760784.660929:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.661096:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565509888 00000100:00100000:3.0:1789760784.661107:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565509888 00000100:00100000:3.0:1789760784.661163:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722888741664 time 722902663155 state 0x0 ref 1 00000100:00100000:3.0:1789760784.661180:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722902923571 time 722902663155 state 0x1 ref 1 00000100:00100000:3.0:1789760784.661326:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722902923571 time 722921617182 state 0x0 ref 1 00000100:00100000:3.0:1789760784.661340:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565509888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.661385:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72941568, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22c98 00010000:00010000:3.0:1789760784.661395:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.661412:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.661418:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.661424:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.661439:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.671376:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985116 is committed 00002000:00010000:3.0:1789760784.671780:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72941568 -> 72945664 00002000:00010000:3.0:1789760784.671786:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142488 -> 142496 00010000:00010000:3.0:1789760784.671801:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671814:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671822:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671828:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.671833:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671841:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671866:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.671879:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72941568->72945663] (req 72941568->72945663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.671965:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565509888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10623us (11114us total) trans 4294985116 rc 0/0 00000100:00100000:3.0:1789760784.671974:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17819 00000100:00100000:3.0:1789760784.671983:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722902923571 time 722921617182 state 0x2 ref 0 00000100:00100000:0.0:1789760784.683882:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.684076:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510016 00000100:00100000:3.0:1789760784.684086:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510016 00000100:00100000:3.0:1789760784.684142:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722902923571 time 722921617182 state 0x0 ref 1 00000100:00100000:3.0:1789760784.684159:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722921877598 time 722921617182 state 0x1 ref 1 00000100:00100000:3.0:1789760784.684180:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722921877598 time 722944472347 state 0x0 ref 1 00000100:00100000:3.0:1789760784.684192:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.684240:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72945664, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ca0 00010000:00010000:3.0:1789760784.684250:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.684264:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.684269:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.684276:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.684296:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.691869:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985117 is committed 00002000:00010000:2.0:1789760784.692102:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72945664 -> 72949760 00002000:00010000:2.0:1789760784.692107:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142496 -> 142504 00010000:00010000:2.0:1789760784.692121:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692133:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692142:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692148:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.692153:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692161:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692180:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.692186:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674e607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72945664->72949759] (req 72945664->72949759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.692944:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8747us (9065us total) trans 4294985117 rc 0/0 00000100:00100000:2.0:1789760784.692960:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17820 00000100:00100000:2.0:1789760784.692969:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722921877598 time 722944472347 state 0x2 ref 0 00000100:00100000:1.0:1789760784.704075:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.704167:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510144 00000100:00100000:2.0:1789760784.704176:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510144 00000100:00100000:2.0:1789760784.704226:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722921877598 time 722944472347 state 0x0 ref 1 00000100:00100000:2.0:1789760784.704242:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722944732763 time 722944472347 state 0x1 ref 1 00000100:00100000:2.0:1789760784.704272:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722944732763 time 722964563520 state 0x0 ref 1 00000100:00100000:2.0:1789760784.704284:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565510144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.704334:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72949760, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ca8 00010000:00010000:2.0:1789760784.704344:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.704362:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.704367:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.704373:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.704386:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.711598:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985118 is committed 00002000:00010000:2.0:1789760784.711751:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72949760 -> 72953856 00002000:00010000:2.0:1789760784.711756:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142504 -> 142512 00010000:00010000:2.0:1789760784.711770:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711783:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711791:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711799:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.711804:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711812:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711832:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.711840:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e60e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72949760->72953855] (req 72949760->72953855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.711921:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565510144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7634us (7851us total) trans 4294985118 rc 0/0 00000100:00100000:2.0:1789760784.711931:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17821 00000100:00100000:2.0:1789760784.711941:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722944732763 time 722964563520 state 0x2 ref 0 00000100:00100000:1.0:1789760784.714878:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.715093:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510272 00000100:00100000:3.0:1789760784.715103:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510272 00000100:00100000:3.0:1789760784.715157:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722944732763 time 722964563520 state 0x0 ref 1 00000100:00100000:3.0:1789760784.715173:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722964823936 time 722964563520 state 0x1 ref 1 00000100:00100000:3.0:1789760784.715202:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722964823936 time 722975494377 state 0x0 ref 1 00000100:00100000:3.0:1789760784.715213:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565510272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.715259:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72953856, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cb0 00010000:00010000:3.0:1789760784.715268:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.715283:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1789760784.715287:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.715293:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.715306:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.720980:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985119 is committed 00002000:00010000:2.0:1789760784.721154:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72953856 -> 72957952 00002000:00010000:2.0:1789760784.721159:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142512 -> 142520 00010000:00010000:2.0:1789760784.721172:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721183:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721192:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721199:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.721204:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721214:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721280:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.721289:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674e615 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72953856->72957951] (req 72953856->72957951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.721429:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565510272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6213us (6556us total) trans 4294985119 rc 0/0 00000100:00100000:2.0:1789760784.721443:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17822 00000100:00100000:2.0:1789760784.721455:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722964823936 time 722975494377 state 0x2 ref 0 00000100:00100000:0.0:1789760784.729328:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.729429:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510400 00000100:00100000:2.0:1789760784.729439:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510400 00000100:00100000:2.0:1789760784.729492:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722964823936 time 722975494377 state 0x0 ref 1 00000100:00100000:2.0:1789760784.729507:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722975754793 time 722975494377 state 0x1 ref 1 00000100:00100000:2.0:1789760784.729541:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722975754793 time 722989832380 state 0x0 ref 1 00000100:00100000:2.0:1789760784.729554:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.729616:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72957952, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cb8 00010000:00010000:2.0:1789760784.729636:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.729653:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=722s v=(0 0) 00010000:00010000:2.0:1789760784.729658:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.729665:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.729688:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.736400:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985120 is committed 00002000:00010000:2.0:1789760784.737332:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72957952 -> 72962048 00002000:00010000:2.0:1789760784.737340:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142520 -> 142528 00010000:00010000:2.0:1789760784.737355:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737368:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737377:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737385:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.737390:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737399:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737419:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.737426:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e61c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72957952->72962047] (req 72957952->72962047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.737532:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7967us (8200us total) trans 4294985120 rc 0/0 00000100:00100000:2.0:1789760784.737542:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17823 00000100:00100000:2.0:1789760784.737551:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722975754793 time 722989832380 state 0x2 ref 0 00000100:00100000:1.0:1789760784.742357:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.742509:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510528 00000100:00100000:2.0:1789760784.742518:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510528 00000100:00100000:2.0:1789760784.742565:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722975754793 time 722989832380 state 0x0 ref 1 00000100:00100000:2.0:1789760784.742581:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722990092796 time 722989832380 state 0x1 ref 1 00000100:00100000:2.0:1789760784.742646:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722990092796 time 723002937896 state 0x0 ref 1 00000100:00100000:2.0:1789760784.742659:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565510528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.742740:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72962048, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cc0 00010000:00010000:2.0:1789760784.742749:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.742764:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.742768:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.742774:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.742789:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.750779:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985121 is committed 00002000:00010000:2.0:1789760784.750912:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72962048 -> 72966144 00002000:00010000:2.0:1789760784.750917:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142528 -> 142536 00010000:00010000:2.0:1789760784.750930:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.750948:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.750958:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.750965:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.750970:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.750979:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.750998:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.751006:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e623 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72962048->72966143] (req 72962048->72966143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.751782:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565510528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9117us (9427us total) trans 4294985121 rc 0/0 00000100:00100000:2.0:1789760784.751795:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17824 00000100:00100000:2.0:1789760784.751804:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722990092796 time 723002937896 state 0x2 ref 0 00000100:00100000:1.0:1789760784.757987:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.758078:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510656 00000100:00100000:2.0:1789760784.758088:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510656 00000100:00100000:2.0:1789760784.758147:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 722990092796 time 723002937896 state 0x0 ref 1 00000100:00100000:2.0:1789760784.758161:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723003198312 time 723002937896 state 0x1 ref 1 00000100:00100000:2.0:1789760784.758189:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723003198312 time 723018481490 state 0x0 ref 1 00000100:00100000:2.0:1789760784.758201:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.758253:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72966144, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cc8 00010000:00010000:2.0:1789760784.758262:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.758278:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.758282:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.758288:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.758301:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.766373:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985122 is committed 00002000:00010000:0.0:1789760784.767134:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72966144 -> 72970240 00002000:00010000:0.0:1789760784.767140:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142536 -> 142544 00010000:00010000:0.0:1789760784.767154:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767166:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767175:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767182:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.767187:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767195:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767213:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.767222:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e62a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72966144->72970239] (req 72966144->72970239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.767368:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565510656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9163us (9387us total) trans 4294985122 rc 0/0 00000100:00100000:0.0:1789760784.767379:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17825 00000100:00100000:0.0:1789760784.767389:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723003198312 time 723018481490 state 0x2 ref 0 00000100:00100000:0.0:1789760784.773688:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.773854:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510784 00000100:00100000:2.0:1789760784.773864:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510784 00000100:00100000:2.0:1789760784.773922:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723003198312 time 723018481490 state 0x0 ref 1 00000100:00100000:2.0:1789760784.773937:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723018741906 time 723018481490 state 0x1 ref 1 00000100:00100000:2.0:1789760784.773959:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723018741906 time 723034251487 state 0x0 ref 1 00000100:00100000:2.0:1789760784.773971:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565510784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.774017:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72970240, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cd0 00010000:00010000:2.0:1789760784.774038:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.774056:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.774060:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.774068:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.774083:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760784.779152:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985123 is committed 00002000:00010000:2.0:1789760784.780095:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72970240 -> 72974336 00002000:00010000:2.0:1789760784.780103:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142544 -> 142552 00010000:00010000:2.0:1789760784.780117:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780129:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780137:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780144:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.780149:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780158:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780176:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.780182:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e631 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72970240->72974335] (req 72970240->72974335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.780366:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565510784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6391us (6692us total) trans 4294985123 rc 0/0 00000100:00100000:2.0:1789760784.780375:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17826 00000100:00100000:2.0:1789760784.780384:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723018741906 time 723034251487 state 0x2 ref 0 00000100:00100000:1.0:1789760784.786808:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.786910:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565510912 00000100:00100000:2.0:1789760784.786920:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565510912 00000100:00100000:2.0:1789760784.786976:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723018741906 time 723034251487 state 0x0 ref 1 00000100:00100000:2.0:1789760784.786991:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723034511903 time 723034251487 state 0x1 ref 1 00000100:00100000:2.0:1789760784.787028:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723034511903 time 723047315690 state 0x0 ref 1 00000100:00100000:2.0:1789760784.787041:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565510912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.787090:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72974336, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cd8 00010000:00010000:2.0:1789760784.787100:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.787115:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.787119:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.787125:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.787138:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.792191:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985124 is committed 00002000:00010000:2.0:1789760784.792500:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72974336 -> 72978432 00002000:00010000:2.0:1789760784.792506:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142552 -> 142560 00010000:00010000:2.0:1789760784.792519:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792532:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792542:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792549:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.792554:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792563:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792583:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.792592:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e638 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72974336->72978431] (req 72974336->72978431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.793214:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565510912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6168us (6407us total) trans 4294985124 rc 0/0 00000100:00100000:2.0:1789760784.793226:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17827 00000100:00100000:2.0:1789760784.793236:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723034511903 time 723047315690 state 0x2 ref 0 00000100:00100000:1.0:1789760784.800335:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.800448:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511040 00000100:00100000:0.0:1789760784.800459:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511040 00000100:00100000:0.0:1789760784.800512:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723034511903 time 723047315690 state 0x0 ref 1 00000100:00100000:0.0:1789760784.800526:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723047576106 time 723047315690 state 0x1 ref 1 00000100:00100000:0.0:1789760784.800564:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723047576106 time 723060854982 state 0x0 ref 1 00000100:00100000:0.0:1789760784.800676:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565511040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.800813:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72978432, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ce0 00010000:00010000:0.0:1789760784.800826:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.800844:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760784.800852:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.800858:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.800876:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.805326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985125 is committed 00002000:00010000:0.0:1789760784.805459:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72978432 -> 72982528 00002000:00010000:0.0:1789760784.805465:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142560 -> 142568 00010000:00010000:0.0:1789760784.805480:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805494:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805504:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805513:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.805518:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805533:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805553:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.805562:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e63f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72978432->72982527] (req 72978432->72982527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.805650:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565511040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5071us (5320us total) trans 4294985125 rc 0/0 00000100:00100000:0.0:1789760784.805662:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17828 00000100:00100000:0.0:1789760784.805672:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723047576106 time 723060854982 state 0x2 ref 0 00000100:00100000:0.0:1789760784.809952:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.810035:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511168 00000100:00100000:2.0:1789760784.810046:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511168 00000100:00100000:2.0:1789760784.810095:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723047576106 time 723060854982 state 0x0 ref 1 00000100:00100000:2.0:1789760784.810110:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723061115398 time 723060854982 state 0x1 ref 1 00000100:00100000:2.0:1789760784.810138:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723061115398 time 723070429959 state 0x0 ref 1 00000100:00100000:2.0:1789760784.810150:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.810194:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72982528, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22ce8 00010000:00010000:2.0:1789760784.810203:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.810218:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.810223:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.810229:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.810242:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.814578:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985126 is committed 00002000:00010000:3.0:1789760784.814733:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72982528 -> 72986624 00002000:00010000:3.0:1789760784.814740:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142568 -> 142576 00010000:00010000:3.0:1789760784.814753:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.814766:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.815135:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.815143:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.815148:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.815158:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.815177:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.815185:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674e646 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72982528->72986623] (req 72982528->72986623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.815280:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5127us (5334us total) trans 4294985126 rc 0/0 00000100:00100000:3.0:1789760784.815289:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17829 00000100:00100000:3.0:1789760784.815299:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723061115398 time 723070429959 state 0x2 ref 0 00000100:00100000:1.0:1789760784.823931:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.824017:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511296 00000100:00100000:2.0:1789760784.824095:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511296 00000100:00100000:2.0:1789760784.824153:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723061115398 time 723070429959 state 0x0 ref 1 00000100:00100000:2.0:1789760784.824168:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723070690375 time 723070429959 state 0x1 ref 1 00000100:00100000:2.0:1789760784.824198:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723070690375 time 723084490342 state 0x0 ref 1 00000100:00100000:2.0:1789760784.824211:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.824259:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72986624, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cf0 00010000:00010000:2.0:1789760784.824268:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.824284:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.824288:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.824294:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.824307:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.841262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985127 is committed 00002000:00010000:2.0:1789760784.841396:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72986624 -> 72990720 00002000:00010000:2.0:1789760784.841401:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142576 -> 142584 00010000:00010000:2.0:1789760784.841415:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841426:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841434:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841440:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.841445:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841453:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841472:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.841479:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e64d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72986624->72990719] (req 72986624->72990719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.841582:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17369us (17657us total) trans 4294985127 rc 0/0 00000100:00100000:2.0:1789760784.841593:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17830 00000100:00100000:2.0:1789760784.841603:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723070690375 time 723084490342 state 0x2 ref 0 00000100:00100000:1.0:1789760784.848665:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.849299:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511424 00000100:00100000:0.0:1789760784.849310:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511424 00000100:00100000:0.0:1789760784.849383:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723070690375 time 723084490342 state 0x0 ref 1 00000100:00100000:0.0:1789760784.849402:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723084750758 time 723084490342 state 0x1 ref 1 00000100:00100000:0.0:1789760784.849433:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723084750758 time 723109725063 state 0x0 ref 1 00000100:00100000:0.0:1789760784.849446:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.849494:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72990720, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22cf8 00010000:00010000:0.0:1789760784.849504:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.849519:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760784.849523:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.849529:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.849542:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.862439:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985128 is committed 00002000:00010000:0.0:1789760784.862624:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72990720 -> 72994816 00002000:00010000:0.0:1789760784.862630:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142584 -> 142592 00010000:00010000:0.0:1789760784.862654:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862669:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862689:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862697:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.862737:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862748:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862770:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.862778:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72990720->72994815] (req 72990720->72994815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.862863:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13415us (14202us total) trans 4294985128 rc 0/0 00000100:00100000:0.0:1789760784.862875:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17831 00000100:00100000:0.0:1789760784.862884:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723084750758 time 723109725063 state 0x2 ref 0 00000100:00100000:0.0:1789760784.876650:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.876820:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511552 00000100:00100000:3.0:1789760784.876831:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511552 00000100:00100000:3.0:1789760784.876888:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723084750758 time 723109725063 state 0x0 ref 1 00000100:00100000:3.0:1789760784.876902:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723109985479 time 723109725063 state 0x1 ref 1 00000100:00100000:3.0:1789760784.876936:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723109985479 time 723137228077 state 0x0 ref 1 00000100:00100000:3.0:1789760784.876947:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.876992:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72994816, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22d00 00010000:00010000:3.0:1789760784.877001:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.877016:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760784.877021:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.877027:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.877040:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.889464:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985129 is committed 00002000:00010000:3.0:1789760784.889596:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72994816 -> 72998912 00002000:00010000:3.0:1789760784.889601:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142592 -> 142600 00010000:00010000:3.0:1789760784.889615:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889633:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889642:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889649:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.889655:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889665:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889696:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.889746:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e65b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72994816->72998911] (req 72994816->72998911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.889843:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12893us (13199us total) trans 4294985129 rc 0/0 00000100:00100000:3.0:1789760784.889855:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17832 00000100:00100000:3.0:1789760784.889865:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723109985479 time 723137228077 state 0x2 ref 0 00000100:00100000:1.0:1789760784.896470:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.896578:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511680 00000100:00100000:2.0:1789760784.896587:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511680 00000100:00100000:2.0:1789760784.896652:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723109985479 time 723137228077 state 0x0 ref 1 00000100:00100000:2.0:1789760784.896667:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723137488493 time 723137228077 state 0x1 ref 1 00000100:00100000:2.0:1789760784.896738:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723137488493 time 723156995215 state 0x0 ref 1 00000100:00100000:2.0:1789760784.896752:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.896801:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72998912, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22d08 00010000:00010000:2.0:1789760784.896810:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.896827:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.896831:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.896837:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.896851:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.903292:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985130 is committed 00002000:00010000:2.0:1789760784.903408:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72998912 -> 73003008 00002000:00010000:2.0:1789760784.903413:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142600 -> 142608 00010000:00010000:2.0:1789760784.903427:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903441:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903449:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903455:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760784.903461:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903469:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903488:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.903495:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e662 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72998912->73003007] (req 72998912->73003007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760784.903649:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565511680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6894us (7183us total) trans 4294985130 rc 0/0 00000100:00100000:2.0:1789760784.903659:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17833 00000100:00100000:2.0:1789760784.903669:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723137488493 time 723156995215 state 0x2 ref 0 00000100:00100000:1.0:1789760784.909150:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.909281:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511808 00000100:00100000:0.0:1789760784.909291:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511808 00000100:00100000:0.0:1789760784.909344:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723137488493 time 723156995215 state 0x0 ref 1 00000100:00100000:0.0:1789760784.909358:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723157255631 time 723156995215 state 0x1 ref 1 00000100:00100000:0.0:1789760784.909387:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723157255631 time 723169680250 state 0x0 ref 1 00000100:00100000:0.0:1789760784.909409:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565511808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.909471:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73003008, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22d10 00010000:00010000:0.0:1789760784.909480:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.909501:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760784.909506:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.909512:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.909526:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.916112:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985131 is committed 00002000:00010000:0.0:1789760784.916219:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73003008 -> 73007104 00002000:00010000:0.0:1789760784.916224:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142608 -> 142616 00010000:00010000:0.0:1789760784.916236:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916250:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916259:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916267:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.916272:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916282:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916307:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.916316:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674e669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73003008->73007103] (req 73003008->73007103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.916510:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565511808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7098us (7364us total) trans 4294985131 rc 0/0 00000100:00100000:0.0:1789760784.916522:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17834 00000100:00100000:0.0:1789760784.916532:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723157255631 time 723169680250 state 0x2 ref 0 00000100:00100000:0.0:1789760784.925501:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.925590:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565511936 00000100:00100000:3.0:1789760784.925600:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565511936 00000100:00100000:3.0:1789760784.925664:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723157255631 time 723169680250 state 0x0 ref 1 00000100:00100000:3.0:1789760784.925688:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723169940666 time 723169680250 state 0x1 ref 1 00000100:00100000:3.0:1789760784.925732:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723169940666 time 723186023944 state 0x0 ref 1 00000100:00100000:3.0:1789760784.925745:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565511936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.925791:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73007104, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22d18 00010000:00010000:3.0:1789760784.925801:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.925816:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760784.925821:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.925828:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.925842:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.932342:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985132 is committed 00002000:00010000:3.0:1789760784.932590:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73007104 -> 73011200 00002000:00010000:3.0:1789760784.932595:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142616 -> 142624 00010000:00010000:3.0:1789760784.932609:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932859:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932874:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932883:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.932888:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932898:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932919:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.932927:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73007104->73011199] (req 73007104->73011199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.933020:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565511936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7272us (7522us total) trans 4294985132 rc 0/0 00000100:00100000:3.0:1789760784.933042:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17835 00000100:00100000:3.0:1789760784.933052:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723169940666 time 723186023944 state 0x2 ref 0 00000100:00100000:1.0:1789760784.939202:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.941884:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512064 00000100:00100000:2.0:1789760784.941899:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512064 00000100:00100000:2.0:1789760784.941962:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723169940666 time 723186023944 state 0x0 ref 1 00000100:00100000:2.0:1789760784.941977:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723186284360 time 723186023944 state 0x1 ref 1 00000100:00100000:2.0:1789760784.942063:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723186284360 time 723202354351 state 0x0 ref 1 00000100:00100000:2.0:1789760784.942076:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.942124:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73011200, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0x22d20 00010000:00010000:2.0:1789760784.942134:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.942149:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.942153:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.942159:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.942172:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.947335:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985133 is committed 00002000:00010000:1.0:1789760784.947538:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73011200 -> 73015296 00002000:00010000:1.0:1789760784.947543:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760784 -> 1789760785 00002000:00010000:1.0:1789760784.947546:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760784 -> 1789760785 00002000:00010000:1.0:1789760784.947549:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142624 -> 142632 00010000:00010000:1.0:1789760784.947561:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947575:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947584:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947592:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760784.947597:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947607:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947627:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.947635:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e677 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73011200->73015295] (req 73011200->73015295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.947922:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5843us (8724us total) trans 4294985133 rc 0/0 00000100:00100000:1.0:1789760784.947934:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17836 00000100:00100000:1.0:1789760784.947943:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723186284360 time 723202354351 state 0x2 ref 0 00000100:00100000:1.0:1789760784.952282:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.952373:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512192 00000100:00100000:0.0:1789760784.952384:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512192 00000100:00100000:0.0:1789760784.952456:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723186284360 time 723202354351 state 0x0 ref 1 00000100:00100000:0.0:1789760784.952472:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723202614767 time 723202354351 state 0x1 ref 1 00000100:00100000:0.0:1789760784.952501:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723202614767 time 723212793416 state 0x0 ref 1 00000100:00100000:0.0:1789760784.952517:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565512192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.952567:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73015296, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d28 00010000:00010000:0.0:1789760784.952576:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.952598:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760784.952603:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.952610:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.952636:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.957422:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985134 is committed 00002000:00010000:0.0:1789760784.958846:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73015296 -> 73019392 00002000:00010000:0.0:1789760784.958854:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142632 -> 142640 00010000:00010000:0.0:1789760784.958869:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958881:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958889:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958897:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760784.958901:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958909:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958932:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.958939:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e67e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73015296->73019391] (req 73015296->73019391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760784.959039:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565512192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6519us (6761us total) trans 4294985134 rc 0/0 00000100:00100000:0.0:1789760784.959050:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17837 00000100:00100000:0.0:1789760784.959060:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723202614767 time 723212793416 state 0x2 ref 0 00000100:00100000:2.0:1789760784.973476:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760784.977000:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512320 00000100:00100000:3.0:1789760784.977015:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512320 00000100:00100000:3.0:1789760784.977082:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723202614767 time 723212793416 state 0x0 ref 1 00000100:00100000:3.0:1789760784.977098:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723213053832 time 723212793416 state 0x1 ref 1 00000100:00100000:3.0:1789760784.977192:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723213053832 time 723237482309 state 0x0 ref 1 00000100:00100000:3.0:1789760784.977207:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760784.977253:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73019392, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d30 00010000:00010000:3.0:1789760784.977263:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.977278:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760784.977283:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.977290:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.977306:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760784.982552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985135 is committed 00002000:00010000:3.0:1789760784.982757:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73019392 -> 73023488 00002000:00010000:3.0:1789760784.982763:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142640 -> 142648 00010000:00010000:3.0:1789760784.982775:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982787:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982796:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982809:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760784.982814:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982823:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982842:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.982851:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e685 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73019392->73023487] (req 73019392->73023487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.982981:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5773us (9512us total) trans 4294985135 rc 0/0 00000100:00100000:3.0:1789760784.982991:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17838 00000100:00100000:3.0:1789760784.983001:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723213053832 time 723237482309 state 0x2 ref 0 00000100:00100000:1.0:1789760784.987851:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760784.988275:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512448 00000100:00100000:2.0:1789760784.988285:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512448 00000100:00100000:2.0:1789760784.988339:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723213053832 time 723237482309 state 0x0 ref 1 00000100:00100000:2.0:1789760784.988354:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723237742725 time 723237482309 state 0x1 ref 1 00000100:00100000:2.0:1789760784.988773:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723237742725 time 723249062626 state 0x0 ref 1 00000100:00100000:2.0:1789760784.988788:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760784.988835:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73023488, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d38 00010000:00010000:2.0:1789760784.988845:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.988861:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760784.988866:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.988872:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.988887:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760784.994936:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985136 is committed 00002000:00010000:1.0:1789760784.995105:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73023488 -> 73027584 00002000:00010000:1.0:1789760784.995111:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142648 -> 142656 00010000:00010000:1.0:1789760784.995123:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995136:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995145:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995152:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760784.995157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995171:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995191:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.995199:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674e68c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73023488->73027583] (req 73023488->73027583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.995296:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6507us (7450us total) trans 4294985136 rc 0/0 00000100:00100000:1.0:1789760784.995307:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17839 00000100:00100000:1.0:1789760784.995319:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723237742725 time 723249062626 state 0x2 ref 0 00000100:00100000:1.0:1789760784.999212:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760784.999520:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512576 00000100:00100000:0.0:1789760784.999529:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512576 00000100:00100000:0.0:1789760784.999663:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723237742725 time 723249062626 state 0x0 ref 1 00000100:00100000:0.0:1789760784.999687:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723249323042 time 723249062626 state 0x1 ref 1 00000100:00100000:0.0:1789760784.999836:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723249323042 time 723260126693 state 0x0 ref 1 00000100:00100000:0.0:1789760784.999852:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760784.999904:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73027584, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d40 00010000:00010000:0.0:1789760784.999913:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.999929:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760784.999934:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760784.999940:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760784.999954:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.010459:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985137 is committed 00002000:00010000:2.0:1789760785.010753:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73027584 -> 73031680 00002000:00010000:2.0:1789760785.010759:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142656 -> 142664 00010000:00010000:2.0:1789760785.010773:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010786:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010797:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010804:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.010809:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010818:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010836:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.010844:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674e693 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73027584->73031679] (req 73027584->73031679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.010938:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11085us (11730us total) trans 4294985137 rc 0/0 00000100:00100000:2.0:1789760785.010948:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17840 00000100:00100000:2.0:1789760785.010959:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723249323042 time 723260126693 state 0x2 ref 0 00000100:00100000:2.0:1789760785.015093:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.015878:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512704 00000100:00100000:3.0:1789760785.015888:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512704 00000100:00100000:3.0:1789760785.015950:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723249323042 time 723260126693 state 0x0 ref 1 00000100:00100000:3.0:1789760785.015965:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723260387109 time 723260126693 state 0x1 ref 1 00000100:00100000:3.0:1789760785.016046:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723260387109 time 723276338088 state 0x0 ref 1 00000100:00100000:3.0:1789760785.016063:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.016108:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73031680, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d48 00010000:00010000:3.0:1789760785.016117:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.016132:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.016136:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.016142:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.016155:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.021233:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985138 is committed 00002000:00010000:3.0:1789760785.021355:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73031680 -> 73035776 00002000:00010000:3.0:1789760785.021360:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142664 -> 142672 00010000:00010000:3.0:1789760785.021372:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021384:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021392:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021399:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.021405:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021425:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021445:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.021454:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e69a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73031680->73035775] (req 73031680->73035775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.021540:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5475us (6452us total) trans 4294985138 rc 0/0 00000100:00100000:3.0:1789760785.021550:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17841 00000100:00100000:3.0:1789760785.021568:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723260387109 time 723276338088 state 0x2 ref 0 00000100:00100000:1.0:1789760785.028080:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.029459:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512832 00000100:00100000:2.0:1789760785.029472:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512832 00000100:00100000:2.0:1789760785.029529:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723260387109 time 723276338088 state 0x0 ref 1 00000100:00100000:2.0:1789760785.029763:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723276598504 time 723276338088 state 0x1 ref 1 00000100:00100000:2.0:1789760785.029799:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723276598504 time 723290090935 state 0x0 ref 1 00000100:00100000:2.0:1789760785.029814:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565512832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.029875:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73035776, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d50 00010000:00010000:2.0:1789760785.029886:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.029902:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.029906:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.029912:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.029927:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.038273:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985139 is committed 00002000:00010000:2.0:1789760785.038540:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73035776 -> 73039872 00002000:00010000:2.0:1789760785.038546:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142672 -> 142680 00010000:00010000:2.0:1789760785.038559:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038572:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038581:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038589:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.038606:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038616:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038637:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.038644:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73035776->73039871] (req 73035776->73039871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.039045:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565512832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9230us (10969us total) trans 4294985139 rc 0/0 00000100:00100000:2.0:1789760785.039056:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17842 00000100:00100000:2.0:1789760785.039066:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723276598504 time 723290090935 state 0x2 ref 0 00000100:00100000:1.0:1789760785.042873:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.042949:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565512960 00000100:00100000:2.0:1789760785.042957:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565512960 00000100:00100000:2.0:1789760785.043012:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723276598504 time 723290090935 state 0x0 ref 1 00000100:00100000:2.0:1789760785.043032:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723290351351 time 723290090935 state 0x1 ref 1 00000100:00100000:2.0:1789760785.043062:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723290351351 time 723303353346 state 0x0 ref 1 00000100:00100000:2.0:1789760785.043078:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.043125:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73039872, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d58 00010000:00010000:2.0:1789760785.043134:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.043151:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.043156:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.043162:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.043175:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.047912:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985140 is committed 00002000:00010000:2.0:1789760785.048028:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73039872 -> 73043968 00002000:00010000:2.0:1789760785.048032:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142680 -> 142688 00010000:00010000:2.0:1789760785.048044:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048056:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048075:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048084:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.048089:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048097:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048118:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.048125:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73039872->73043967] (req 73039872->73043967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.048216:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565512960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5136us (5348us total) trans 4294985140 rc 0/0 00000100:00100000:2.0:1789760785.048227:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17843 00000100:00100000:2.0:1789760785.048236:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723290351351 time 723303353346 state 0x2 ref 0 00000100:00100000:3.0:1789760785.054307:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.054408:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513088 00000100:00100000:2.0:1789760785.054418:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513088 00000100:00100000:2.0:1789760785.054469:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723290351351 time 723303353346 state 0x0 ref 1 00000100:00100000:2.0:1789760785.054485:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723303613762 time 723303353346 state 0x1 ref 1 00000100:00100000:2.0:1789760785.054517:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723303613762 time 723314809098 state 0x0 ref 1 00000100:00100000:2.0:1789760785.054529:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565513088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.054572:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73043968, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d60 00010000:00010000:2.0:1789760785.054582:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.054598:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.054602:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.054608:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.054633:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.060175:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985141 is committed 00002000:00010000:2.0:1789760785.060285:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73043968 -> 73048064 00002000:00010000:2.0:1789760785.060290:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142688 -> 142696 00010000:00010000:2.0:1789760785.060303:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060315:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060325:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060332:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.060338:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060346:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060372:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.060380:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73043968->73048063] (req 73043968->73048063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.060470:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565513088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5939us (6169us total) trans 4294985141 rc 0/0 00000100:00100000:2.0:1789760785.060480:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17844 00000100:00100000:2.0:1789760785.060490:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723303613762 time 723314809098 state 0x2 ref 0 00000100:00100000:1.0:1789760785.065247:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.065347:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513216 00000100:00100000:2.0:1789760785.065356:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513216 00000100:00100000:2.0:1789760785.065420:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723303613762 time 723314809098 state 0x0 ref 1 00000100:00100000:2.0:1789760785.065436:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723315069514 time 723314809098 state 0x1 ref 1 00000100:00100000:2.0:1789760785.065464:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723315069514 time 723325756036 state 0x0 ref 1 00000100:00100000:2.0:1789760785.065477:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565513216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.065522:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73048064, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d68 00010000:00010000:2.0:1789760785.065532:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.065561:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.065568:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.065575:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.065591:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.074767:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985142 is committed 00002000:00010000:2.0:1789760785.078933:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73048064 -> 73052160 00002000:00010000:2.0:1789760785.078942:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142696 -> 142704 00010000:00010000:2.0:1789760785.078955:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.078968:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.078978:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.078986:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.078990:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.078999:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.079019:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.079032:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73048064->73052159] (req 73048064->73052159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.079187:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565513216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13707us (13944us total) trans 4294985142 rc 0/0 00000100:00100000:2.0:1789760785.079198:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17845 00000100:00100000:2.0:1789760785.079208:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723315069514 time 723325756036 state 0x2 ref 0 00000100:00100000:1.0:1789760785.085948:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.086552:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513344 00000100:00100000:2.0:1789760785.086562:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513344 00000100:00100000:2.0:1789760785.086617:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723315069514 time 723325756036 state 0x0 ref 1 00000100:00100000:2.0:1789760785.086632:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723326016452 time 723325756036 state 0x1 ref 1 00000100:00100000:2.0:1789760785.086669:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723326016452 time 723346961190 state 0x0 ref 1 00000100:00100000:2.0:1789760785.086695:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.086768:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73052160, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d70 00010000:00010000:2.0:1789760785.086779:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.086794:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.086798:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.086866:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.086889:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.093794:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985143 is committed 00002000:00010000:3.0:1789760785.093974:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73052160 -> 73056256 00002000:00010000:3.0:1789760785.093979:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142704 -> 142712 00010000:00010000:3.0:1789760785.093992:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094005:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094015:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094034:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.094040:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094049:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094069:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.094077:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674e6bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73052160->73056255] (req 73052160->73056255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.094169:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7473us (8224us total) trans 4294985143 rc 0/0 00000100:00100000:3.0:1789760785.094179:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17846 00000100:00100000:3.0:1789760785.094188:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723326016452 time 723346961190 state 0x2 ref 0 00000100:00100000:3.0:1789760785.101812:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.101934:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513472 00000100:00100000:2.0:1789760785.101944:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513472 00000100:00100000:2.0:1789760785.101996:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723326016452 time 723346961190 state 0x0 ref 1 00000100:00100000:2.0:1789760785.102012:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723347221606 time 723346961190 state 0x1 ref 1 00000100:00100000:2.0:1789760785.102046:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723347221606 time 723362337148 state 0x0 ref 1 00000100:00100000:2.0:1789760785.102060:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565513472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.102115:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73056256, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d78 00010000:00010000:2.0:1789760785.102124:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.102139:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.102144:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.102150:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.102164:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.108566:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985144 is committed 00002000:00010000:2.0:1789760785.109212:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73056256 -> 73060352 00002000:00010000:2.0:1789760785.109218:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142712 -> 142720 00010000:00010000:2.0:1789760785.109232:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109244:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109252:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109259:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.109263:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109271:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109289:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.109296:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73056256->73060351] (req 73056256->73060351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.109390:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565513472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7329us (7583us total) trans 4294985144 rc 0/0 00000100:00100000:2.0:1789760785.109401:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17847 00000100:00100000:2.0:1789760785.109410:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723347221606 time 723362337148 state 0x2 ref 0 00000100:00100000:1.0:1789760785.113667:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.113960:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513600 00000100:00100000:2.0:1789760785.113970:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513600 00000100:00100000:2.0:1789760785.114036:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723347221606 time 723362337148 state 0x0 ref 1 00000100:00100000:2.0:1789760785.114054:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723362597564 time 723362337148 state 0x1 ref 1 00000100:00100000:2.0:1789760785.114090:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723362597564 time 723374381494 state 0x0 ref 1 00000100:00100000:2.0:1789760785.114103:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565513600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.114150:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73060352, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d80 00010000:00010000:2.0:1789760785.114159:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.114175:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.114180:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.114186:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.114200:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.122063:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985145 is committed 00002000:00010000:2.0:1789760785.122168:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73060352 -> 73064448 00002000:00010000:2.0:1789760785.122174:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142720 -> 142728 00010000:00010000:2.0:1789760785.122186:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122204:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122214:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122221:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.122226:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122235:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122254:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.122262:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73060352->73064447] (req 73060352->73064447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.122353:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565513600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8248us (8690us total) trans 4294985145 rc 0/0 00000100:00100000:2.0:1789760785.122363:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17848 00000100:00100000:2.0:1789760785.122373:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723362597564 time 723374381494 state 0x2 ref 0 00000100:00100000:1.0:1789760785.130368:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.130474:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513728 00000100:00100000:3.0:1789760785.130484:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513728 00000100:00100000:3.0:1789760785.130540:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723362597564 time 723374381494 state 0x0 ref 1 00000100:00100000:3.0:1789760785.130555:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723374641910 time 723374381494 state 0x1 ref 1 00000100:00100000:3.0:1789760785.130586:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723374641910 time 723390878277 state 0x0 ref 1 00000100:00100000:3.0:1789760785.130600:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565513728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.130664:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73064448, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d88 00010000:00010000:3.0:1789760785.130683:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.130699:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.130744:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.130752:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.130766:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.141283:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985146 is committed 00002000:00010000:3.0:1789760785.141441:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73064448 -> 73068544 00002000:00010000:3.0:1789760785.141447:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142728 -> 142736 00010000:00010000:3.0:1789760785.141462:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141474:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141483:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141489:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.141494:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141502:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141520:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.141528:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73064448->73068543] (req 73064448->73068543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.142914:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565513728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12306us (12545us total) trans 4294985146 rc 0/0 00000100:00100000:3.0:1789760785.142929:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17849 00000100:00100000:3.0:1789760785.142939:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723374641910 time 723390878277 state 0x2 ref 0 00000100:00100000:3.0:1789760785.148019:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.148894:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513856 00000100:00100000:2.0:1789760785.148905:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513856 00000100:00100000:2.0:1789760785.148964:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723374641910 time 723390878277 state 0x0 ref 1 00000100:00100000:2.0:1789760785.148978:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723391138693 time 723390878277 state 0x1 ref 1 00000100:00100000:2.0:1789760785.149049:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723391138693 time 723409340997 state 0x0 ref 1 00000100:00100000:2.0:1789760785.149062:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c95b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.149106:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73068544, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d90 00010000:00010000:2.0:1789760785.149115:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.149140:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.149144:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.149150:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.149164:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.153926:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985147 is committed 00002000:00010000:2.0:1789760785.154140:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73068544 -> 73072640 00002000:00010000:2.0:1789760785.154145:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142736 -> 142744 00010000:00010000:2.0:1789760785.154157:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154169:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154184:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154192:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.154197:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154205:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154224:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.154231:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73068544->73072639] (req 73068544->73072639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.154359:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5293us (6801us total) trans 4294985147 rc 0/0 00000100:00100000:2.0:1789760785.154369:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17850 00000100:00100000:2.0:1789760785.154378:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723391138693 time 723409340997 state 0x2 ref 0 00000100:00100000:1.0:1789760785.159831:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.159923:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565513984 00000100:00100000:2.0:1789760785.159934:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565513984 00000100:00100000:2.0:1789760785.159989:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723391138693 time 723409340997 state 0x0 ref 1 00000100:00100000:2.0:1789760785.160003:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723409601413 time 723409340997 state 0x1 ref 1 00000100:00100000:2.0:1789760785.160030:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723409601413 time 723420323068 state 0x0 ref 1 00000100:00100000:2.0:1789760785.160043:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.160088:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73072640, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22d98 00010000:00010000:2.0:1789760785.160097:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.160111:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.160115:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.160120:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.160144:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.163977:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580067584:0@lo:400:kworker.0 00000100:00100000:2.0:1789760785.163987:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7ec78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3458:1876699580067328:0@lo:400:kworker.0 00000100:00100000:3.0:1789760785.164057:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7ec7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:769fd61a-9f51-46fc-af80-467e2ca172bc:3457:1876699580067200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760785.164608:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3459:1876699580067456:0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.166568:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760785.168344:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760785.168405:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067328 00000100:00100000:0.0:1789760785.168415:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067328 00000100:00100000:2.0:1789760785.168423:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d47440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580067840:0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.168474:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789760785.168479:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760785.168489:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1876699580067328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760785.168523:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067584 00000100:00100000:2.0:1789760785.168529:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067584 00000100:00100000:0.0:1789760785.168556:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1876699580067328:12345-0@lo:400:kworker.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.168564:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789760785.168570:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067840 00000100:00100000:2.0:1789760785.168575:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067840 00000100:00100000:2.0:1789760785.168602:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789760785.168610:0:9029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789760785.168614:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580067584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.168625:0:9029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760785.168669:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580067584:12345-0@lo:400:kworker.0 Request processed in 58us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760785.168690:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789760785.168692:0:9029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580067840:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.168701:0:9029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1789760785.168737:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760785.168743:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760785.168782:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580067584:0@lo:400:kworker.0 00000100:00100000:2.0:1789760785.168816:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7ec78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3458:1876699580067328:0@lo:400:kworker.0 00000100:00100000:2.0:1789760785.168826:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d47440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580067840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760785.175348:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760785.175425:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580067968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760785.175466:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760785.175579:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067456 00000100:00100000:0.0:1789760785.175588:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067456 00000100:00100000:0.0:1789760785.175656:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789760785.175669:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1876699580067456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.175772:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1876699580067456:12345-0@lo:400:kworker.0 Request processed in 107us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.175779:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1789760785.175966:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760785.176012:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3457:1876699580067712:0@lo:400:kworker.0 00000100:00100000:1.0:1789760785.176030:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3459:1876699580067456:0@lo:400:kworker.0 00000100:00100000:3.0:1789760785.176044:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760785.176187:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067968 00000100:00100000:2.0:1789760785.176192:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067968 00000100:00100000:2.0:1789760785.176224:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789760785.176231:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580067968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760785.176257:0:6955:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760785.176306:0:5966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067712 00000100:00100000:1.0:1789760785.176310:0:5966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067712 00000100:00100000:1.0:1789760785.176341:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789760785.176347:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876699580067712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760785.176378:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876699580067712:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760785.176384:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1789760785.176974:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580067200 00000100:00100000:0.0:1789760785.176980:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580067200 00000100:00100000:0.0:1789760785.177018:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789760785.177031:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3457:x1876699580067200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.177067:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3457:x1876699580067200:12345-0@lo:400:kworker.0 Request processed in 37us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.177072:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789760785.177386:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580067968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1155us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760785.177393:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1789760785.177415:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760785.177585:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3457:1876699580067712:0@lo:400:kworker.0 00000100:00100000:3.0:1789760785.177615:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7ec7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:769fd61a-9f51-46fc-af80-467e2ca172bc:3457:1876699580067200:0@lo:400:kworker.0 00000100:00100000:0.0:1789760785.177621:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580067968:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789760785.178011:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985148 is committed 00002000:00010000:1.0:1789760785.178121:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73072640 -> 73076736 00002000:00010000:1.0:1789760785.178126:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142744 -> 142752 00010000:00010000:1.0:1789760785.178138:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178151:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178160:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178168:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.178172:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178186:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178205:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.178213:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674e6e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73072640->73076735] (req 73072640->73076735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.178292:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565513984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18249us (18468us total) trans 4294985148 rc 0/0 00000100:00100000:1.0:1789760785.178303:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17851 00000100:00100000:1.0:1789760785.178313:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723409601413 time 723420323068 state 0x2 ref 0 00000100:00100000:1.0:1789760785.184103:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.184215:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514112 00000100:00100000:3.0:1789760785.184225:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514112 00000100:00100000:3.0:1789760785.184281:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723409601413 time 723420323068 state 0x0 ref 1 00000100:00100000:3.0:1789760785.184299:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723420583484 time 723420323068 state 0x1 ref 1 00000100:00100000:3.0:1789760785.184331:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723420583484 time 723444623468 state 0x0 ref 1 00000100:00100000:3.0:1789760785.184344:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.184400:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73076736, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22da0 00010000:00010000:3.0:1789760785.184410:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.184426:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.184430:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.184435:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.184449:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.197552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985149 is committed 00002000:00010000:3.0:1789760785.197763:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73076736 -> 73080832 00002000:00010000:3.0:1789760785.197768:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142752 -> 142760 00010000:00010000:3.0:1789760785.197781:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197794:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197810:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197818:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.197823:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197832:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197852:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.197860:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e6e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73076736->73080831] (req 73076736->73080831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.198013:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13666us (13912us total) trans 4294985149 rc 0/0 00000100:00100000:3.0:1789760785.198034:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17852 00000100:00100000:3.0:1789760785.198045:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723420583484 time 723444623468 state 0x2 ref 0 00000100:00100000:3.0:1789760785.209578:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.210050:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514240 00000100:00100000:2.0:1789760785.210061:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514240 00000100:00100000:2.0:1789760785.210119:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723420583484 time 723444623468 state 0x0 ref 1 00000100:00100000:2.0:1789760785.210136:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723444883884 time 723444623468 state 0x1 ref 1 00000100:00100000:2.0:1789760785.210232:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723444883884 time 723470523296 state 0x0 ref 1 00000100:00100000:2.0:1789760785.210247:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565514240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.210296:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73080832, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22da8 00010000:00010000:2.0:1789760785.210306:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.210321:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.210325:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.210332:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.210347:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.222132:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985150 is committed 00002000:00010000:2.0:1789760785.222268:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73080832 -> 73084928 00002000:00010000:2.0:1789760785.222273:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142760 -> 142768 00010000:00010000:2.0:1789760785.222288:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222300:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222309:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222317:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.222322:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222336:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222356:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.222364:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e6ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73080832->73084927] (req 73080832->73084927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.222470:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565514240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12222us (12897us total) trans 4294985150 rc 0/0 00000100:00100000:2.0:1789760785.222480:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17853 00000100:00100000:2.0:1789760785.222490:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723444883884 time 723470523296 state 0x2 ref 0 00000100:00100000:1.0:1789760785.249424:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.252858:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514368 00000100:00100000:2.0:1789760785.252872:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514368 00000100:00100000:0.0:1789760785.253107:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723444883884 time 723470523296 state 0x0 ref 1 00000100:00100000:0.0:1789760785.253123:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723470783712 time 723470523296 state 0x1 ref 1 00000100:00100000:0.0:1789760785.253158:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723470783712 time 723513450351 state 0x0 ref 1 00000100:00100000:0.0:1789760785.253172:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.253221:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73084928, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22db0 00010000:00010000:0.0:1789760785.253230:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.253246:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.253251:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.253258:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.253272:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.264745:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985151 is committed 00002000:00010000:0.0:1789760785.264887:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73084928 -> 73089024 00002000:00010000:0.0:1789760785.264893:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142768 -> 142776 00010000:00010000:0.0:1789760785.264906:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264918:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264927:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264934:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.264938:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264952:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264972:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.264980:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e6f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73084928->73089023] (req 73084928->73089023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.265078:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11904us (15659us total) trans 4294985151 rc 0/0 00000100:00100000:0.0:1789760785.265088:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17854 00000100:00100000:0.0:1789760785.265098:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723470783712 time 723513450351 state 0x2 ref 0 00000100:00100000:1.0:1789760785.271873:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.271932:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514496 00000100:00100000:3.0:1789760785.271942:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514496 00000100:00100000:3.0:1789760785.272000:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723470783712 time 723513450351 state 0x0 ref 1 00000100:00100000:3.0:1789760785.272019:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723513710767 time 723513450351 state 0x1 ref 1 00000100:00100000:3.0:1789760785.272059:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723513710767 time 723532350979 state 0x0 ref 1 00000100:00100000:3.0:1789760785.272283:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.272332:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73089024, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22db8 00010000:00010000:3.0:1789760785.272341:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.272356:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.272361:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.272367:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.272382:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.279623:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985152 is committed 00002000:00010000:3.0:1789760785.282197:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73089024 -> 73093120 00002000:00010000:3.0:1789760785.282206:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142776 -> 142784 00010000:00010000:3.0:1789760785.282220:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282441:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282464:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282474:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.282479:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282489:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282510:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.282518:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e6fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73089024->73093119] (req 73089024->73093119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.282610:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10330us (10742us total) trans 4294985152 rc 0/0 00000100:00100000:3.0:1789760785.282620:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17855 00000100:00100000:3.0:1789760785.282629:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723513710767 time 723532350979 state 0x2 ref 0 00000100:00100000:3.0:1789760785.287968:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.288302:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514624 00000100:00100000:2.0:1789760785.288313:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514624 00000100:00100000:2.0:1789760785.288367:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723513710767 time 723532350979 state 0x0 ref 1 00000100:00100000:2.0:1789760785.288383:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723532611395 time 723532350979 state 0x1 ref 1 00000100:00100000:2.0:1789760785.288418:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723532611395 time 723548709633 state 0x0 ref 1 00000100:00100000:2.0:1789760785.288447:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.288496:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73093120, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22dc0 00010000:00010000:2.0:1789760785.288507:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.288523:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.288528:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.288534:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.288549:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.303441:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985153 is committed 00002000:00010000:2.0:1789760785.307997:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73093120 -> 73097216 00002000:00010000:2.0:1789760785.308008:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142784 -> 142792 00010000:00010000:2.0:1789760785.308191:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308205:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308214:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308222:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.308227:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308236:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308257:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.308264:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73093120->73097215] (req 73093120->73097215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.308590:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 20154us (20624us total) trans 4294985153 rc 0/0 00000100:00100000:2.0:1789760785.308602:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17856 00000100:00100000:2.0:1789760785.308611:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723532611395 time 723548709633 state 0x2 ref 0 00000100:00100000:1.0:1789760785.315496:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.317512:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514752 00000100:00100000:0.0:1789760785.317526:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514752 00000100:00100000:0.0:1789760785.317594:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723532611395 time 723548709633 state 0x0 ref 1 00000100:00100000:0.0:1789760785.317609:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723548970049 time 723548709633 state 0x1 ref 1 00000100:00100000:0.0:1789760785.317660:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723548970049 time 723577951463 state 0x0 ref 1 00000100:00100000:0.0:1789760785.317683:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.317751:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73097216, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22dc8 00010000:00010000:0.0:1789760785.317760:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.317777:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.317781:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.317787:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.317802:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.326197:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985154 is committed 00002000:00010000:0.0:1789760785.326393:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73097216 -> 73101312 00002000:00010000:0.0:1789760785.326398:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142792 -> 142800 00010000:00010000:0.0:1789760785.326411:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326422:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326431:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326437:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.326441:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326453:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326471:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.326479:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e70a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73097216->73101311] (req 73097216->73101311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.326634:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565514752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8958us (11141us total) trans 4294985154 rc 0/0 00000100:00100000:0.0:1789760785.326645:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17857 00000100:00100000:0.0:1789760785.326654:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723548970049 time 723577951463 state 0x2 ref 0 00000100:00100000:1.0:1789760785.334475:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.334531:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565514880 00000100:00100000:3.0:1789760785.334540:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565514880 00000100:00100000:3.0:1789760785.334590:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723548970049 time 723577951463 state 0x0 ref 1 00000100:00100000:3.0:1789760785.334657:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723578211879 time 723577951463 state 0x1 ref 1 00000100:00100000:3.0:1789760785.334694:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723578211879 time 723594985955 state 0x0 ref 1 00000100:00100000:3.0:1789760785.334963:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.335007:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73101312, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22dd0 00010000:00010000:3.0:1789760785.335016:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.335032:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.335036:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.335043:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.335059:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760785.341343:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985155 is committed 00002000:00010000:2.0:1789760785.349062:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73101312 -> 73105408 00002000:00010000:2.0:1789760785.349072:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142800 -> 142808 00010000:00010000:2.0:1789760785.349085:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349099:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349108:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349116:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.349120:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349135:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349154:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.349161:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674e711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73101312->73105407] (req 73101312->73105407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.349265:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565514880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14553us (14794us total) trans 4294985155 rc 0/0 00000100:00100000:2.0:1789760785.349277:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17858 00000100:00100000:2.0:1789760785.349288:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723578211879 time 723594985955 state 0x2 ref 0 00000100:00100000:3.0:1789760785.355120:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.355212:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515008 00000100:00100000:2.0:1789760785.355223:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515008 00000100:00100000:2.0:1789760785.355280:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723578211879 time 723594985955 state 0x0 ref 1 00000100:00100000:2.0:1789760785.355296:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723595246371 time 723594985955 state 0x1 ref 1 00000100:00100000:2.0:1789760785.355332:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723595246371 time 723615624172 state 0x0 ref 1 00000100:00100000:2.0:1789760785.355351:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565515008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.355397:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73105408, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22dd8 00010000:00010000:2.0:1789760785.355407:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.355424:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.355429:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.355434:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.355448:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.364643:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985156 is committed 00002000:00010000:2.0:1789760785.364825:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73105408 -> 73109504 00002000:00010000:2.0:1789760785.364830:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142808 -> 142816 00010000:00010000:2.0:1789760785.364848:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364860:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364869:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364877:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.364881:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364890:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364913:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.364921:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73105408->73109503] (req 73105408->73109503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.365013:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565515008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9665us (9897us total) trans 4294985156 rc 0/0 00000100:00100000:2.0:1789760785.365763:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17859 00000100:00100000:2.0:1789760785.365774:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723595246371 time 723615624172 state 0x2 ref 0 00000100:00100000:1.0:1789760785.372992:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.373396:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515136 00000100:00100000:0.0:1789760785.373405:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515136 00000100:00100000:0.0:1789760785.373514:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723595246371 time 723615624172 state 0x0 ref 1 00000100:00100000:0.0:1789760785.373530:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723615884588 time 723615624172 state 0x1 ref 1 00000100:00100000:0.0:1789760785.373608:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723615884588 time 723633899458 state 0x0 ref 1 00000100:00100000:0.0:1789760785.373629:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565515136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.373696:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73109504, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22de0 00010000:00010000:0.0:1789760785.373744:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.373759:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.373764:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.373770:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.373784:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.382031:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985157 is committed 00002000:00010000:0.0:1789760785.382183:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73109504 -> 73113600 00002000:00010000:0.0:1789760785.382188:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142816 -> 142824 00010000:00010000:0.0:1789760785.382201:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382214:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382224:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382231:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.382236:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382245:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382264:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.382272:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e71f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73109504->73113599] (req 73109504->73113599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.382373:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565515136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8750us (9386us total) trans 4294985157 rc 0/0 00000100:00100000:0.0:1789760785.382383:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17860 00000100:00100000:0.0:1789760785.382392:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723615884588 time 723633899458 state 0x2 ref 0 00000100:00100000:1.0:1789760785.391881:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.392007:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515264 00000100:00100000:2.0:1789760785.392017:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515264 00000100:00100000:2.0:1789760785.392069:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723615884588 time 723633899458 state 0x0 ref 1 00000100:00100000:2.0:1789760785.392085:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723634159874 time 723633899458 state 0x1 ref 1 00000100:00100000:2.0:1789760785.392115:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723634159874 time 723652407317 state 0x0 ref 1 00000100:00100000:2.0:1789760785.392128:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.392175:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73113600, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22de8 00010000:00010000:2.0:1789760785.392185:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.392205:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.392210:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.392216:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.392230:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.398982:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985158 is committed 00002000:00010000:2.0:1789760785.399209:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73113600 -> 73117696 00002000:00010000:2.0:1789760785.399214:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142824 -> 142832 00010000:00010000:2.0:1789760785.399228:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399240:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399249:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399255:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.399260:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399269:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399293:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.399301:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73113600->73117695] (req 73113600->73117695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.399389:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7259us (7514us total) trans 4294985158 rc 0/0 00000100:00100000:2.0:1789760785.399398:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17861 00000100:00100000:2.0:1789760785.399406:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723634159874 time 723652407317 state 0x2 ref 0 00000100:00100000:3.0:1789760785.402606:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.403949:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515392 00000100:00100000:2.0:1789760785.403963:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515392 00000100:00100000:2.0:1789760785.404025:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723634159874 time 723652407317 state 0x0 ref 1 00000100:00100000:2.0:1789760785.404041:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723652667733 time 723652407317 state 0x1 ref 1 00000100:00100000:2.0:1789760785.404075:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723652667733 time 723664367504 state 0x0 ref 1 00000100:00100000:2.0:1789760785.404087:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.404135:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73117696, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22df0 00010000:00010000:2.0:1789760785.404144:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.404159:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.404164:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.404170:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.404183:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.409266:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985159 is committed 00002000:00010000:2.0:1789760785.409769:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73117696 -> 73121792 00002000:00010000:2.0:1789760785.409775:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142832 -> 142840 00010000:00010000:2.0:1789760785.409788:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409802:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409811:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409818:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.409822:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409832:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409852:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.409865:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e72d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73117696->73121791] (req 73117696->73121791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.409963:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5871us (7360us total) trans 4294985159 rc 0/0 00000100:00100000:2.0:1789760785.409973:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17862 00000100:00100000:2.0:1789760785.409983:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723652667733 time 723664367504 state 0x2 ref 0 00000100:00100000:1.0:1789760785.413157:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.413321:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515520 00000100:00100000:0.0:1789760785.413332:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515520 00000100:00100000:0.0:1789760785.413387:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723652667733 time 723664367504 state 0x0 ref 1 00000100:00100000:0.0:1789760785.413402:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723664627920 time 723664367504 state 0x1 ref 1 00000100:00100000:0.0:1789760785.413434:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723664627920 time 723673726298 state 0x0 ref 1 00000100:00100000:0.0:1789760785.413448:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565515520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.413494:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73121792, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22df8 00010000:00010000:0.0:1789760785.413503:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.413522:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.413527:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.413532:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.413546:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.418150:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985160 is committed 00002000:00010000:0.0:1789760785.418257:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73121792 -> 73125888 00002000:00010000:0.0:1789760785.418263:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142840 -> 142848 00010000:00010000:0.0:1789760785.418275:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418288:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418297:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418305:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.418310:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418320:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418349:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.418358:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e734 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73121792->73125887] (req 73121792->73125887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.418455:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565515520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5005us (5304us total) trans 4294985160 rc 0/0 00000100:00100000:0.0:1789760785.418465:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17863 00000100:00100000:0.0:1789760785.418475:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723664627920 time 723673726298 state 0x2 ref 0 00000100:00100000:0.0:1789760785.422588:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.425202:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515648 00000100:00100000:2.0:1789760785.425218:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515648 00000100:00100000:2.0:1789760785.425281:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723664627920 time 723673726298 state 0x0 ref 1 00000100:00100000:2.0:1789760785.425297:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723673986714 time 723673726298 state 0x1 ref 1 00000100:00100000:2.0:1789760785.425386:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723673986714 time 723685677640 state 0x0 ref 1 00000100:00100000:2.0:1789760785.425400:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565515648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.425449:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73125888, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e00 00010000:00010000:2.0:1789760785.425458:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.425474:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.425479:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.425485:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.425499:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.429627:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985161 is committed 00002000:00010000:2.0:1789760785.429834:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73125888 -> 73129984 00002000:00010000:2.0:1789760785.429840:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142848 -> 142856 00010000:00010000:2.0:1789760785.429853:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429867:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429877:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429885:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.429890:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429900:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429918:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.429925:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674e73b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73125888->73129983] (req 73125888->73129983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.430072:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565515648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4668us (7487us total) trans 4294985161 rc 0/0 00000100:00100000:2.0:1789760785.430083:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17864 00000100:00100000:2.0:1789760785.430092:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723673986714 time 723685677640 state 0x2 ref 0 00000100:00100000:2.0:1789760785.436439:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.436903:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515776 00000100:00100000:3.0:1789760785.436913:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515776 00000100:00100000:3.0:1789760785.436968:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723673986714 time 723685677640 state 0x0 ref 1 00000100:00100000:3.0:1789760785.436984:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723685938056 time 723685677640 state 0x1 ref 1 00000100:00100000:3.0:1789760785.437017:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723685938056 time 723697308836 state 0x0 ref 1 00000100:00100000:3.0:1789760785.437040:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.437086:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73129984, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e08 00010000:00010000:3.0:1789760785.437097:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.437113:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.437117:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.437124:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.437137:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.443458:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985162 is committed 00002000:00010000:3.0:1789760785.443621:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73129984 -> 73134080 00002000:00010000:3.0:1789760785.443626:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142856 -> 142864 00010000:00010000:3.0:1789760785.443641:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443654:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443663:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443671:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.443688:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443697:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443752:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.443760:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e742 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73129984->73134079] (req 73129984->73134079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.443833:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6793us (7399us total) trans 4294985162 rc 0/0 00000100:00100000:3.0:1789760785.443842:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17865 00000100:00100000:3.0:1789760785.443851:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723685938056 time 723697308836 state 0x2 ref 0 00000100:00100000:1.0:1789760785.450990:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.451105:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565515904 00000100:00100000:0.0:1789760785.451117:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565515904 00000100:00100000:0.0:1789760785.451177:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723685938056 time 723697308836 state 0x0 ref 1 00000100:00100000:0.0:1789760785.451194:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723697569252 time 723697308836 state 0x1 ref 1 00000100:00100000:0.0:1789760785.451226:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723697569252 time 723711517461 state 0x0 ref 1 00000100:00100000:0.0:1789760785.451240:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.451291:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73134080, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e10 00010000:00010000:0.0:1789760785.451301:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.451318:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.451322:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.451328:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.451343:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.455839:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985163 is committed 00002000:00010000:1.0:1789760785.456091:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73134080 -> 73138176 00002000:00010000:1.0:1789760785.456096:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142864 -> 142872 00010000:00010000:1.0:1789760785.456111:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456124:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456134:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456141:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.456145:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456155:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456176:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.456184:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73134080->73138175] (req 73134080->73138175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.456317:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565515904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5076us (5335us total) trans 4294985163 rc 0/0 00000100:00100000:1.0:1789760785.456328:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17866 00000100:00100000:1.0:1789760785.456338:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723697569252 time 723711517461 state 0x2 ref 0 00000100:00100000:0.0:1789760785.462980:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760785.463112:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516032 00000100:00100000:2.0:1789760785.463123:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516032 00000100:00100000:2.0:1789760785.463177:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723697569252 time 723711517461 state 0x0 ref 1 00000100:00100000:2.0:1789760785.463194:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723711777877 time 723711517461 state 0x1 ref 1 00000100:00100000:2.0:1789760785.463225:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723711777877 time 723723517206 state 0x0 ref 1 00000100:00100000:2.0:1789760785.463238:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760785.463286:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73138176, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e18 00010000:00010000:2.0:1789760785.463296:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.463314:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1789760785.463318:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.463324:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.463338:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.467982:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985164 is committed 00002000:00010000:0.0:1789760785.468235:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73138176 -> 73142272 00002000:00010000:0.0:1789760785.468240:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142872 -> 142880 00010000:00010000:0.0:1789760785.468252:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468264:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468272:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468279:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.468283:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468291:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468309:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.468317:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674e750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73138176->73142271] (req 73138176->73142271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.468560:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5318us (5583us total) trans 4294985164 rc 0/0 00000100:00100000:0.0:1789760785.468570:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17867 00000100:00100000:0.0:1789760785.468579:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723711777877 time 723723517206 state 0x2 ref 0 00000100:00100000:2.0:1789760785.473460:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760785.473556:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516160 00000100:00100000:3.0:1789760785.473566:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516160 00000100:00100000:3.0:1789760785.473833:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723711777877 time 723723517206 state 0x0 ref 1 00000100:00100000:3.0:1789760785.473850:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723723777622 time 723723517206 state 0x1 ref 1 00000100:00100000:3.0:1789760785.473930:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723723777622 time 723734221756 state 0x0 ref 1 00000100:00100000:3.0:1789760785.473945:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565516160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760785.473989:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73142272, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e20 00010000:00010000:3.0:1789760785.473998:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.474014:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:3.0:1789760785.474030:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.474037:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.474051:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.480187:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985165 is committed 00002000:00010000:3.0:1789760785.480356:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73142272 -> 73146368 00002000:00010000:3.0:1789760785.480361:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142880 -> 142888 00010000:00010000:3.0:1789760785.480375:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480388:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480397:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480405:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.480410:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480419:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480440:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.480452:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73142272->73146367] (req 73142272->73146367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.480578:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565516160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6631us (7122us total) trans 4294985165 rc 0/0 00000100:00100000:3.0:1789760785.480588:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17868 00000100:00100000:3.0:1789760785.480597:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723723777622 time 723734221756 state 0x2 ref 0 00000100:00100000:1.0:1789760785.484523:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.484904:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516288 00000100:00100000:0.0:1789760785.484914:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516288 00000100:00100000:0.0:1789760785.484967:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723723777622 time 723734221756 state 0x0 ref 1 00000100:00100000:0.0:1789760785.484981:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723734482172 time 723734221756 state 0x1 ref 1 00000100:00100000:0.0:1789760785.485015:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723734482172 time 723745307040 state 0x0 ref 1 00000100:00100000:0.0:1789760785.485036:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.485084:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73146368, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e28 00010000:00010000:0.0:1789760785.485094:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.485115:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.485119:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.485125:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.485139:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.488861:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985166 is committed 00002000:00010000:0.0:1789760785.491167:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73146368 -> 73150464 00002000:00010000:0.0:1789760785.491176:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142888 -> 142896 00010000:00010000:0.0:1789760785.491189:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491202:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491211:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491219:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.491224:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491233:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491260:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.491268:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e75e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73146368->73150463] (req 73146368->73150463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.491368:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6330us (6849us total) trans 4294985166 rc 0/0 00000100:00100000:0.0:1789760785.491378:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17869 00000100:00100000:0.0:1789760785.491387:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723734482172 time 723745307040 state 0x2 ref 0 00000100:00100000:0.0:1789760785.495596:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.495959:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516416 00000100:00100000:1.0:1789760785.495971:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516416 00000100:00100000:1.0:1789760785.496040:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723734482172 time 723745307040 state 0x0 ref 1 00000100:00100000:1.0:1789760785.496055:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723745567456 time 723745307040 state 0x1 ref 1 00000100:00100000:1.0:1789760785.496122:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723745567456 time 723756413604 state 0x0 ref 1 00000100:00100000:1.0:1789760785.496135:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565516416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.496185:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73150464, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e30 00010000:00010000:1.0:1789760785.496195:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.496210:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.496214:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.496220:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.496233:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.500107:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985167 is committed 00002000:00010000:1.0:1789760785.500211:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73150464 -> 73154560 00002000:00010000:1.0:1789760785.500217:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142896 -> 142904 00010000:00010000:1.0:1789760785.500231:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500246:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500256:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500264:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.500269:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500279:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500300:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.500308:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73150464->73154559] (req 73150464->73154559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.500400:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565516416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4262us (4808us total) trans 4294985167 rc 0/0 00000100:00100000:1.0:1789760785.500410:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17870 00000100:00100000:1.0:1789760785.500420:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723745567456 time 723756413604 state 0x2 ref 0 00000100:00100000:3.0:1789760785.506341:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.506835:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516544 00000100:00100000:0.0:1789760785.506845:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516544 00000100:00100000:0.0:1789760785.506902:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723745567456 time 723756413604 state 0x0 ref 1 00000100:00100000:0.0:1789760785.506917:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723756674020 time 723756413604 state 0x1 ref 1 00000100:00100000:0.0:1789760785.506995:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723756674020 time 723767285854 state 0x0 ref 1 00000100:00100000:0.0:1789760785.507010:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.507057:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73154560, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e38 00010000:00010000:0.0:1789760785.507075:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.507096:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.507100:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.507107:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.507122:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.516391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985168 is committed 00002000:00010000:3.0:1789760785.516552:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73154560 -> 73158656 00002000:00010000:3.0:1789760785.516557:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142904 -> 142912 00010000:00010000:3.0:1789760785.516572:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516585:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516594:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516602:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.516607:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516616:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516636:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.516644:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e76c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73154560->73158655] (req 73154560->73158655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.516798:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9787us (10474us total) trans 4294985168 rc 0/0 00000100:00100000:3.0:1789760785.516809:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17871 00000100:00100000:3.0:1789760785.516819:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723756674020 time 723767285854 state 0x2 ref 0 00000100:00100000:2.0:1789760785.520548:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.520613:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516672 00000100:00100000:0.0:1789760785.520623:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516672 00000100:00100000:0.0:1789760785.520695:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723756674020 time 723767285854 state 0x0 ref 1 00000100:00100000:0.0:1789760785.520747:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723767546270 time 723767285854 state 0x1 ref 1 00000100:00100000:0.0:1789760785.520772:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723767546270 time 723781063748 state 0x0 ref 1 00000100:00100000:0.0:1789760785.520784:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565516672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.520830:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73158656, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e40 00010000:00010000:0.0:1789760785.520839:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.520854:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.520859:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.520866:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.520882:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.526376:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985169 is committed 00002000:00010000:0.0:1789760785.526521:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73158656 -> 73162752 00002000:00010000:0.0:1789760785.526526:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142912 -> 142920 00010000:00010000:0.0:1789760785.526539:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526552:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526562:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526570:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.526575:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526586:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526603:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.526612:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73158656->73162751] (req 73158656->73162751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.526753:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565516672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5966us (6296us total) trans 4294985169 rc 0/0 00000100:00100000:0.0:1789760785.526764:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17872 00000100:00100000:0.0:1789760785.526774:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723767546270 time 723781063748 state 0x2 ref 0 00000100:00100000:0.0:1789760785.530825:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.530907:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516800 00000100:00100000:1.0:1789760785.530916:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516800 00000100:00100000:1.0:1789760785.530978:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723767546270 time 723781063748 state 0x0 ref 1 00000100:00100000:1.0:1789760785.530993:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723781324164 time 723781063748 state 0x1 ref 1 00000100:00100000:1.0:1789760785.531027:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723781324164 time 723791318914 state 0x0 ref 1 00000100:00100000:1.0:1789760785.531039:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.531089:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73162752, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e48 00010000:00010000:1.0:1789760785.531098:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.531115:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.531119:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.531126:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.531152:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.550638:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985170 is committed 00002000:00010000:1.0:1789760785.550835:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73162752 -> 73166848 00002000:00010000:1.0:1789760785.550841:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142920 -> 142928 00010000:00010000:1.0:1789760785.550854:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.550867:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.550880:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.550887:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.550892:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.550900:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.550919:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.552742:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e77a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73162752->73166847] (req 73162752->73166847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.552852:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565516800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 21810us (22032us total) trans 4294985170 rc 0/0 00000100:00100000:1.0:1789760785.552863:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17873 00000100:00100000:1.0:1789760785.552872:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723781324164 time 723791318914 state 0x2 ref 0 00000100:00100000:3.0:1789760785.566348:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.569096:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565516928 00000100:00100000:0.0:1789760785.569111:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565516928 00000100:00100000:0.0:1789760785.569307:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723781324164 time 723791318914 state 0x0 ref 1 00000100:00100000:0.0:1789760785.569323:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723791579330 time 723791318914 state 0x1 ref 1 00000100:00100000:0.0:1789760785.569417:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723791579330 time 723829708800 state 0x0 ref 1 00000100:00100000:0.0:1789760785.569432:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565516928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.569482:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73166848, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e50 00010000:00010000:0.0:1789760785.569491:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.569507:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.569512:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.569518:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.569532:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.577073:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985171 is committed 00002000:00010000:0.0:1789760785.577224:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73166848 -> 73170944 00002000:00010000:0.0:1789760785.577229:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142928 -> 142936 00010000:00010000:0.0:1789760785.577243:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577256:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577265:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577281:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.577286:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577297:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577317:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.577326:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73166848->73170943] (req 73166848->73170943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.577464:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565516928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8032us (11121us total) trans 4294985171 rc 0/0 00000100:00100000:0.0:1789760785.577476:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17874 00000100:00100000:0.0:1789760785.577486:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723791579330 time 723829708800 state 0x2 ref 0 00000100:00100000:2.0:1789760785.585867:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.586050:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517056 00000100:00100000:0.0:1789760785.586059:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517056 00000100:00100000:0.0:1789760785.586112:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723791579330 time 723829708800 state 0x0 ref 1 00000100:00100000:0.0:1789760785.586126:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723829969216 time 723829708800 state 0x1 ref 1 00000100:00100000:0.0:1789760785.586153:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723829969216 time 723846444745 state 0x0 ref 1 00000100:00100000:0.0:1789760785.586166:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.586212:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73170944, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e58 00010000:00010000:0.0:1789760785.586221:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.586237:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.586242:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.586248:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.586263:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.601859:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985172 is committed 00002000:00010000:0.0:1789760785.601976:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73170944 -> 73175040 00002000:00010000:0.0:1789760785.601981:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142936 -> 142944 00010000:00010000:0.0:1789760785.601994:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602007:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602026:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602035:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.602040:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602050:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602068:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.602077:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73170944->73175039] (req 73170944->73175039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.602164:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15996us (16366us total) trans 4294985172 rc 0/0 00000100:00100000:0.0:1789760785.602174:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17875 00000100:00100000:0.0:1789760785.602184:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723829969216 time 723846444745 state 0x2 ref 0 00000100:00100000:3.0:1789760785.608180:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.608664:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517184 00000100:00100000:1.0:1789760785.608682:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517184 00000100:00100000:1.0:1789760785.608761:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723829969216 time 723846444745 state 0x0 ref 1 00000100:00100000:1.0:1789760785.608775:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723846705161 time 723846444745 state 0x1 ref 1 00000100:00100000:1.0:1789760785.608801:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723846705161 time 723869093215 state 0x0 ref 1 00000100:00100000:1.0:1789760785.608812:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.608854:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73175040, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e60 00010000:00010000:1.0:1789760785.608863:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.608878:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.608882:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.608888:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.608902:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.611895:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760785.622158:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985173 is committed 00002000:00010000:1.0:1789760785.622265:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73175040 -> 73179136 00002000:00010000:1.0:1789760785.622270:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142944 -> 142952 00010000:00010000:1.0:1789760785.622282:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622294:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622308:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622321:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.622326:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622335:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622365:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.622373:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e78f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73175040->73179135] (req 73175040->73179135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.622473:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13657us (14297us total) trans 4294985173 rc 0/0 00000100:00100000:1.0:1789760785.622483:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17876 00000100:00100000:1.0:1789760785.622492:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723846705161 time 723869093215 state 0x2 ref 0 00000100:00100000:3.0:1789760785.632119:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.632411:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517312 00000100:00100000:0.0:1789760785.632420:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517312 00000100:00100000:0.0:1789760785.632472:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723846705161 time 723869093215 state 0x0 ref 1 00000100:00100000:0.0:1789760785.632488:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723869353631 time 723869093215 state 0x1 ref 1 00000100:00100000:0.0:1789760785.632521:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723869353631 time 723892813344 state 0x0 ref 1 00000100:00100000:0.0:1789760785.632533:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.632574:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73179136, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e68 00010000:00010000:0.0:1789760785.632583:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.632598:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.632603:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.632879:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.632898:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.643000:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985174 is committed 00002000:00010000:3.0:1789760785.643454:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73179136 -> 73183232 00002000:00010000:3.0:1789760785.643459:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142952 -> 142960 00010000:00010000:3.0:1789760785.643472:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643485:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643494:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643507:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760785.643511:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643520:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643538:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.643547:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73179136->73183231] (req 73179136->73183231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760785.643697:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11160us (11582us total) trans 4294985174 rc 0/0 00000100:00100000:3.0:1789760785.643750:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17877 00000100:00100000:3.0:1789760785.643760:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723869353631 time 723892813344 state 0x2 ref 0 00000100:00100000:2.0:1789760785.654039:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.654163:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517440 00000100:00100000:0.0:1789760785.654173:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517440 00000100:00100000:0.0:1789760785.654228:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723869353631 time 723892813344 state 0x0 ref 1 00000100:00100000:0.0:1789760785.654247:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723893073760 time 723892813344 state 0x1 ref 1 00000100:00100000:0.0:1789760785.654285:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723893073760 time 723914577329 state 0x0 ref 1 00000100:00100000:0.0:1789760785.654300:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.654348:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73183232, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e70 00010000:00010000:0.0:1789760785.654358:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.654374:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.654379:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.654385:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.654399:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.665957:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985175 is committed 00002000:00010000:0.0:1789760785.666072:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73183232 -> 73187328 00002000:00010000:0.0:1789760785.666078:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142960 -> 142968 00010000:00010000:0.0:1789760785.666095:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666109:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666118:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666126:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.666130:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666139:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666159:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.666168:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e79d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73183232->73187327] (req 73183232->73187327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.666274:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565517440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11972us (12251us total) trans 4294985175 rc 0/0 00000100:00100000:0.0:1789760785.666285:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17878 00000100:00100000:0.0:1789760785.666294:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723893073760 time 723914577329 state 0x2 ref 0 00000100:00100000:0.0:1789760785.682964:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.683083:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517568 00000100:00100000:1.0:1789760785.683093:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517568 00000100:00100000:1.0:1789760785.683147:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723893073760 time 723914577329 state 0x0 ref 1 00000100:00100000:1.0:1789760785.683163:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723914837745 time 723914577329 state 0x1 ref 1 00000100:00100000:1.0:1789760785.683198:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723914837745 time 723943490000 state 0x0 ref 1 00000100:00100000:1.0:1789760785.683215:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.683263:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73187328, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e78 00010000:00010000:1.0:1789760785.683272:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.683289:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.683293:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.683299:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.683314:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.691549:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985176 is committed 00002000:00010000:1.0:1789760785.691683:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73187328 -> 73191424 00002000:00010000:1.0:1789760785.691688:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142968 -> 142976 00010000:00010000:1.0:1789760785.691724:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691737:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691746:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691754:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.691759:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691767:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691785:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.691792:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73187328->73191423] (req 73187328->73191423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.691898:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8672us (9048us total) trans 4294985176 rc 0/0 00000100:00100000:1.0:1789760785.691916:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17879 00000100:00100000:1.0:1789760785.691925:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723914837745 time 723943490000 state 0x2 ref 0 00000100:00100000:3.0:1789760785.696521:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.696684:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517696 00000100:00100000:0.0:1789760785.696693:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517696 00000100:00100000:0.0:1789760785.697096:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723914837745 time 723943490000 state 0x0 ref 1 00000100:00100000:0.0:1789760785.697218:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723943750416 time 723943490000 state 0x1 ref 1 00000100:00100000:1.0:1789760785.697512:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723943750416 time 723957801124 state 0x0 ref 1 00000100:00100000:1.0:1789760785.697528:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.697576:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73191424, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e80 00010000:00010000:1.0:1789760785.697585:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.697601:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.697605:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.697612:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.697625:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.709781:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985177 is committed 00002000:00010000:1.0:1789760785.711813:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73191424 -> 73195520 00002000:00010000:1.0:1789760785.711823:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142976 -> 142984 00010000:00010000:1.0:1789760785.711836:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711850:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711861:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711869:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.711874:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711883:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711902:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.711916:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73191424->73195519] (req 73191424->73195519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.712026:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14490us (15847us total) trans 4294985177 rc 0/0 00000100:00100000:1.0:1789760785.712037:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17880 00000100:00100000:1.0:1789760785.712048:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723943750416 time 723957801124 state 0x2 ref 0 00000100:00100000:2.0:1789760785.723022:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.723471:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517824 00000100:00100000:0.0:1789760785.723481:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517824 00000100:00100000:0.0:1789760785.723537:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723943750416 time 723957801124 state 0x0 ref 1 00000100:00100000:0.0:1789760785.723553:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723958061540 time 723957801124 state 0x1 ref 1 00000100:00100000:0.0:1789760785.723624:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723958061540 time 723983915360 state 0x0 ref 1 00000100:00100000:0.0:1789760785.723638:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.723733:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73195520, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e88 00010000:00010000:0.0:1789760785.723743:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.723759:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789760785.723763:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.723770:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.723783:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.731494:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985178 is committed 00002000:00010000:0.0:1789760785.731639:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73195520 -> 73199616 00002000:00010000:0.0:1789760785.731645:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142984 -> 142992 00010000:00010000:0.0:1789760785.731660:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731684:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731700:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731750:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.731755:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731764:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731783:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.731789:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73195520->73199615] (req 73195520->73199615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.731880:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565517824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8240us (8863us total) trans 4294985178 rc 0/0 00000100:00100000:0.0:1789760785.731890:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17881 00000100:00100000:0.0:1789760785.731898:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723958061540 time 723983915360 state 0x2 ref 0 00000100:00100000:3.0:1789760785.736261:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.736404:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565517952 00000100:00100000:1.0:1789760785.736414:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565517952 00000100:00100000:1.0:1789760785.736464:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723958061540 time 723983915360 state 0x0 ref 1 00000100:00100000:1.0:1789760785.736479:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723984175776 time 723983915360 state 0x1 ref 1 00000100:00100000:1.0:1789760785.736509:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723984175776 time 723996801340 state 0x0 ref 1 00000100:00100000:1.0:1789760785.736522:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565517952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.736567:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73199616, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e90 00010000:00010000:1.0:1789760785.736577:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.736591:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789760785.736595:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.736602:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.736622:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.742905:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985179 is committed 00002000:00010000:1.0:1789760785.743028:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73199616 -> 73203712 00002000:00010000:1.0:1789760785.743033:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 142992 -> 143000 00010000:00010000:1.0:1789760785.743047:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743060:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743070:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743077:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.743082:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743091:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743114:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.743122:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73199616->73203711] (req 73199616->73203711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.743210:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565517952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6685us (6953us total) trans 4294985179 rc 0/0 00000100:00100000:1.0:1789760785.743220:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17882 00000100:00100000:1.0:1789760785.743229:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723984175776 time 723996801340 state 0x2 ref 0 00000100:00100000:3.0:1789760785.747208:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.747285:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518080 00000100:00100000:1.0:1789760785.747295:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518080 00000100:00100000:1.0:1789760785.747351:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723984175776 time 723996801340 state 0x0 ref 1 00000100:00100000:1.0:1789760785.747367:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723997061756 time 723996801340 state 0x1 ref 1 00000100:00100000:1.0:1789760785.747399:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723997061756 time 724007691316 state 0x0 ref 1 00000100:00100000:1.0:1789760785.747412:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.747456:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73203712, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22e98 00010000:00010000:1.0:1789760785.747465:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.747483:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.747488:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.747494:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.747508:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.753105:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985180 is committed 00002000:00010000:1.0:1789760785.757072:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73203712 -> 73207808 00002000:00010000:1.0:1789760785.757083:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143000 -> 143008 00010000:00010000:1.0:1789760785.757096:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757109:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757118:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757126:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.757131:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757140:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757161:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.757169:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73203712->73207807] (req 73203712->73207807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.757404:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9989us (10201us total) trans 4294985180 rc 0/0 00000100:00100000:1.0:1789760785.757415:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17883 00000100:00100000:1.0:1789760785.757424:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723997061756 time 724007691316 state 0x2 ref 0 00000100:00100000:2.0:1789760785.764670:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.764901:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518208 00000100:00100000:0.0:1789760785.764911:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518208 00000100:00100000:0.0:1789760785.764965:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 723997061756 time 724007691316 state 0x0 ref 1 00000100:00100000:0.0:1789760785.764981:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724007951732 time 724007691316 state 0x1 ref 1 00000100:00100000:0.0:1789760785.765012:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724007951732 time 724025304046 state 0x0 ref 1 00000100:00100000:0.0:1789760785.765025:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565518208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.765071:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73207808, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ea0 00010000:00010000:0.0:1789760785.765080:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.765095:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.765099:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.765105:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.765118:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.769690:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985181 is committed 00002000:00010000:0.0:1789760785.769887:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73207808 -> 73211904 00002000:00010000:0.0:1789760785.769893:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143008 -> 143016 00010000:00010000:0.0:1789760785.769907:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769920:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769930:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769944:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.769949:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769957:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769977:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.769985:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73207808->73211903] (req 73207808->73211903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.770190:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565518208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5162us (5526us total) trans 4294985181 rc 0/0 00000100:00100000:0.0:1789760785.770201:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17884 00000100:00100000:0.0:1789760785.770210:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724007951732 time 724025304046 state 0x2 ref 0 00000100:00100000:3.0:1789760785.774871:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.775317:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518336 00000100:00100000:1.0:1789760785.775327:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518336 00000100:00100000:1.0:1789760785.775380:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724007951732 time 724025304046 state 0x0 ref 1 00000100:00100000:1.0:1789760785.775397:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724025564462 time 724025304046 state 0x1 ref 1 00000100:00100000:1.0:1789760785.775429:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724025564462 time 724035721398 state 0x0 ref 1 00000100:00100000:1.0:1789760785.775441:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.775486:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73211904, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ea8 00010000:00010000:1.0:1789760785.775496:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.775512:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.775516:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.775523:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.775537:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.779687:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985182 is committed 00002000:00010000:1.0:1789760785.783130:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73211904 -> 73216000 00002000:00010000:1.0:1789760785.783139:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143016 -> 143024 00010000:00010000:1.0:1789760785.783152:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783167:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783176:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783184:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.783189:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783199:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783219:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.783227:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73211904->73215999] (req 73211904->73215999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.783894:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8449us (9027us total) trans 4294985182 rc 0/0 00000100:00100000:1.0:1789760785.783905:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17885 00000100:00100000:1.0:1789760785.783914:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724025564462 time 724035721398 state 0x2 ref 0 00000100:00100000:3.0:1789760785.797107:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.797363:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518464 00000100:00100000:1.0:1789760785.797374:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518464 00000100:00100000:1.0:1789760785.797427:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724025564462 time 724035721398 state 0x0 ref 1 00000100:00100000:1.0:1789760785.797442:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724035981814 time 724035721398 state 0x1 ref 1 00000100:00100000:1.0:1789760785.797472:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724035981814 time 724057764465 state 0x0 ref 1 00000100:00100000:1.0:1789760785.797484:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.797533:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73216000, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22eb0 00010000:00010000:1.0:1789760785.797543:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.797559:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.797563:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.797570:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.797584:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.803225:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985183 is committed 00002000:00010000:1.0:1789760785.803497:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73216000 -> 73220096 00002000:00010000:1.0:1789760785.803502:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143024 -> 143032 00010000:00010000:1.0:1789760785.803515:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803532:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803541:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803548:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.803552:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803561:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803581:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.803589:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73216000->73220095] (req 73216000->73220095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.803870:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6382us (6768us total) trans 4294985183 rc 0/0 00000100:00100000:1.0:1789760785.803881:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17886 00000100:00100000:1.0:1789760785.803892:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724035981814 time 724057764465 state 0x2 ref 0 00000100:00100000:3.0:1789760785.808820:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.809163:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518592 00000100:00100000:0.0:1789760785.809173:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518592 00000100:00100000:0.0:1789760785.809230:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724035981814 time 724057764465 state 0x0 ref 1 00000100:00100000:0.0:1789760785.809246:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724058024881 time 724057764465 state 0x1 ref 1 00000100:00100000:0.0:1789760785.809268:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724058024881 time 724069560270 state 0x0 ref 1 00000100:00100000:0.0:1789760785.809283:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.809330:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73220096, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22eb8 00010000:00010000:0.0:1789760785.809340:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.809356:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.809360:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.809367:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.809380:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.815583:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985184 is committed 00002000:00010000:1.0:1789760785.815698:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73220096 -> 73224192 00002000:00010000:1.0:1789760785.815737:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143032 -> 143040 00010000:00010000:1.0:1789760785.815751:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815763:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815772:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815780:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.815785:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815794:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815815:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.815822:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e7dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73220096->73224191] (req 73220096->73224191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.816040:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565518592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6754us (7225us total) trans 4294985184 rc 0/0 00000100:00100000:1.0:1789760785.816051:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17887 00000100:00100000:1.0:1789760785.816060:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724058024881 time 724069560270 state 0x2 ref 0 00000100:00100000:3.0:1789760785.819093:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.819173:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518720 00000100:00100000:1.0:1789760785.819182:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518720 00000100:00100000:1.0:1789760785.819231:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724058024881 time 724069560270 state 0x0 ref 1 00000100:00100000:1.0:1789760785.819246:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724069820686 time 724069560270 state 0x1 ref 1 00000100:00100000:1.0:1789760785.819281:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724069820686 time 724079571987 state 0x0 ref 1 00000100:00100000:1.0:1789760785.819293:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565518720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.819353:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73224192, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ec0 00010000:00010000:1.0:1789760785.819362:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.819384:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.819389:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.819396:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.819409:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.826991:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985185 is committed 00002000:00010000:1.0:1789760785.827196:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73224192 -> 73228288 00002000:00010000:1.0:1789760785.827201:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143040 -> 143048 00010000:00010000:1.0:1789760785.827214:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827235:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827244:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827252:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.827257:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827267:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827286:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.827293:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e7e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73224192->73228287] (req 73224192->73228287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.827396:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565518720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8100us (8307us total) trans 4294985185 rc 0/0 00000100:00100000:1.0:1789760785.827407:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17888 00000100:00100000:1.0:1789760785.827417:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724069820686 time 724079571987 state 0x2 ref 0 00000100:00100000:3.0:1789760785.834370:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.834489:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518848 00000100:00100000:1.0:1789760785.834508:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518848 00000100:00100000:1.0:1789760785.834562:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724069820686 time 724079571987 state 0x0 ref 1 00000100:00100000:1.0:1789760785.834576:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724079832403 time 724079571987 state 0x1 ref 1 00000100:00100000:1.0:1789760785.834615:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724079832403 time 724094906653 state 0x0 ref 1 00000100:00100000:1.0:1789760785.834626:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.834681:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73228288, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ec8 00010000:00010000:1.0:1789760785.834690:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.834723:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.834729:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.834735:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.834749:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.839275:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985186 is committed 00002000:00010000:1.0:1789760785.839393:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73228288 -> 73232384 00002000:00010000:1.0:1789760785.839399:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143048 -> 143056 00010000:00010000:1.0:1789760785.839413:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839426:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839442:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839450:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.839454:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839463:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839482:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.839491:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73228288->73232383] (req 73228288->73232383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.839944:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5304us (6258us total) trans 4294985186 rc 0/0 00000100:00100000:1.0:1789760785.839956:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17889 00000100:00100000:1.0:1789760785.839966:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724079832403 time 724094906653 state 0x2 ref 0 00000100:00100000:2.0:1789760785.851248:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.851456:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565518976 00000100:00100000:1.0:1789760785.851465:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565518976 00000100:00100000:1.0:1789760785.851518:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724079832403 time 724094906653 state 0x0 ref 1 00000100:00100000:1.0:1789760785.851533:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724095167069 time 724094906653 state 0x1 ref 1 00000100:00100000:1.0:1789760785.851565:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724095167069 time 724111857338 state 0x0 ref 1 00000100:00100000:1.0:1789760785.851577:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.851624:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73232384, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ed0 00010000:00010000:1.0:1789760785.851633:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.851649:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.851653:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.851659:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.851935:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.856006:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985187 is committed 00002000:00010000:1.0:1789760785.856219:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73232384 -> 73236480 00002000:00010000:1.0:1789760785.856225:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143056 -> 143064 00010000:00010000:1.0:1789760785.856238:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856251:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856261:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856274:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.856278:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856287:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856306:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.856314:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73232384->73236479] (req 73232384->73236479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.856488:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565518976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4907us (5243us total) trans 4294985187 rc 0/0 00000100:00100000:1.0:1789760785.856499:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17890 00000100:00100000:1.0:1789760785.856510:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724095167069 time 724111857338 state 0x2 ref 0 00000100:00100000:2.0:1789760785.866690:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.866878:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519104 00000100:00100000:1.0:1789760785.866887:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519104 00000100:00100000:1.0:1789760785.866941:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724095167069 time 724111857338 state 0x0 ref 1 00000100:00100000:1.0:1789760785.866957:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724112117754 time 724111857338 state 0x1 ref 1 00000100:00100000:1.0:1789760785.866987:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724112117754 time 724127279704 state 0x0 ref 1 00000100:00100000:1.0:1789760785.867003:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.867061:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73236480, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ed8 00010000:00010000:1.0:1789760785.867080:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.867096:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.867101:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.867107:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.867121:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.871057:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985188 is committed 00002000:00010000:1.0:1789760785.871446:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73236480 -> 73240576 00002000:00010000:1.0:1789760785.871451:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143064 -> 143072 00010000:00010000:1.0:1789760785.871464:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871475:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871482:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871491:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.871497:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871506:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871526:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.871535:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e7f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73236480->73240575] (req 73236480->73240575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.871627:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4622us (4954us total) trans 4294985188 rc 0/0 00000100:00100000:1.0:1789760785.871638:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17891 00000100:00100000:1.0:1789760785.871647:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724112117754 time 724127279704 state 0x2 ref 0 00000100:00100000:2.0:1789760785.875373:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.875701:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519232 00000100:00100000:1.0:1789760785.875870:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519232 00000100:00100000:0.0:1789760785.875986:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724112117754 time 724127279704 state 0x0 ref 1 00000100:00100000:0.0:1789760785.876002:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724127540120 time 724127279704 state 0x1 ref 1 00000100:00100000:0.0:1789760785.876079:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724127540120 time 724136370543 state 0x0 ref 1 00000100:00100000:0.0:1789760785.876094:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565519232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.876140:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73240576, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ee0 00010000:00010000:0.0:1789760785.876151:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.876172:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.876176:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.876183:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.876197:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.881282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985189 is committed 00002000:00010000:1.0:1789760785.881405:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73240576 -> 73244672 00002000:00010000:1.0:1789760785.881410:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143072 -> 143080 00010000:00010000:1.0:1789760785.881423:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881435:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881444:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881452:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.881457:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881466:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881485:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.881493:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e7ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73240576->73244671] (req 73240576->73244671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.881630:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565519232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5534us (6261us total) trans 4294985189 rc 0/0 00000100:00100000:1.0:1789760785.881641:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17892 00000100:00100000:1.0:1789760785.881650:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724127540120 time 724136370543 state 0x2 ref 0 00000100:00100000:2.0:1789760785.885585:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.885680:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519360 00000100:00100000:1.0:1789760785.885690:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519360 00000100:00100000:1.0:1789760785.885848:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724127540120 time 724136370543 state 0x0 ref 1 00000100:00100000:1.0:1789760785.885864:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724136630959 time 724136370543 state 0x1 ref 1 00000100:00100000:1.0:1789760785.885899:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724136630959 time 724146190980 state 0x0 ref 1 00000100:00100000:0.0:1789760785.885943:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.885993:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73244672, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ee8 00010000:00010000:0.0:1789760785.886002:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.886019:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.886412:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.886420:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.886436:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.890692:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985190 is committed 00002000:00010000:0.0:1789760785.890898:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73244672 -> 73248768 00002000:00010000:0.0:1789760785.890903:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143080 -> 143088 00010000:00010000:0.0:1789760785.890916:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890934:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890944:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890950:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.890955:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890964:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890983:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.890992:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73244672->73248767] (req 73244672->73248767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.891154:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5237us (5573us total) trans 4294985190 rc 0/0 00000100:00100000:0.0:1789760785.891164:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17893 00000100:00100000:0.0:1789760785.891173:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724136630959 time 724146190980 state 0x2 ref 0 00000100:00100000:2.0:1789760785.894478:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.894576:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519488 00000100:00100000:1.0:1789760785.894586:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519488 00000100:00100000:1.0:1789760785.894651:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724136630959 time 724146190980 state 0x0 ref 1 00000100:00100000:1.0:1789760785.894666:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724146451396 time 724146190980 state 0x1 ref 1 00000100:00100000:1.0:1789760785.894736:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724146451396 time 724154996641 state 0x0 ref 1 00000100:00100000:1.0:1789760785.894749:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565519488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.894795:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73248768, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ef0 00010000:00010000:1.0:1789760785.894804:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.894820:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.894825:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.894831:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.894844:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.898678:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985191 is committed 00002000:00010000:2.0:1789760785.898829:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73248768 -> 73252864 00002000:00010000:2.0:1789760785.898834:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143088 -> 143096 00010000:00010000:2.0:1789760785.898847:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898865:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898873:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898882:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.898886:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898895:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898915:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898922:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674e80d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73248768->73252863] (req 73248768->73252863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.899145:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565519488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4392us (4671us total) trans 4294985191 rc 0/0 00000100:00100000:2.0:1789760785.899156:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17894 00000100:00100000:2.0:1789760785.899165:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724146451396 time 724154996641 state 0x2 ref 0 00000100:00100000:2.0:1789760785.906968:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.907087:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519616 00000100:00100000:1.0:1789760785.907097:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519616 00000100:00100000:1.0:1789760785.907157:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724146451396 time 724154996641 state 0x0 ref 1 00000100:00100000:1.0:1789760785.907171:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724155257057 time 724154996641 state 0x1 ref 1 00000100:00100000:1.0:1789760785.907205:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724155257057 time 724167497456 state 0x0 ref 1 00000100:00100000:1.0:1789760785.907222:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565519616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.907271:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73252864, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22ef8 00010000:00010000:1.0:1789760785.907280:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.907295:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.907299:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.907305:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.907318:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.913346:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985192 is committed 00002000:00010000:1.0:1789760785.914807:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73252864 -> 73256960 00002000:00010000:1.0:1789760785.914816:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143096 -> 143104 00010000:00010000:1.0:1789760785.914829:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914840:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914848:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914862:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.914867:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914875:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914895:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.914903:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73252864->73256959] (req 73252864->73256959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.914998:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565519616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7774us (8035us total) trans 4294985192 rc 0/0 00000100:00100000:1.0:1789760785.915008:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17895 00000100:00100000:1.0:1789760785.915018:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724155257057 time 724167497456 state 0x2 ref 0 00000100:00100000:2.0:1789760785.920419:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.920535:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519744 00000100:00100000:0.0:1789760785.920548:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519744 00000100:00100000:0.0:1789760785.920605:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724155257057 time 724167497456 state 0x0 ref 1 00000100:00100000:0.0:1789760785.920634:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724167757872 time 724167497456 state 0x1 ref 1 00000100:00100000:0.0:1789760785.920661:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724167757872 time 724180953466 state 0x0 ref 1 00000100:00100000:0.0:1789760785.920684:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565519744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.920760:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73256960, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22f00 00010000:00010000:0.0:1789760785.920770:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.920784:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.920789:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.920795:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.920810:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.925870:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985193 is committed 00002000:00010000:0.0:1789760785.926102:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73256960 -> 73261056 00002000:00010000:0.0:1789760785.926108:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143104 -> 143112 00010000:00010000:0.0:1789760785.926120:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926137:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926145:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926152:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.926157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926164:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926181:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.926188:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e81b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73256960->73261055] (req 73256960->73261055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.926462:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565519744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5785us (6047us total) trans 4294985193 rc 0/0 00000100:00100000:0.0:1789760785.926472:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17896 00000100:00100000:0.0:1789760785.926481:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724167757872 time 724180953466 state 0x2 ref 0 00000100:00100000:2.0:1789760785.934074:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.934414:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565519872 00000100:00100000:0.0:1789760785.934425:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565519872 00000100:00100000:0.0:1789760785.934481:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724167757872 time 724180953466 state 0x0 ref 1 00000100:00100000:0.0:1789760785.934496:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724181213882 time 724180953466 state 0x1 ref 1 00000100:00100000:0.0:1789760785.934537:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724181213882 time 724194828934 state 0x0 ref 1 00000100:00100000:0.0:1789760785.934549:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.934594:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73261056, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0x22f08 00010000:00010000:0.0:1789760785.934603:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.934618:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.934622:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.934628:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.934641:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760785.939646:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985194 is committed 00002000:00010000:0.0:1789760785.940456:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73261056 -> 73265152 00002000:00010000:0.0:1789760785.940462:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760785 -> 1789760786 00002000:00010000:0.0:1789760785.940464:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760785 -> 1789760786 00002000:00010000:0.0:1789760785.940466:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143112 -> 143120 00010000:00010000:0.0:1789760785.940479:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940497:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940506:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940514:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.940519:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940529:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940550:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.940558:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73261056->73265151] (req 73261056->73265151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.940743:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565519872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6191us (6674us total) trans 4294985194 rc 0/0 00000100:00100000:0.0:1789760785.940754:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17897 00000100:00100000:0.0:1789760785.940763:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724181213882 time 724194828934 state 0x2 ref 0 00000100:00100000:2.0:1789760785.948488:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.950111:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520000 00000100:00100000:1.0:1789760785.950124:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520000 00000100:00100000:1.0:1789760785.951096:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724181213882 time 724194828934 state 0x0 ref 1 00000100:00100000:1.0:1789760785.951115:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724195089350 time 724194828934 state 0x1 ref 1 00000100:00100000:1.0:1789760785.951211:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724195089350 time 724211502274 state 0x0 ref 1 00000100:00100000:1.0:1789760785.951228:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.951290:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73265152, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f10 00010000:00010000:1.0:1789760785.951300:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.951317:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.951322:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.951328:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.951342:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.962761:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985195 is committed 00002000:00010000:1.0:1789760785.962886:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73265152 -> 73269248 00002000:00010000:1.0:1789760785.962891:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143120 -> 143128 00010000:00010000:1.0:1789760785.962905:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962918:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962927:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962935:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760785.962940:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962949:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962969:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.962978:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73265152->73269247] (req 73265152->73269247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.963071:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11842us (14586us total) trans 4294985195 rc 0/0 00000100:00100000:1.0:1789760785.963082:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17898 00000100:00100000:1.0:1789760785.963091:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724195089350 time 724211502274 state 0x2 ref 0 00000100:00100000:2.0:1789760785.975117:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.975225:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520128 00000100:00100000:0.0:1789760785.975235:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520128 00000100:00100000:0.0:1789760785.975304:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724195089350 time 724211502274 state 0x0 ref 1 00000100:00100000:0.0:1789760785.975319:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724211762690 time 724211502274 state 0x1 ref 1 00000100:00100000:0.0:1789760785.975387:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724211762690 time 724235679287 state 0x0 ref 1 00000100:00100000:0.0:1789760785.975400:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.975459:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73269248, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f18 00010000:00010000:0.0:1789760785.975468:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.975482:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.975487:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.975493:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.975506:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760785.983253:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985196 is committed 00002000:00010000:2.0:1789760785.983451:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73269248 -> 73273344 00002000:00010000:2.0:1789760785.983465:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143128 -> 143136 00010000:00010000:2.0:1789760785.983479:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983491:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983500:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983507:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760785.983512:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983521:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983541:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.983549:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674e830 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73269248->73273343] (req 73269248->73273343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.983644:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8242us (8533us total) trans 4294985196 rc 0/0 00000100:00100000:2.0:1789760785.983652:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17899 00000100:00100000:2.0:1789760785.983661:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724211762690 time 724235679287 state 0x2 ref 0 00000100:00100000:2.0:1789760785.988318:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760785.988419:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520256 00000100:00100000:0.0:1789760785.988428:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520256 00000100:00100000:0.0:1789760785.988481:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724211762690 time 724235679287 state 0x0 ref 1 00000100:00100000:0.0:1789760785.988496:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724235939703 time 724235679287 state 0x1 ref 1 00000100:00100000:0.0:1789760785.988568:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724235939703 time 724248859267 state 0x0 ref 1 00000100:00100000:0.0:1789760785.988582:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565520256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760785.988641:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73273344, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f20 00010000:00010000:0.0:1789760785.988650:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.988666:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760785.988883:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.988891:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.988906:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760785.995790:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985197 is committed 00002000:00010000:0.0:1789760785.996084:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73273344 -> 73277440 00002000:00010000:0.0:1789760785.996089:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143136 -> 143144 00010000:00010000:0.0:1789760785.996104:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996118:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996128:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996136:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760785.996142:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996152:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996172:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.996180:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73273344->73277439] (req 73273344->73277439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.996309:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565520256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7724us (7996us total) trans 4294985197 rc 0/0 00000100:00100000:0.0:1789760785.996319:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17900 00000100:00100000:0.0:1789760785.996328:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724235939703 time 724248859267 state 0x2 ref 0 00000100:00100000:0.0:1789760785.999193:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760785.999422:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520384 00000100:00100000:1.0:1789760785.999431:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520384 00000100:00100000:1.0:1789760785.999485:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724235939703 time 724248859267 state 0x0 ref 1 00000100:00100000:1.0:1789760785.999498:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724249119683 time 724248859267 state 0x1 ref 1 00000100:00100000:1.0:1789760785.999533:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724249119683 time 724259825115 state 0x0 ref 1 00000100:00100000:1.0:1789760785.999546:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565520384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760785.999591:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73277440, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f28 00010000:00010000:1.0:1789760785.999600:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.999626:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760785.999630:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.999636:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.999649:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.004920:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985198 is committed 00002000:00010000:1.0:1789760786.005152:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73277440 -> 73281536 00002000:00010000:1.0:1789760786.005157:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143144 -> 143152 00010000:00010000:1.0:1789760786.005171:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005182:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005190:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005197:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.005202:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005210:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005230:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.005239:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e83e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73277440->73281535] (req 73277440->73281535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.005329:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565520384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5780us (6139us total) trans 4294985198 rc 0/0 00000100:00100000:1.0:1789760786.005339:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17901 00000100:00100000:1.0:1789760786.005349:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724249119683 time 724259825115 state 0x2 ref 0 00000100:00100000:2.0:1789760786.010045:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.010117:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520512 00000100:00100000:0.0:1789760786.010126:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520512 00000100:00100000:0.0:1789760786.010238:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724249119683 time 724259825115 state 0x0 ref 1 00000100:00100000:0.0:1789760786.010254:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724260085531 time 724259825115 state 0x1 ref 1 00000100:00100000:0.0:1789760786.010282:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724260085531 time 724270574268 state 0x0 ref 1 00000100:00100000:0.0:1789760786.010297:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.010352:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73281536, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f30 00010000:00010000:0.0:1789760786.010362:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.010377:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.010381:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.010387:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.010402:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760786.012714:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789760786.015535:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985199 is committed 00002000:00010000:0.0:1789760786.015682:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73281536 -> 73285632 00002000:00010000:0.0:1789760786.015687:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143152 -> 143160 00010000:00010000:0.0:1789760786.015700:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015733:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015743:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015751:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.015755:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015769:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015789:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.015797:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e845 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73281536->73285631] (req 73281536->73285631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.015888:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565520512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5591us (5848us total) trans 4294985199 rc 0/0 00000100:00100000:0.0:1789760786.016006:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17902 00000100:00100000:0.0:1789760786.016263:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724260085531 time 724270574268 state 0x2 ref 0 00000100:00100000:2.0:1789760786.019750:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.019888:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520640 00000100:00100000:0.0:1789760786.019906:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520640 00000100:00100000:0.0:1789760786.019960:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724260085531 time 724270574268 state 0x0 ref 1 00000100:00100000:0.0:1789760786.019974:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724270834684 time 724270574268 state 0x1 ref 1 00000100:00100000:0.0:1789760786.020003:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724270834684 time 724280295158 state 0x0 ref 1 00000100:00100000:0.0:1789760786.020023:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565520640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.020074:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73285632, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f38 00010000:00010000:0.0:1789760786.020083:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.020099:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.020104:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.020110:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.020123:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.027765:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985200 is committed 00002000:00010000:0.0:1789760786.027888:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73285632 -> 73289728 00002000:00010000:0.0:1789760786.027894:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143160 -> 143168 00010000:00010000:0.0:1789760786.027908:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027921:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027931:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027939:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.027944:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027954:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027979:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.027988:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e84c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73285632->73289727] (req 73285632->73289727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.028091:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565520640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8072us (8382us total) trans 4294985200 rc 0/0 00000100:00100000:0.0:1789760786.028101:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17903 00000100:00100000:0.0:1789760786.028110:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724270834684 time 724280295158 state 0x2 ref 0 00000100:00100000:2.0:1789760786.034954:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.035058:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520768 00000100:00100000:1.0:1789760786.035069:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520768 00000100:00100000:1.0:1789760786.035124:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724270834684 time 724280295158 state 0x0 ref 1 00000100:00100000:1.0:1789760786.035139:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724280555574 time 724280295158 state 0x1 ref 1 00000100:00100000:1.0:1789760786.035167:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724280555574 time 724295459346 state 0x0 ref 1 00000100:00100000:1.0:1789760786.035182:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565520768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.035228:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73289728, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f40 00010000:00010000:1.0:1789760786.035238:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.035255:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.035261:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.035268:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.035283:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.040030:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985201 is committed 00002000:00010000:1.0:1789760786.040886:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73289728 -> 73293824 00002000:00010000:1.0:1789760786.040904:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143168 -> 143176 00010000:00010000:1.0:1789760786.040919:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040933:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040942:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040949:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.040954:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040963:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040982:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.040994:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e853 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73289728->73293823] (req 73289728->73293823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.041086:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565520768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5902us (6137us total) trans 4294985201 rc 0/0 00000100:00100000:1.0:1789760786.041095:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17904 00000100:00100000:1.0:1789760786.041104:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724280555574 time 724295459346 state 0x2 ref 0 00000100:00100000:2.0:1789760786.049248:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.049843:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565520896 00000100:00100000:0.0:1789760786.049854:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565520896 00000100:00100000:0.0:1789760786.049908:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724280555574 time 724295459346 state 0x0 ref 1 00000100:00100000:0.0:1789760786.049924:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724295719762 time 724295459346 state 0x1 ref 1 00000100:00100000:0.0:1789760786.049951:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724295719762 time 724310243318 state 0x0 ref 1 00000100:00100000:0.0:1789760786.049965:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565520896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.050011:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73293824, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f48 00010000:00010000:0.0:1789760786.050020:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.050035:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.050041:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.050048:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.050063:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.057191:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985202 is committed 00002000:00010000:0.0:1789760786.058082:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73293824 -> 73297920 00002000:00010000:0.0:1789760786.058088:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143176 -> 143184 00010000:00010000:0.0:1789760786.058102:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058115:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058125:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058132:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.058136:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058210:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058231:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.058311:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e85a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73293824->73297919] (req 73293824->73297919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.058446:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565520896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8479us (9204us total) trans 4294985202 rc 0/0 00000100:00100000:0.0:1789760786.058566:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17905 00000100:00100000:0.0:1789760786.058577:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724295719762 time 724310243318 state 0x2 ref 0 00000100:00100000:1.0:1789760786.063404:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.063502:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521024 00000100:00100000:0.0:1789760786.063513:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521024 00000100:00100000:0.0:1789760786.063572:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724295719762 time 724310243318 state 0x0 ref 1 00000100:00100000:0.0:1789760786.063589:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724310503734 time 724310243318 state 0x1 ref 1 00000100:00100000:0.0:1789760786.063618:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724310503734 time 724323910342 state 0x0 ref 1 00000100:00100000:0.0:1789760786.063631:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.063696:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73297920, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f50 00010000:00010000:0.0:1789760786.064325:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.064341:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.064345:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.064350:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.064370:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.072701:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985203 is committed 00002000:00010000:1.0:1789760786.072913:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73297920 -> 73302016 00002000:00010000:1.0:1789760786.072918:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143184 -> 143192 00010000:00010000:1.0:1789760786.072932:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.072944:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.072952:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.072959:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.072964:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.072972:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.072992:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.073000:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674e861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73297920->73302015] (req 73297920->73302015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.073153:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9519us (9754us total) trans 4294985203 rc 0/0 00000100:00100000:1.0:1789760786.073163:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17906 00000100:00100000:1.0:1789760786.073172:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724310503734 time 724323910342 state 0x2 ref 0 00000100:00100000:2.0:1789760786.078785:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.078933:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521152 00000100:00100000:1.0:1789760786.078943:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521152 00000100:00100000:1.0:1789760786.078995:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724310503734 time 724323910342 state 0x0 ref 1 00000100:00100000:1.0:1789760786.079010:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724324170758 time 724323910342 state 0x1 ref 1 00000100:00100000:1.0:1789760786.079039:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724324170758 time 724339331612 state 0x0 ref 1 00000100:00100000:1.0:1789760786.079051:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.079093:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73302016, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f58 00010000:00010000:1.0:1789760786.079101:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.079116:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.079120:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.079126:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.079137:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.086224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985204 is committed 00002000:00010000:1.0:1789760786.086461:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73302016 -> 73306112 00002000:00010000:1.0:1789760786.086467:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143192 -> 143200 00010000:00010000:1.0:1789760786.086481:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086494:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086503:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086509:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.086514:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086522:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086542:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.086556:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e868 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73302016->73306111] (req 73302016->73306111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.086648:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7594us (7867us total) trans 4294985204 rc 0/0 00000100:00100000:1.0:1789760786.086658:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17907 00000100:00100000:1.0:1789760786.086680:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724324170758 time 724339331612 state 0x2 ref 0 00000100:00100000:2.0:1789760786.092342:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.092510:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521280 00000100:00100000:0.0:1789760786.092519:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521280 00000100:00100000:0.0:1789760786.092578:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724324170758 time 724339331612 state 0x0 ref 1 00000100:00100000:0.0:1789760786.092593:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724339592028 time 724339331612 state 0x1 ref 1 00000100:00100000:0.0:1789760786.092697:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724339592028 time 724352986756 state 0x0 ref 1 00000100:00100000:0.0:1789760786.092755:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565521280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.092802:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73306112, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f60 00010000:00010000:0.0:1789760786.092811:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.092826:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.092830:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.092836:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.092850:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.098118:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985205 is committed 00002000:00010000:0.0:1789760786.098414:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73306112 -> 73310208 00002000:00010000:0.0:1789760786.098419:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143200 -> 143208 00010000:00010000:0.0:1789760786.098432:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098444:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098453:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098470:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.098474:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098484:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098595:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.098605:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e86f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73306112->73310207] (req 73306112->73310207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.098881:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565521280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6123us (6543us total) trans 4294985205 rc 0/0 00000100:00100000:0.0:1789760786.098892:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17908 00000100:00100000:0.0:1789760786.098901:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724339592028 time 724352986756 state 0x2 ref 0 00000100:00100000:2.0:1789760786.107260:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.107914:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521408 00000100:00100000:1.0:1789760786.107924:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521408 00000100:00100000:1.0:1789760786.107978:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724339592028 time 724352986756 state 0x0 ref 1 00000100:00100000:1.0:1789760786.107994:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724353247172 time 724352986756 state 0x1 ref 1 00000100:00100000:1.0:1789760786.108066:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724353247172 time 724368356404 state 0x0 ref 1 00000100:00100000:1.0:1789760786.108080:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565521408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.108129:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73310208, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f68 00010000:00010000:1.0:1789760786.108139:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.108155:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.108158:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.108163:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.108185:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.112662:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985206 is committed 00002000:00010000:1.0:1789760786.113146:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73310208 -> 73314304 00002000:00010000:1.0:1789760786.113151:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143208 -> 143216 00010000:00010000:1.0:1789760786.113166:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113179:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113188:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113196:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.113202:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113211:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113231:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113240:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e876 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73310208->73314303] (req 73310208->73314303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.113356:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565521408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5273us (6111us total) trans 4294985206 rc 0/0 00000100:00100000:1.0:1789760786.113367:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17909 00000100:00100000:1.0:1789760786.113378:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724353247172 time 724368356404 state 0x2 ref 0 00000100:00100000:0.0:1789760786.121892:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.121998:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521536 00000100:00100000:1.0:1789760786.122009:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521536 00000100:00100000:1.0:1789760786.122078:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724353247172 time 724368356404 state 0x0 ref 1 00000100:00100000:1.0:1789760786.122094:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724368616820 time 724368356404 state 0x1 ref 1 00000100:00100000:1.0:1789760786.122171:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724368616820 time 724382461528 state 0x0 ref 1 00000100:00100000:1.0:1789760786.122185:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.122236:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73314304, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f70 00010000:00010000:1.0:1789760786.122246:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.122262:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.122266:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.122272:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.122286:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.127060:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985207 is committed 00002000:00010000:1.0:1789760786.127321:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73314304 -> 73318400 00002000:00010000:1.0:1789760786.127327:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143216 -> 143224 00010000:00010000:1.0:1789760786.127339:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127351:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127360:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127366:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.127371:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127379:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127399:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.127406:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e87d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73314304->73318399] (req 73314304->73318399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.128130:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5830us (6130us total) trans 4294985207 rc 0/0 00000100:00100000:1.0:1789760786.128144:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17910 00000100:00100000:1.0:1789760786.128154:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724368616820 time 724382461528 state 0x2 ref 0 00000100:00100000:2.0:1789760786.137721:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.137860:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521664 00000100:00100000:0.0:1789760786.137867:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521664 00000100:00100000:0.0:1789760786.137924:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724368616820 time 724382461528 state 0x0 ref 1 00000100:00100000:0.0:1789760786.137936:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724382721944 time 724382461528 state 0x1 ref 1 00000100:00100000:0.0:1789760786.137959:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724382721944 time 724398251027 state 0x0 ref 1 00000100:00100000:0.0:1789760786.137972:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.138035:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73318400, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f78 00010000:00010000:0.0:1789760786.138044:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.138061:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.138065:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.138071:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.138085:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.143078:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985208 is committed 00002000:00010000:0.0:1789760786.143194:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73318400 -> 73322496 00002000:00010000:0.0:1789760786.143199:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143224 -> 143232 00010000:00010000:0.0:1789760786.143213:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143226:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143236:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143243:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.143248:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143257:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143276:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.143284:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73318400->73322495] (req 73318400->73322495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.143382:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5407us (5782us total) trans 4294985208 rc 0/0 00000100:00100000:0.0:1789760786.143393:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17911 00000100:00100000:0.0:1789760786.143402:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724382721944 time 724398251027 state 0x2 ref 0 00000100:00100000:2.0:1789760786.148024:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.148451:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521792 00000100:00100000:1.0:1789760786.148471:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521792 00000100:00100000:1.0:1789760786.148526:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724382721944 time 724398251027 state 0x0 ref 1 00000100:00100000:1.0:1789760786.148542:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724398511443 time 724398251027 state 0x1 ref 1 00000100:00100000:1.0:1789760786.148573:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724398511443 time 724408865122 state 0x0 ref 1 00000100:00100000:1.0:1789760786.148586:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.148638:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73322496, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f80 00010000:00010000:1.0:1789760786.148645:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.148657:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.148660:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.148664:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.148693:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.153884:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985209 is committed 00002000:00010000:1.0:1789760786.154516:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73322496 -> 73326592 00002000:00010000:1.0:1789760786.154523:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143232 -> 143240 00010000:00010000:1.0:1789760786.154536:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154550:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154560:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154567:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.154572:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154581:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154601:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.154618:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e88b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73322496->73326591] (req 73322496->73326591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.154755:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565521792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6166us (6735us total) trans 4294985209 rc 0/0 00000100:00100000:1.0:1789760786.154765:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17912 00000100:00100000:1.0:1789760786.154775:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724398511443 time 724408865122 state 0x2 ref 0 00000100:00100000:2.0:1789760786.165804:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.165978:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565521920 00000100:00100000:1.0:1789760786.165988:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565521920 00000100:00100000:1.0:1789760786.166040:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724398511443 time 724408865122 state 0x0 ref 1 00000100:00100000:1.0:1789760786.166056:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724409125538 time 724408865122 state 0x1 ref 1 00000100:00100000:1.0:1789760786.166086:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724409125538 time 724426377609 state 0x0 ref 1 00000100:00100000:1.0:1789760786.166098:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.166145:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73326592, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f88 00010000:00010000:1.0:1789760786.166159:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.166175:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.166180:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.166186:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.166199:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.174572:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985210 is committed 00002000:00010000:1.0:1789760786.177372:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73326592 -> 73330688 00002000:00010000:1.0:1789760786.177382:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143240 -> 143248 00010000:00010000:1.0:1789760786.177396:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177415:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177424:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177432:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.177437:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177446:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177465:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.177472:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73326592->73330687] (req 73326592->73330687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.177619:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565521920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11510us (11812us total) trans 4294985210 rc 0/0 00000100:00100000:1.0:1789760786.177629:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17913 00000100:00100000:1.0:1789760786.177640:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724409125538 time 724426377609 state 0x2 ref 0 00000100:00100000:2.0:1789760786.184090:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.184193:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522048 00000100:00100000:0.0:1789760786.184202:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522048 00000100:00100000:0.0:1789760786.184387:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724409125538 time 724426377609 state 0x0 ref 1 00000100:00100000:0.0:1789760786.184401:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724426638025 time 724426377609 state 0x1 ref 1 00000100:00100000:0.0:1789760786.184480:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724426638025 time 724444770739 state 0x0 ref 1 00000100:00100000:0.0:1789760786.184494:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.184541:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73330688, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f90 00010000:00010000:0.0:1789760786.184552:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.184569:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.184573:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.184581:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.184597:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.193388:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985211 is committed 00002000:00010000:0.0:1789760786.193509:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73330688 -> 73334784 00002000:00010000:0.0:1789760786.193513:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143248 -> 143256 00010000:00010000:0.0:1789760786.193525:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193543:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193552:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193559:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.193563:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193572:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193592:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.193600:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73330688->73334783] (req 73330688->73334783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.194352:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9855us (10329us total) trans 4294985211 rc 0/0 00000100:00100000:1.0:1789760786.194363:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17914 00000100:00100000:1.0:1789760786.194371:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724426638025 time 724444770739 state 0x2 ref 0 00000100:00100000:2.0:1789760786.199518:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.200264:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522176 00000100:00100000:1.0:1789760786.200276:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522176 00000100:00100000:1.0:1789760786.200336:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724426638025 time 724444770739 state 0x0 ref 1 00000100:00100000:1.0:1789760786.200351:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724445031155 time 724444770739 state 0x1 ref 1 00000100:00100000:1.0:1789760786.200423:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724445031155 time 724460714114 state 0x0 ref 1 00000100:00100000:1.0:1789760786.200437:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.200482:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73334784, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22f98 00010000:00010000:1.0:1789760786.200491:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.200505:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.200508:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.200514:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.200527:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.205490:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985212 is committed 00002000:00010000:1.0:1789760786.206033:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73334784 -> 73338880 00002000:00010000:1.0:1789760786.206039:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143256 -> 143264 00010000:00010000:1.0:1789760786.206056:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206071:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206083:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206094:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.206099:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206112:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206135:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.206145:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674e8a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73334784->73338879] (req 73334784->73338879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.206243:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5804us (6729us total) trans 4294985212 rc 0/0 00000100:00100000:1.0:1789760786.206315:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17915 00000100:00100000:1.0:1789760786.206325:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724445031155 time 724460714114 state 0x2 ref 0 00000100:00100000:2.0:1789760786.210162:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.210240:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522304 00000100:00100000:1.0:1789760786.210249:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522304 00000100:00100000:1.0:1789760786.210304:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724445031155 time 724460714114 state 0x0 ref 1 00000100:00100000:1.0:1789760786.210320:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724460974530 time 724460714114 state 0x1 ref 1 00000100:00100000:1.0:1789760786.210349:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724460974530 time 724470641093 state 0x0 ref 1 00000100:00100000:1.0:1789760786.210361:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.210405:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73338880, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fa0 00010000:00010000:1.0:1789760786.210415:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.210431:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.210436:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.210443:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.210456:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.221322:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985213 is committed 00002000:00010000:0.0:1789760786.221480:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73338880 -> 73342976 00002000:00010000:0.0:1789760786.221484:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143264 -> 143272 00010000:00010000:0.0:1789760786.221496:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221508:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221517:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221525:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.221530:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221539:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221558:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.221566:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674e8a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73338880->73342975] (req 73338880->73342975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.221961:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11597us (11805us total) trans 4294985213 rc 0/0 00000100:00100000:0.0:1789760786.221972:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17916 00000100:00100000:0.0:1789760786.221979:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724460974530 time 724470641093 state 0x2 ref 0 00000100:00100000:2.0:1789760786.226627:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.227172:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522432 00000100:00100000:1.0:1789760786.227183:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522432 00000100:00100000:1.0:1789760786.227235:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724460974530 time 724470641093 state 0x0 ref 1 00000100:00100000:1.0:1789760786.227250:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724470901509 time 724470641093 state 0x1 ref 1 00000100:00100000:1.0:1789760786.227283:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724470901509 time 724487574427 state 0x0 ref 1 00000100:00100000:1.0:1789760786.227294:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.227342:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73342976, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fa8 00010000:00010000:1.0:1789760786.227351:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.227368:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.227372:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.227378:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.227391:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.235700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985214 is committed 00002000:00010000:1.0:1789760786.236259:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73342976 -> 73347072 00002000:00010000:1.0:1789760786.236265:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143272 -> 143280 00010000:00010000:1.0:1789760786.236277:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236290:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236299:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236311:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.236316:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236324:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236344:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.236352:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73342976->73347071] (req 73342976->73347071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.236445:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9149us (9823us total) trans 4294985214 rc 0/0 00000100:00100000:1.0:1789760786.236457:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17917 00000100:00100000:1.0:1789760786.236467:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724470901509 time 724487574427 state 0x2 ref 0 00000100:00100000:3.0:1789760786.242336:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760786.242595:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522560 00000100:00100000:2.0:1789760786.242604:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522560 00000100:00100000:2.0:1789760786.242681:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724470901509 time 724487574427 state 0x0 ref 1 00000100:00100000:2.0:1789760786.242696:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724487834843 time 724487574427 state 0x1 ref 1 00000100:00100000:3.0:1789760786.242872:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724487834843 time 724503160920 state 0x0 ref 1 00000100:00100000:3.0:1789760786.242892:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.242944:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73347072, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fb0 00010000:00010000:3.0:1789760786.242953:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.242968:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.242972:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.242978:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.242995:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.252543:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985215 is committed 00002000:00010000:3.0:1789760786.252841:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73347072 -> 73351168 00002000:00010000:3.0:1789760786.252846:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143280 -> 143288 00010000:00010000:3.0:1789760786.252859:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252872:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252881:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252888:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.252893:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252902:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252921:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.252929:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e8b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73347072->73351167] (req 73347072->73351167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.253027:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10139us (10802us total) trans 4294985215 rc 0/0 00000100:00100000:3.0:1789760786.253036:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17918 00000100:00100000:3.0:1789760786.253046:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724487834843 time 724503160920 state 0x2 ref 0 00000100:00100000:2.0:1789760786.267290:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.267394:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522688 00000100:00100000:0.0:1789760786.267404:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522688 00000100:00100000:0.0:1789760786.267466:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724487834843 time 724503160920 state 0x0 ref 1 00000100:00100000:0.0:1789760786.267481:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724503421336 time 724503160920 state 0x1 ref 1 00000100:00100000:0.0:1789760786.267511:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724503421336 time 724527803073 state 0x0 ref 1 00000100:00100000:0.0:1789760786.267534:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.267584:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73351168, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fb8 00010000:00010000:0.0:1789760786.267594:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.267610:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.267614:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.267621:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.267634:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.274258:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985216 is committed 00002000:00010000:0.0:1789760786.279441:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73351168 -> 73355264 00002000:00010000:0.0:1789760786.279453:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143288 -> 143296 00010000:00010000:0.0:1789760786.279467:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279479:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279488:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279913:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.279918:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279928:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279948:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.279955:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73351168->73355263] (req 73351168->73355263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.280270:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12733us (12984us total) trans 4294985216 rc 0/0 00000100:00100000:0.0:1789760786.280280:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17919 00000100:00100000:0.0:1789760786.280290:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724503421336 time 724527803073 state 0x2 ref 0 00000100:00100000:2.0:1789760786.285819:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.285915:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522816 00000100:00100000:1.0:1789760786.285924:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522816 00000100:00100000:1.0:1789760786.285979:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724503421336 time 724527803073 state 0x0 ref 1 00000100:00100000:1.0:1789760786.285996:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724528063489 time 724527803073 state 0x1 ref 1 00000100:00100000:1.0:1789760786.286027:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724528063489 time 724546319349 state 0x0 ref 1 00000100:00100000:1.0:1789760786.286041:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.286094:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73355264, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fc0 00010000:00010000:1.0:1789760786.286114:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.286130:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.286135:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.286141:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.286154:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.292909:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985217 is committed 00002000:00010000:1.0:1789760786.293038:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73355264 -> 73359360 00002000:00010000:1.0:1789760786.293044:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143296 -> 143304 00010000:00010000:1.0:1789760786.293057:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293070:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293081:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293089:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.293095:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293106:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293125:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.293134:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73355264->73359359] (req 73355264->73359359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.293225:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565522816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7181us (7412us total) trans 4294985217 rc 0/0 00000100:00100000:1.0:1789760786.293237:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17920 00000100:00100000:1.0:1789760786.293247:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724528063489 time 724546319349 state 0x2 ref 0 00000100:00100000:3.0:1789760786.307755:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.307965:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565522944 00000100:00100000:1.0:1789760786.307974:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565522944 00000100:00100000:1.0:1789760786.308034:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724528063489 time 724546319349 state 0x0 ref 1 00000100:00100000:1.0:1789760786.308050:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724546579765 time 724546319349 state 0x1 ref 1 00000100:00100000:1.0:1789760786.308084:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724546579765 time 724568376598 state 0x0 ref 1 00000100:00100000:1.0:1789760786.308098:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.308144:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73359360, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fc8 00010000:00010000:1.0:1789760786.308153:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.308168:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.308173:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.308180:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.308195:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.314550:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985218 is committed 00002000:00010000:1.0:1789760786.315080:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73359360 -> 73363456 00002000:00010000:1.0:1789760786.315086:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143304 -> 143312 00010000:00010000:1.0:1789760786.315101:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315113:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315123:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315130:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.315136:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315145:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315164:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.315172:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73359360->73363455] (req 73359360->73363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.315262:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565522944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7161us (7562us total) trans 4294985218 rc 0/0 00000100:00100000:1.0:1789760786.315272:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17921 00000100:00100000:1.0:1789760786.315282:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724546579765 time 724568376598 state 0x2 ref 0 00000100:00100000:2.0:1789760786.320825:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.321028:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523072 00000100:00100000:0.0:1789760786.321037:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523072 00000100:00100000:0.0:1789760786.321095:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724546579765 time 724568376598 state 0x0 ref 1 00000100:00100000:0.0:1789760786.321109:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724568637014 time 724568376598 state 0x1 ref 1 00000100:00100000:0.0:1789760786.321133:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724568637014 time 724581425766 state 0x0 ref 1 00000100:00100000:0.0:1789760786.321150:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.321199:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73363456, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fd0 00010000:00010000:0.0:1789760786.321209:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.321225:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.321229:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.321235:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.321249:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.327642:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985219 is committed 00002000:00010000:0.0:1789760786.327945:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73363456 -> 73367552 00002000:00010000:0.0:1789760786.327951:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143312 -> 143320 00010000:00010000:0.0:1789760786.327966:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.327980:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.327990:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.327998:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.328004:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.328022:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.328043:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.328050:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73363456->73367551] (req 73363456->73367551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.328164:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7012us (7346us total) trans 4294985219 rc 0/0 00000100:00100000:0.0:1789760786.328174:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17922 00000100:00100000:0.0:1789760786.328184:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724568637014 time 724581425766 state 0x2 ref 0 00000100:00100000:2.0:1789760786.342480:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.342755:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523200 00000100:00100000:1.0:1789760786.342775:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523200 00000100:00100000:1.0:1789760786.342833:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724568637014 time 724581425766 state 0x0 ref 1 00000100:00100000:1.0:1789760786.342849:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724581686182 time 724581425766 state 0x1 ref 1 00000100:00100000:1.0:1789760786.342881:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724581686182 time 724603172838 state 0x0 ref 1 00000100:00100000:1.0:1789760786.342905:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565523200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.342955:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73367552, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fd8 00010000:00010000:1.0:1789760786.342965:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.342980:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.342985:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.342992:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.343006:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.350515:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985220 is committed 00002000:00010000:1.0:1789760786.350698:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73367552 -> 73371648 00002000:00010000:1.0:1789760786.350991:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143320 -> 143328 00010000:00010000:1.0:1789760786.351006:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351145:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351155:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351162:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.351167:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351176:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351197:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.351210:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73367552->73371647] (req 73367552->73371647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.351404:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565523200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8507us (8929us total) trans 4294985220 rc 0/0 00000100:00100000:1.0:1789760786.351416:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17923 00000100:00100000:1.0:1789760786.351425:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724581686182 time 724603172838 state 0x2 ref 0 00000100:00100000:3.0:1789760786.361286:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.361760:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523328 00000100:00100000:1.0:1789760786.361781:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523328 00000100:00100000:1.0:1789760786.361838:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724581686182 time 724603172838 state 0x0 ref 1 00000100:00100000:1.0:1789760786.361853:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724603433254 time 724603172838 state 0x1 ref 1 00000100:00100000:1.0:1789760786.361881:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724603433254 time 724622173843 state 0x0 ref 1 00000100:00100000:1.0:1789760786.361906:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565523328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.361952:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73371648, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fe0 00010000:00010000:1.0:1789760786.361962:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.361977:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.361982:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.361989:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.362008:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.368260:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985221 is committed 00002000:00010000:1.0:1789760786.368433:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73371648 -> 73375744 00002000:00010000:1.0:1789760786.368439:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143328 -> 143336 00010000:00010000:1.0:1789760786.368453:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368467:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368476:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368484:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.368489:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368498:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368519:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.368527:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73371648->73375743] (req 73371648->73375743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.368624:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565523328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6727us (7342us total) trans 4294985221 rc 0/0 00000100:00100000:1.0:1789760786.368634:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17924 00000100:00100000:1.0:1789760786.368643:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724603433254 time 724622173843 state 0x2 ref 0 00000100:00100000:2.0:1789760786.378181:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.379413:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523456 00000100:00100000:0.0:1789760786.379425:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523456 00000100:00100000:0.0:1789760786.379486:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724603433254 time 724622173843 state 0x0 ref 1 00000100:00100000:0.0:1789760786.379502:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724622434259 time 724622173843 state 0x1 ref 1 00000100:00100000:0.0:1789760786.379538:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724622434259 time 724639830068 state 0x0 ref 1 00000100:00100000:0.0:1789760786.379553:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.379605:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73375744, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22fe8 00010000:00010000:0.0:1789760786.379616:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.379632:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.379636:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.379643:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.379656:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.388934:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985222 is committed 00002000:00010000:0.0:1789760786.391448:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73375744 -> 73379840 00002000:00010000:0.0:1789760786.391526:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143336 -> 143344 00010000:00010000:0.0:1789760786.391541:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391554:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391562:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391570:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.391575:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391583:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391604:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.391611:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73375744->73379839] (req 73375744->73379839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.391948:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12386us (13764us total) trans 4294985222 rc 0/0 00000100:00100000:0.0:1789760786.391959:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17925 00000100:00100000:0.0:1789760786.391969:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724622434259 time 724639830068 state 0x2 ref 0 00000100:00100000:3.0:1789760786.401725:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.401989:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523584 00000100:00100000:1.0:1789760786.401998:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523584 00000100:00100000:1.0:1789760786.402190:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724622434259 time 724639830068 state 0x0 ref 1 00000100:00100000:1.0:1789760786.402206:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724640090484 time 724639830068 state 0x1 ref 1 00000100:00100000:1.0:1789760786.402277:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724640090484 time 724662567890 state 0x0 ref 1 00000100:00100000:1.0:1789760786.402291:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.402348:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73379840, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22ff0 00010000:00010000:1.0:1789760786.402358:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.402376:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.402381:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.402389:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.402403:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.411487:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985223 is committed 00002000:00010000:2.0:1789760786.411604:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73379840 -> 73383936 00002000:00010000:2.0:1789760786.411609:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143344 -> 143352 00010000:00010000:2.0:1789760786.411623:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.411635:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.411643:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.411656:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760786.411661:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.411680:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.411698:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.412132:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674e8ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73379840->73383935] (req 73379840->73383935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.412335:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565523584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10040us (10628us total) trans 4294985223 rc 0/0 00000100:00100000:3.0:1789760786.412347:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17926 00000100:00100000:3.0:1789760786.412357:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724640090484 time 724662567890 state 0x2 ref 0 00000100:00100000:3.0:1789760786.417379:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.417843:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523712 00000100:00100000:1.0:1789760786.417853:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523712 00000100:00100000:1.0:1789760786.417905:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724640090484 time 724662567890 state 0x0 ref 1 00000100:00100000:1.0:1789760786.417919:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724662828306 time 724662567890 state 0x1 ref 1 00000100:00100000:1.0:1789760786.417985:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724662828306 time 724678276703 state 0x0 ref 1 00000100:00100000:1.0:1789760786.417997:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565523712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.418062:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73383936, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x22ff8 00010000:00010000:1.0:1789760786.418071:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.418087:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.418092:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.418097:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.418111:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.424342:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985224 is committed 00002000:00010000:1.0:1789760786.424484:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73383936 -> 73388032 00002000:00010000:1.0:1789760786.424489:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143352 -> 143360 00010000:00010000:1.0:1789760786.424502:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424515:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424524:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424532:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.424536:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424546:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424563:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.424570:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e8f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73383936->73388031] (req 73383936->73388031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.424889:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565523712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6889us (7515us total) trans 4294985224 rc 0/0 00000100:00100000:1.0:1789760786.424900:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17927 00000100:00100000:1.0:1789760786.424911:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724662828306 time 724678276703 state 0x2 ref 0 00000100:00100000:3.0:1789760786.435164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.435489:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523840 00000100:00100000:0.0:1789760786.435498:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523840 00000100:00100000:0.0:1789760786.436677:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724662828306 time 724678276703 state 0x0 ref 1 00000100:00100000:0.0:1789760786.436698:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724678537119 time 724678276703 state 0x1 ref 1 00000100:00100000:0.0:1789760786.436758:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724678537119 time 724697049494 state 0x0 ref 1 00000100:00100000:0.0:1789760786.436777:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565523840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.436836:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73388032, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23000 00010000:00010000:0.0:1789760786.436846:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.436860:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.436864:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.436870:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.436883:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.459392:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985225 is committed 00002000:00010000:0.0:1789760786.459912:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73388032 -> 73392128 00002000:00010000:0.0:1789760786.459917:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143360 -> 143368 00010000:00010000:0.0:1789760786.459931:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.459945:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.459954:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.459962:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.459967:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.459977:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.459995:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.460004:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674e8fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73388032->73392127] (req 73388032->73392127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.460262:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565523840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 23489us (25103us total) trans 4294985225 rc 0/0 00000100:00100000:0.0:1789760786.460272:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17928 00000100:00100000:0.0:1789760786.460281:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724678537119 time 724697049494 state 0x2 ref 0 00000100:00100000:3.0:1789760786.465493:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.469929:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565523968 00000100:00100000:1.0:1789760786.469945:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565523968 00000100:00100000:1.0:1789760786.470893:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724678537119 time 724697049494 state 0x0 ref 1 00000100:00100000:1.0:1789760786.470911:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724697309910 time 724697049494 state 0x1 ref 1 00000100:00100000:1.0:1789760786.470949:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724697309910 time 724731241279 state 0x0 ref 1 00000100:00100000:1.0:1789760786.470967:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565523968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.471025:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73392128, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23008 00010000:00010000:1.0:1789760786.471034:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.471048:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.471052:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.471057:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.471246:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.477552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985226 is committed 00002000:00010000:3.0:1789760786.477659:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73392128 -> 73396224 00002000:00010000:3.0:1789760786.477663:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143368 -> 143376 00010000:00010000:3.0:1789760786.477686:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477698:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477726:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477733:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.477738:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477746:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477765:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.477773:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674e902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73392128->73396223] (req 73392128->73396223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.478004:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565523968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7039us (12517us total) trans 4294985226 rc 0/0 00000100:00100000:3.0:1789760786.478024:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17929 00000100:00100000:3.0:1789760786.478034:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724697309910 time 724731241279 state 0x2 ref 0 00000100:00100000:3.0:1789760786.485006:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.485171:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524096 00000100:00100000:1.0:1789760786.485182:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524096 00000100:00100000:1.0:1789760786.485234:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724697309910 time 724731241279 state 0x0 ref 1 00000100:00100000:1.0:1789760786.485249:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724731501695 time 724731241279 state 0x1 ref 1 00000100:00100000:1.0:1789760786.485277:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724731501695 time 724745569874 state 0x0 ref 1 00000100:00100000:1.0:1789760786.485289:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.485335:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73396224, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23010 00010000:00010000:1.0:1789760786.485344:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.485361:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.485366:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.485372:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.485386:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.493409:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985227 is committed 00002000:00010000:1.0:1789760786.493529:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73396224 -> 73400320 00002000:00010000:1.0:1789760786.493534:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143376 -> 143384 00010000:00010000:1.0:1789760786.493547:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493560:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493569:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493577:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.493583:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493592:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493611:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.493619:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73396224->73400319] (req 73396224->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.493762:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8469us (8763us total) trans 4294985227 rc 0/0 00000100:00100000:1.0:1789760786.493773:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17930 00000100:00100000:1.0:1789760786.493783:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724731501695 time 724745569874 state 0x2 ref 0 00000100:00100000:0.0:1789760786.504684:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.506206:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524224 00000100:00100000:1.0:1789760786.506218:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524224 00000100:00100000:1.0:1789760786.506276:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724731501695 time 724745569874 state 0x0 ref 1 00000100:00100000:1.0:1789760786.506291:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724745830290 time 724745569874 state 0x1 ref 1 00000100:00100000:1.0:1789760786.506332:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724745830290 time 724766624596 state 0x0 ref 1 00000100:00100000:1.0:1789760786.506346:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565524224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.506392:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73400320, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23018 00010000:00010000:1.0:1789760786.506402:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.506417:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.506422:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.506427:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.506441:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.513974:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985228 is committed 00002000:00010000:1.0:1789760786.514109:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73400320 -> 73404416 00002000:00010000:1.0:1789760786.514114:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143384 -> 143392 00010000:00010000:1.0:1789760786.514127:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514138:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514147:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514155:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.514160:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514169:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514189:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.514197:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->73404415] (req 73400320->73404415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.514288:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565524224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7941us (9617us total) trans 4294985228 rc 0/0 00000100:00100000:1.0:1789760786.514299:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17931 00000100:00100000:1.0:1789760786.514308:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724745830290 time 724766624596 state 0x2 ref 0 00000100:00100000:3.0:1789760786.534615:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.534753:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524352 00000100:00100000:1.0:1789760786.534763:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524352 00000100:00100000:1.0:1789760786.534829:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724745830290 time 724766624596 state 0x0 ref 1 00000100:00100000:1.0:1789760786.534857:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724766885012 time 724766624596 state 0x1 ref 1 00000100:00100000:1.0:1789760786.534895:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724766885012 time 724795187462 state 0x0 ref 1 00000100:00100000:1.0:1789760786.534908:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.534956:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73404416, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23020 00010000:00010000:1.0:1789760786.534966:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.534981:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.534986:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.534994:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.535008:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.541200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985229 is committed 00002000:00010000:3.0:1789760786.543290:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73404416 -> 73408512 00002000:00010000:3.0:1789760786.543299:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143392 -> 143400 00010000:00010000:3.0:1789760786.543379:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543393:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543403:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543410:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.543414:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543424:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543619:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.543626:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674e917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73404416->73408511] (req 73404416->73408511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.544281:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9370us (9671us total) trans 4294985229 rc 0/0 00000100:00100000:3.0:1789760786.544292:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17932 00000100:00100000:3.0:1789760786.544302:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724766885012 time 724795187462 state 0x2 ref 0 00000100:00100000:3.0:1789760786.551955:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.552217:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524480 00000100:00100000:1.0:1789760786.552228:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524480 00000100:00100000:1.0:1789760786.552284:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724766885012 time 724795187462 state 0x0 ref 1 00000100:00100000:1.0:1789760786.552300:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724795447878 time 724795187462 state 0x1 ref 1 00000100:00100000:1.0:1789760786.552405:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724795447878 time 724812696523 state 0x0 ref 1 00000100:00100000:1.0:1789760786.552418:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565524480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.552468:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73408512, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23028 00010000:00010000:1.0:1789760786.552478:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.552494:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.552498:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.552504:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.552518:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.564162:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985230 is committed 00002000:00010000:1.0:1789760786.578523:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73408512 -> 73412608 00002000:00010000:1.0:1789760786.578534:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143400 -> 143408 00010000:00010000:1.0:1789760786.578549:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578563:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578572:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578580:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.578586:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578595:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578617:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.578625:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e91e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73408512->73412607] (req 73408512->73412607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.578779:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565524480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 26358us (27664us total) trans 4294985230 rc 0/0 00000100:00100000:1.0:1789760786.578790:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17933 00000100:00100000:1.0:1789760786.578800:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724795447878 time 724812696523 state 0x2 ref 0 00000100:00100000:2.0:1789760786.588521:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.588659:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524608 00000100:00100000:1.0:1789760786.588681:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524608 00000100:00100000:1.0:1789760786.588784:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724795447878 time 724812696523 state 0x0 ref 1 00000100:00100000:1.0:1789760786.588800:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724812956939 time 724812696523 state 0x1 ref 1 00000100:00100000:1.0:1789760786.588831:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724812956939 time 724849122717 state 0x0 ref 1 00000100:00100000:1.0:1789760786.588844:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.588890:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73412608, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23030 00010000:00010000:1.0:1789760786.588899:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.588916:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.588921:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.588927:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.588941:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.597850:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985231 is committed 00002000:00010000:1.0:1789760786.598262:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73412608 -> 73416704 00002000:00010000:1.0:1789760786.598267:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143408 -> 143416 00010000:00010000:1.0:1789760786.598282:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598294:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598302:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598310:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.598315:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598324:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598344:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.598352:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73412608->73416703] (req 73412608->73416703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.598444:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9598us (9928us total) trans 4294985231 rc 0/0 00000100:00100000:1.0:1789760786.598454:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17934 00000100:00100000:1.0:1789760786.598462:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724812956939 time 724849122717 state 0x2 ref 0 00000100:00100000:3.0:1789760786.610261:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.612392:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524736 00000100:00100000:1.0:1789760786.612408:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524736 00000100:00100000:3.0:1789760786.612590:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724812956939 time 724849122717 state 0x0 ref 1 00000100:00100000:3.0:1789760786.612618:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724849383133 time 724849122717 state 0x1 ref 1 00000100:00100000:3.0:1789760786.612658:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724849383133 time 724872949444 state 0x0 ref 1 00000100:00100000:3.0:1789760786.612684:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.612770:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73416704, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23038 00010000:00010000:3.0:1789760786.612780:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.612796:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.612801:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.612808:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.612823:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.621504:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985232 is committed 00002000:00010000:3.0:1789760786.621772:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73416704 -> 73420800 00002000:00010000:3.0:1789760786.621778:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143416 -> 143424 00010000:00010000:3.0:1789760786.621791:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621805:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621815:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621822:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.621826:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621834:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621853:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.621861:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e92c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73416704->73420799] (req 73416704->73420799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.621960:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565524736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9276us (11704us total) trans 4294985232 rc 0/0 00000100:00100000:3.0:1789760786.621972:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17935 00000100:00100000:3.0:1789760786.621981:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724849383133 time 724872949444 state 0x2 ref 0 00000100:00100000:3.0:1789760786.625857:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.628238:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524864 00000100:00100000:1.0:1789760786.628252:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524864 00000100:00100000:1.0:1789760786.628313:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724849383133 time 724872949444 state 0x0 ref 1 00000100:00100000:1.0:1789760786.628328:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724873209860 time 724872949444 state 0x1 ref 1 00000100:00100000:1.0:1789760786.628362:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724873209860 time 724888654604 state 0x0 ref 1 00000100:00100000:1.0:1789760786.628376:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.628421:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73420800, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23040 00010000:00010000:1.0:1789760786.628432:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.628447:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.628452:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.628458:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.628472:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.633887:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985233 is committed 00010000:00010000:0.0:1789760786.636418:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760786.639346:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73420800 -> 73424896 00002000:00010000:2.0:1789760786.639356:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143424 -> 143432 00010000:00010000:2.0:1789760786.639370:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639384:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639393:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639405:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760786.639410:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639418:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639451:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.639460:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674e933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73420800->73424895] (req 73420800->73424895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760786.639643:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11264us (13790us total) trans 4294985233 rc 0/0 00000100:00100000:2.0:1789760786.639654:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17936 00000100:00100000:2.0:1789760786.639680:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724873209860 time 724888654604 state 0x2 ref 0 00000100:00100000:2.0:1789760786.649787:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.649934:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565524992 00000100:00100000:1.0:1789760786.649945:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565524992 00000100:00100000:1.0:1789760786.650001:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724873209860 time 724888654604 state 0x0 ref 1 00000100:00100000:1.0:1789760786.650022:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724888915020 time 724888654604 state 0x1 ref 1 00000100:00100000:1.0:1789760786.650052:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724888915020 time 724910344300 state 0x0 ref 1 00000100:00100000:1.0:1789760786.650074:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.650123:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73424896, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23048 00010000:00010000:1.0:1789760786.650257:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.650273:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:1.0:1789760786.650277:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.650284:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.650299:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.655612:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985234 is committed 00002000:00010000:1.0:1789760786.656373:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73424896 -> 73428992 00002000:00010000:1.0:1789760786.656379:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143432 -> 143440 00010000:00010000:1.0:1789760786.656393:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656408:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656422:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656430:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.656435:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656443:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656462:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.656471:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e93a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73424896->73428991] (req 73424896->73428991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.656569:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565524992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6502us (6787us total) trans 4294985234 rc 0/0 00000100:00100000:1.0:1789760786.656580:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17937 00000100:00100000:1.0:1789760786.656590:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724888915020 time 724910344300 state 0x2 ref 0 00000100:00100000:0.0:1789760786.662554:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.662653:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525120 00000100:00100000:3.0:1789760786.662662:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525120 00000100:00100000:3.0:1789760786.662758:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724888915020 time 724910344300 state 0x0 ref 1 00000100:00100000:3.0:1789760786.662773:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724910604716 time 724910344300 state 0x1 ref 1 00000100:00100000:3.0:1789760786.662808:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724910604716 time 724923100486 state 0x0 ref 1 00000100:00100000:3.0:1789760786.662821:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.662872:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73428992, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23050 00010000:00010000:3.0:1789760786.662882:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.662899:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.662904:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.662910:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.662924:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.671947:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985235 is committed 00002000:00010000:3.0:1789760786.672088:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73428992 -> 73433088 00002000:00010000:3.0:1789760786.672094:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143440 -> 143448 00010000:00010000:3.0:1789760786.672106:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672119:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672130:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672137:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.672141:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672151:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672171:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.672180:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73428992->73433087] (req 73428992->73433087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.672304:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9480us (9755us total) trans 4294985235 rc 0/0 00000100:00100000:3.0:1789760786.672313:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17938 00000100:00100000:3.0:1789760786.672323:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724910604716 time 724923100486 state 0x2 ref 0 00000100:00100000:2.0:1789760786.682701:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.682905:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525248 00000100:00100000:3.0:1789760786.682916:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525248 00000100:00100000:3.0:1789760786.682968:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724910604716 time 724923100486 state 0x0 ref 1 00000100:00100000:3.0:1789760786.682984:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724923360902 time 724923100486 state 0x1 ref 1 00000100:00100000:3.0:1789760786.683013:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724923360902 time 724943305336 state 0x0 ref 1 00000100:00100000:3.0:1789760786.683024:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.683066:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73433088, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23058 00010000:00010000:3.0:1789760786.683075:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.683090:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.683093:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.683099:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.683112:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.689314:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985236 is committed 00002000:00010000:2.0:1789760786.689425:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73433088 -> 73437184 00002000:00010000:2.0:1789760786.689430:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143448 -> 143456 00010000:00010000:2.0:1789760786.689444:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689457:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689466:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689473:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760786.689478:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689487:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689506:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.689514:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674e948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73433088->73437183] (req 73433088->73437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760786.689610:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6582us (6912us total) trans 4294985236 rc 0/0 00000100:00100000:2.0:1789760786.689621:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17939 00000100:00100000:2.0:1789760786.689632:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724923360902 time 724943305336 state 0x2 ref 0 00000100:00100000:2.0:1789760786.703980:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.704161:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525376 00000100:00100000:0.0:1789760786.704172:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525376 00000100:00100000:0.0:1789760786.704224:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724923360902 time 724943305336 state 0x0 ref 1 00000100:00100000:0.0:1789760786.704240:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724943565752 time 724943305336 state 0x1 ref 1 00000100:00100000:0.0:1789760786.704271:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724943565752 time 724964563468 state 0x0 ref 1 00000100:00100000:0.0:1789760786.704283:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.704329:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73437184, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23060 00010000:00010000:0.0:1789760786.704339:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.704355:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:0.0:1789760786.704359:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.704365:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.704380:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760786.709555:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985237 is committed 00002000:00010000:0.0:1789760786.709695:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73437184 -> 73441280 00002000:00010000:0.0:1789760786.709700:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143456 -> 143464 00010000:00010000:0.0:1789760786.709747:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709760:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709768:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709776:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.709780:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709789:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709808:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.709821:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674e94f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73437184->73441279] (req 73437184->73441279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.709968:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5682us (5993us total) trans 4294985237 rc 0/0 00000100:00100000:0.0:1789760786.709978:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17940 00000100:00100000:0.0:1789760786.709987:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724943565752 time 724964563468 state 0x2 ref 0 00000100:00100000:0.0:1789760786.723809:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.724049:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525504 00000100:00100000:3.0:1789760786.724060:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525504 00000100:00100000:3.0:1789760786.724115:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724943565752 time 724964563468 state 0x0 ref 1 00000100:00100000:3.0:1789760786.724131:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724964823884 time 724964563468 state 0x1 ref 1 00000100:00100000:3.0:1789760786.724212:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724964823884 time 724984503439 state 0x0 ref 1 00000100:00100000:3.0:1789760786.724226:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565525504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.724274:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73441280, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23068 00010000:00010000:3.0:1789760786.724284:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.724300:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.724305:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.724311:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.724324:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.732774:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985238 is committed 00002000:00010000:3.0:1789760786.733351:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73441280 -> 73445376 00002000:00010000:3.0:1789760786.733357:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143464 -> 143472 00010000:00010000:3.0:1789760786.733371:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733384:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733392:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733400:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.733404:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733418:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733438:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.733446:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73441280->73445375] (req 73441280->73445375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.733545:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565525504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9317us (9741us total) trans 4294985238 rc 0/0 00000100:00100000:3.0:1789760786.733556:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17941 00000100:00100000:3.0:1789760786.733565:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724964823884 time 724984503439 state 0x2 ref 0 00000100:00100000:2.0:1789760786.739357:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.739501:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525632 00000100:00100000:3.0:1789760786.739510:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525632 00000100:00100000:3.0:1789760786.739566:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724964823884 time 724984503439 state 0x0 ref 1 00000100:00100000:3.0:1789760786.739581:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724984763855 time 724984503439 state 0x1 ref 1 00000100:00100000:3.0:1789760786.739651:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724984763855 time 724999941901 state 0x0 ref 1 00000100:00100000:3.0:1789760786.739675:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.739756:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73445376, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23070 00010000:00010000:3.0:1789760786.739765:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.739781:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1789760786.739785:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.739791:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.739804:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760786.745917:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985239 is committed 00002000:00010000:3.0:1789760786.746030:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73445376 -> 73449472 00002000:00010000:3.0:1789760786.746035:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143472 -> 143480 00010000:00010000:3.0:1789760786.746047:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746059:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746069:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746076:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.746080:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746090:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746115:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.746123:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e95d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73445376->73449471] (req 73445376->73449471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.746211:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6545us (6860us total) trans 4294985239 rc 0/0 00000100:00100000:3.0:1789760786.746221:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17942 00000100:00100000:3.0:1789760786.746230:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724984763855 time 724999941901 state 0x2 ref 0 00000100:00100000:2.0:1789760786.753020:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.753213:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525760 00000100:00100000:0.0:1789760786.753222:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525760 00000100:00100000:0.0:1789760786.753278:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 724984763855 time 724999941901 state 0x0 ref 1 00000100:00100000:0.0:1789760786.753293:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725000202317 time 724999941901 state 0x1 ref 1 00000100:00100000:0.0:1789760786.753331:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725000202317 time 725013623401 state 0x0 ref 1 00000100:00100000:0.0:1789760786.753344:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565525760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.753391:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73449472, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23078 00010000:00010000:0.0:1789760786.753543:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.753559:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.753563:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.753569:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.753583:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.761334:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985240 is committed 00002000:00010000:1.0:1789760786.761504:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73449472 -> 73453568 00002000:00010000:1.0:1789760786.761511:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143480 -> 143488 00010000:00010000:1.0:1789760786.761526:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761546:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761555:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761563:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.761568:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761577:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761597:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.761683:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674e964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73449472->73453567] (req 73449472->73453567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.762158:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565525760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8811us (9151us total) trans 4294985240 rc 0/0 00000100:00100000:1.0:1789760786.762170:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17943 00000100:00100000:1.0:1789760786.762179:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725000202317 time 725013623401 state 0x2 ref 0 00000100:00100000:0.0:1789760786.769973:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.770206:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565525888 00000100:00100000:3.0:1789760786.770216:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565525888 00000100:00100000:3.0:1789760786.770272:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725000202317 time 725013623401 state 0x0 ref 1 00000100:00100000:3.0:1789760786.770289:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725013883817 time 725013623401 state 0x1 ref 1 00000100:00100000:3.0:1789760786.770322:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725013883817 time 725030613670 state 0x0 ref 1 00000100:00100000:3.0:1789760786.770334:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.770381:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73453568, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23080 00010000:00010000:3.0:1789760786.770391:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.770407:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760786.770412:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.770418:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.770431:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.779942:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985241 is committed 00002000:00010000:3.0:1789760786.780183:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73453568 -> 73457664 00002000:00010000:3.0:1789760786.780188:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143488 -> 143496 00010000:00010000:3.0:1789760786.780201:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780214:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780223:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780230:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.780235:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780243:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780260:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.780273:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e96b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73453568->73457663] (req 73453568->73457663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.780505:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565525888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10167us (10535us total) trans 4294985241 rc 0/0 00000100:00100000:3.0:1789760786.780516:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17944 00000100:00100000:3.0:1789760786.780526:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725013883817 time 725030613670 state 0x2 ref 0 00000100:00100000:2.0:1789760786.791220:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760786.791350:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526016 00000100:00100000:3.0:1789760786.791359:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526016 00000100:00100000:3.0:1789760786.791415:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725013883817 time 725030613670 state 0x0 ref 1 00000100:00100000:3.0:1789760786.791431:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725030874086 time 725030613670 state 0x1 ref 1 00000100:00100000:3.0:1789760786.791504:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725030874086 time 725051795607 state 0x0 ref 1 00000100:00100000:3.0:1789760786.791517:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565526016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760786.791566:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73457664, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23088 00010000:00010000:3.0:1789760786.791576:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.791591:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760786.791596:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760786.791601:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.791633:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.797689:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985242 is committed 00002000:00010000:1.0:1789760786.797855:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73457664 -> 73461760 00002000:00010000:1.0:1789760786.797860:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143496 -> 143504 00010000:00010000:1.0:1789760786.797874:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797887:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797896:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797904:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.797909:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797917:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797936:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.797944:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674e972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73457664->73461759] (req 73457664->73461759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.798046:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565526016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6526us (6830us total) trans 4294985242 rc 0/0 00000100:00100000:1.0:1789760786.798056:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17945 00000100:00100000:1.0:1789760786.798067:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725030874086 time 725051795607 state 0x2 ref 0 00000100:00100000:2.0:1789760786.807419:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.809616:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526144 00000100:00100000:1.0:1789760786.809641:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526144 00000100:00100000:1.0:1789760786.809726:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725030874086 time 725051795607 state 0x0 ref 1 00000100:00100000:1.0:1789760786.809742:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725052056023 time 725051795607 state 0x1 ref 1 00000100:00100000:1.0:1789760786.809987:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725052056023 time 725070276197 state 0x0 ref 1 00000100:00100000:1.0:1789760786.810003:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565526144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.810060:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73461760, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23090 00010000:00010000:1.0:1789760786.810070:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.810086:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760786.810090:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.810106:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.810121:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.816034:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985243 is committed 00002000:00010000:1.0:1789760786.820269:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73461760 -> 73465856 00002000:00010000:1.0:1789760786.820280:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143504 -> 143512 00010000:00010000:1.0:1789760786.820293:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820312:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820321:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820330:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760786.820335:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820344:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820365:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.820374:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73461760->73465855] (req 73461760->73465855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.820476:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565526144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10472us (13062us total) trans 4294985243 rc 0/0 00000100:00100000:1.0:1789760786.820486:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17946 00000100:00100000:1.0:1789760786.820496:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725052056023 time 725070276197 state 0x2 ref 0 00000100:00100000:3.0:1789760786.830023:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760786.832795:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760786.832840:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760786.832858:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760786.832891:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526528 00000100:00100000:2.0:1789760786.832900:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526528 00000100:00100000:2.0:1789760786.832952:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526656 00000100:00100000:2.0:1789760786.832956:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526656 00000100:00100000:2.0:1789760786.832978:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 472 00000100:00100000:2.0:1789760786.832986:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2360:x1876699565526528:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760786.833067:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f2a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2360:x1876699565526528:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.833075:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 472 00000100:00100000:2.0:1789760786.833094:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 473 00000100:00100000:2.0:1789760786.833100:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565526656:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760786.833123:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2360:x1876699565526656:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.833128:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 473 00000100:00080000:2.0:1789760786.833142:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760786.833520:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526400 00000100:00100000:0.0:1789760786.833526:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526400 00000100:00100000:0.0:1789760786.833567:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 400 00000100:00100000:0.0:1789760786.833575:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565526400:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1789760786.833616:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af634c28-3647-4f73-bb24-40d7878858fb+13:2360:x1876699565526400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.833623:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 400 00000100:00100000:1.0:1789760786.834342:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526272 00000100:00100000:1.0:1789760786.834350:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526272 00000100:00100000:0.0:1789760786.834485:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725052056023 time 725070276197 state 0x0 ref 1 00000100:00100000:0.0:1789760786.834501:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725070536613 time 725070276197 state 0x1 ref 1 00000100:00100000:0.0:1789760786.834571:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725070536613 time 725094852309 state 0x0 ref 1 00000100:00100000:0.0:1789760786.834586:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565526272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.834629:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73465856, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x23098 00010000:00010000:0.0:1789760786.834639:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.834660:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.834676:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.834682:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.834723:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.840758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985244 is committed 00002000:00010000:3.0:1789760786.841098:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73465856 -> 73469952 00002000:00010000:3.0:1789760786.841103:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143512 -> 143520 00010000:00010000:3.0:1789760786.841117:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841130:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841140:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841147:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.841152:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841162:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841181:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.841193:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674e980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73465856->73469951] (req 73465856->73469951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.841475:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565526272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6887us (11454us total) trans 4294985244 rc 0/0 00000100:00100000:3.0:1789760786.841487:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17947 00000100:00100000:3.0:1789760786.841497:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725070536613 time 725094852309 state 0x2 ref 0 00000100:00100000:2.0:1789760786.845567:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.847340:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526784 00000100:00100000:1.0:1789760786.847362:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526784 00000100:00100000:2.0:1789760786.847482:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725070536613 time 725094852309 state 0x0 ref 1 00000100:00100000:2.0:1789760786.847500:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725095112725 time 725094852309 state 0x1 ref 1 00000100:00100000:2.0:1789760786.847538:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725095112725 time 725107829443 state 0x0 ref 1 00000100:00100000:2.0:1789760786.847555:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565526784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760786.847600:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73469952, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230a0 00010000:00010000:2.0:1789760786.847610:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.847625:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760786.847629:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760786.847636:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.847670:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.852577:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985245 is committed 00002000:00010000:2.0:1789760786.852686:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73469952 -> 73474048 00002000:00010000:2.0:1789760786.852692:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143520 -> 143528 00010000:00010000:2.0:1789760786.852729:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852741:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852749:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852757:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760786.852762:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852770:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852789:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.852796:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674e987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73469952->73474047] (req 73469952->73474047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760786.852882:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565526784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5325us (7320us total) trans 4294985245 rc 0/0 00000100:00100000:2.0:1789760786.852893:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17948 00000100:00100000:2.0:1789760786.852902:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725095112725 time 725107829443 state 0x2 ref 0 00000100:00100000:2.0:1789760786.857538:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760786.857600:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565526912 00000100:00100000:1.0:1789760786.857609:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565526912 00000100:00100000:1.0:1789760786.857661:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725095112725 time 725107829443 state 0x0 ref 1 00000100:00100000:1.0:1789760786.857688:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725108089859 time 725107829443 state 0x1 ref 1 00000100:00100000:1.0:1789760786.857751:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725108089859 time 725118043237 state 0x0 ref 1 00000100:00100000:1.0:1789760786.857764:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565526912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760786.858619:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73474048, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230a8 00010000:00010000:1.0:1789760786.858630:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.858645:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760786.858650:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.858656:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.858677:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.876960:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985246 is committed 00002000:00010000:0.0:1789760786.877143:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73474048 -> 73478144 00002000:00010000:0.0:1789760786.877149:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143528 -> 143536 00010000:00010000:0.0:1789760786.877163:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877175:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877184:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877192:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.877196:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877205:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877368:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.877378:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674e98e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73474048->73478143] (req 73474048->73478143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.877470:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565526912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19704us (19936us total) trans 4294985246 rc 0/0 00000100:00100000:0.0:1789760786.877481:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17949 00000100:00100000:0.0:1789760786.877490:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725108089859 time 725118043237 state 0x2 ref 0 00000100:00100000:3.0:1789760786.881984:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.882637:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527040 00000100:00100000:0.0:1789760786.882648:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527040 00000100:00100000:0.0:1789760786.882861:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725108089859 time 725118043237 state 0x0 ref 1 00000100:00100000:0.0:1789760786.882878:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725118303653 time 725118043237 state 0x1 ref 1 00000100:00100000:0.0:1789760786.882948:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725118303653 time 725143239362 state 0x0 ref 1 00000100:00100000:0.0:1789760786.882963:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.883013:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73478144, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230b0 00010000:00010000:0.0:1789760786.883022:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.883037:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.883042:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.883048:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.883071:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.889148:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985247 is committed 00002000:00010000:3.0:1789760786.889265:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73478144 -> 73482240 00002000:00010000:3.0:1789760786.889270:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143536 -> 143544 00010000:00010000:3.0:1789760786.889283:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889295:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889305:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889312:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760786.889317:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889325:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889345:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760786.889352:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674e995 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73478144->73482239] (req 73478144->73482239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760786.889522:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6486us (7472us total) trans 4294985247 rc 0/0 00000100:00100000:3.0:1789760786.889530:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17950 00000100:00100000:3.0:1789760786.889538:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725118303653 time 725143239362 state 0x2 ref 0 00000100:00100000:2.0:1789760786.895555:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.895651:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527168 00000100:00100000:0.0:1789760786.895660:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527168 00000100:00100000:0.0:1789760786.895958:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725118303653 time 725143239362 state 0x0 ref 1 00000100:00100000:0.0:1789760786.895972:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725143499778 time 725143239362 state 0x1 ref 1 00000100:00100000:0.0:1789760786.896001:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725143499778 time 725156293006 state 0x0 ref 1 00000100:00100000:0.0:1789760786.896015:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.896130:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73482240, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230b8 00010000:00010000:0.0:1789760786.896140:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.896155:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.896160:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.896166:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.896182:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760786.905970:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985248 is committed 00002000:00010000:2.0:1789760786.906280:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73482240 -> 73486336 00002000:00010000:2.0:1789760786.906286:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143544 -> 143552 00010000:00010000:2.0:1789760786.906310:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906331:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906443:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906452:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760786.906457:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906467:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906486:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.906494:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674e99c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73482240->73486335] (req 73482240->73486335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760786.906590:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10573us (11039us total) trans 4294985248 rc 0/0 00000100:00100000:2.0:1789760786.908194:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17951 00000100:00100000:2.0:1789760786.908222:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725143499778 time 725156293006 state 0x2 ref 0 00000100:00100000:2.0:1789760786.917513:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.917678:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527296 00000100:00100000:0.0:1789760786.917688:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527296 00000100:00100000:0.0:1789760786.917839:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725143499778 time 725156293006 state 0x0 ref 1 00000100:00100000:0.0:1789760786.917854:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725156553422 time 725156293006 state 0x1 ref 1 00000100:00100000:0.0:1789760786.917884:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725156553422 time 725178176451 state 0x0 ref 1 00000100:00100000:0.0:1789760786.917896:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.917946:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73486336, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230c0 00010000:00010000:0.0:1789760786.917956:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.917971:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.917975:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.917981:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.917995:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.929223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985249 is committed 00002000:00010000:0.0:1789760786.929409:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73486336 -> 73490432 00002000:00010000:0.0:1789760786.929414:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143552 -> 143560 00010000:00010000:0.0:1789760786.929532:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929545:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929554:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929562:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.929566:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929576:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929596:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.929605:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73486336->73490431] (req 73486336->73490431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.929750:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11850us (12240us total) trans 4294985249 rc 0/0 00000100:00100000:0.0:1789760786.929761:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17952 00000100:00100000:0.0:1789760786.929838:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725156553422 time 725178176451 state 0x2 ref 0 00000100:00100000:3.0:1789760786.936902:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.937195:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527424 00000100:00100000:0.0:1789760786.937204:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527424 00000100:00100000:0.0:1789760786.937253:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725156553422 time 725178176451 state 0x0 ref 1 00000100:00100000:0.0:1789760786.937267:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725178436867 time 725178176451 state 0x1 ref 1 00000100:00100000:0.0:1789760786.937399:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725178436867 time 725197690310 state 0x0 ref 1 00000100:00100000:0.0:1789760786.937412:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.937474:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73490432, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0x230c8 00010000:00010000:0.0:1789760786.937483:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.937499:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.937503:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.937509:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.937523:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.944520:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985250 is committed 00002000:00010000:0.0:1789760786.945481:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73490432 -> 73494528 00002000:00010000:0.0:1789760786.945488:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760786 -> 1789760787 00002000:00010000:0.0:1789760786.945490:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760786 -> 1789760787 00002000:00010000:0.0:1789760786.945492:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143560 -> 143568 00010000:00010000:0.0:1789760786.945506:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945523:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945532:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945545:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.945550:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945559:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945579:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.945587:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73490432->73494527] (req 73490432->73494527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.945792:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8377us (8895us total) trans 4294985250 rc 0/0 00000100:00100000:0.0:1789760786.945804:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17953 00000100:00100000:0.0:1789760786.945813:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725178436867 time 725197690310 state 0x2 ref 0 00000100:00100000:2.0:1789760786.956558:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.956694:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527552 00000100:00100000:0.0:1789760786.956729:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527552 00000100:00100000:0.0:1789760786.956784:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725178436867 time 725197690310 state 0x0 ref 1 00000100:00100000:0.0:1789760786.956800:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725197950726 time 725197690310 state 0x1 ref 1 00000100:00100000:0.0:1789760786.956830:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725197950726 time 725217121901 state 0x0 ref 1 00000100:00100000:0.0:1789760786.956844:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.956891:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73494528, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230d0 00010000:00010000:0.0:1789760786.956900:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.956914:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.956919:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.956926:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.956939:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.962613:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985251 is committed 00002000:00010000:0.0:1789760786.962776:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73494528 -> 73498624 00002000:00010000:0.0:1789760786.962783:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143568 -> 143576 00010000:00010000:0.0:1789760786.962798:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962813:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962830:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962839:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.962845:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962856:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962879:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.962888:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73494528->73498623] (req 73494528->73498623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.963004:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6159us (6450us total) trans 4294985251 rc 0/0 00000100:00100000:0.0:1789760786.963022:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17954 00000100:00100000:0.0:1789760786.963031:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725197950726 time 725217121901 state 0x2 ref 0 00000100:00100000:2.0:1789760786.969548:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.969623:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527680 00000100:00100000:0.0:1789760786.969632:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527680 00000100:00100000:0.0:1789760786.969691:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725197950726 time 725217121901 state 0x0 ref 1 00000100:00100000:0.0:1789760786.969733:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725217382317 time 725217121901 state 0x1 ref 1 00000100:00100000:0.0:1789760786.969753:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725217382317 time 725230045423 state 0x0 ref 1 00000100:00100000:0.0:1789760786.969765:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.969810:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73498624, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230d8 00010000:00010000:0.0:1789760786.969820:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.969836:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.969840:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.969847:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.969861:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.975690:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985252 is committed 00002000:00010000:0.0:1789760786.975819:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73498624 -> 73502720 00002000:00010000:0.0:1789760786.975825:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143576 -> 143584 00010000:00010000:0.0:1789760786.975839:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975851:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975860:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975873:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.975878:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975887:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975906:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.975914:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73498624->73502719] (req 73498624->73502719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.976003:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6235us (6459us total) trans 4294985252 rc 0/0 00000100:00100000:0.0:1789760786.976019:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17955 00000100:00100000:0.0:1789760786.976029:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725217382317 time 725230045423 state 0x2 ref 0 00000100:00100000:3.0:1789760786.978910:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.982793:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527808 00000100:00100000:0.0:1789760786.982809:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527808 00000100:00100000:0.0:1789760786.982871:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725217382317 time 725230045423 state 0x0 ref 1 00000100:00100000:0.0:1789760786.982887:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725230305839 time 725230045423 state 0x1 ref 1 00000100:00100000:0.0:1789760786.982923:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725230305839 time 725243215907 state 0x0 ref 1 00000100:00100000:0.0:1789760786.982940:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.982987:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73502720, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230e0 00010000:00010000:0.0:1789760786.982996:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.983012:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.983016:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.983023:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.983036:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760786.987608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985253 is committed 00002000:00010000:0.0:1789760786.987749:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73502720 -> 73506816 00002000:00010000:0.0:1789760786.987754:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143584 -> 143592 00010000:00010000:0.0:1789760786.987769:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987782:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987791:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987798:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760786.987803:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987811:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987831:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.987838:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73502720->73506815] (req 73502720->73506815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.987963:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565527808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5022us (9059us total) trans 4294985253 rc 0/0 00000100:00100000:0.0:1789760786.987973:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17956 00000100:00100000:0.0:1789760786.987982:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725230305839 time 725243215907 state 0x2 ref 0 00000100:00100000:2.0:1789760786.995609:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760786.995678:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565527936 00000100:00100000:0.0:1789760786.995687:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565527936 00000100:00100000:0.0:1789760786.995779:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725230305839 time 725243215907 state 0x0 ref 1 00000100:00100000:0.0:1789760786.995794:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725243476323 time 725243215907 state 0x1 ref 1 00000100:00100000:0.0:1789760786.995824:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725243476323 time 725256115949 state 0x0 ref 1 00000100:00100000:0.0:1789760786.995838:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760786.995887:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73506816, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230e8 00010000:00010000:0.0:1789760786.995897:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.995913:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760786.995917:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.995924:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.995937:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.000853:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985254 is committed 00002000:00010000:0.0:1789760787.001288:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73506816 -> 73510912 00002000:00010000:0.0:1789760787.001294:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143592 -> 143600 00010000:00010000:0.0:1789760787.001306:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001382:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001393:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001401:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.001406:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001415:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001433:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.001441:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674e9c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73506816->73510911] (req 73506816->73510911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.001529:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565527936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5691us (5927us total) trans 4294985254 rc 0/0 00000100:00100000:0.0:1789760787.001538:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17957 00000100:00100000:0.0:1789760787.001548:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725243476323 time 725256115949 state 0x2 ref 0 00000100:00100000:2.0:1789760787.009281:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.009396:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528064 00000100:00100000:0.0:1789760787.009405:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528064 00000100:00100000:0.0:1789760787.009453:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725243476323 time 725256115949 state 0x0 ref 1 00000100:00100000:0.0:1789760787.009468:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725256376365 time 725256115949 state 0x1 ref 1 00000100:00100000:0.0:1789760787.009498:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725256376365 time 725269790428 state 0x0 ref 1 00000100:00100000:0.0:1789760787.009510:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.009554:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73510912, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230f0 00010000:00010000:0.0:1789760787.009563:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.009578:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.009583:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.009589:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.009602:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.014303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985255 is committed 00002000:00010000:2.0:1789760787.014423:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73510912 -> 73515008 00002000:00010000:2.0:1789760787.014429:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143600 -> 143608 00010000:00010000:2.0:1789760787.014441:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014453:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014461:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014469:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.014473:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014482:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014500:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.014509:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674e9cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73510912->73515007] (req 73510912->73515007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.014613:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5091us (5328us total) trans 4294985255 rc 0/0 00000100:00100000:2.0:1789760787.014623:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17958 00000100:00100000:2.0:1789760787.014633:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725256376365 time 725269790428 state 0x2 ref 0 00000100:00100000:3.0:1789760787.018434:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.019044:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528192 00000100:00100000:0.0:1789760787.019054:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528192 00000100:00100000:0.0:1789760787.019107:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725256376365 time 725269790428 state 0x0 ref 1 00000100:00100000:0.0:1789760787.019122:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725270050844 time 725269790428 state 0x1 ref 1 00000100:00100000:0.0:1789760787.019156:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725270050844 time 725279447997 state 0x0 ref 1 00000100:00100000:0.0:1789760787.019170:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.019216:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73515008, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x230f8 00010000:00010000:0.0:1789760787.019226:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.019242:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.019247:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.019253:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.019267:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.022795:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985256 is committed 00002000:00010000:0.0:1789760787.022901:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73515008 -> 73519104 00002000:00010000:0.0:1789760787.022905:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143608 -> 143616 00010000:00010000:0.0:1789760787.022917:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022929:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022938:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022945:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.022950:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022959:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022977:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.022985:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73515008->73519103] (req 73515008->73519103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.023101:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 3930us (4671us total) trans 4294985256 rc 0/0 00000100:00100000:0.0:1789760787.023112:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17959 00000100:00100000:0.0:1789760787.023121:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725270050844 time 725279447997 state 0x2 ref 0 00000100:00100000:0.0:1789760787.028234:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.028361:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528320 00000100:00100000:2.0:1789760787.028370:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528320 00000100:00100000:2.0:1789760787.028423:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725270050844 time 725279447997 state 0x0 ref 1 00000100:00100000:2.0:1789760787.028449:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725279708413 time 725279447997 state 0x1 ref 1 00000100:00100000:2.0:1789760787.028476:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725279708413 time 725288768450 state 0x0 ref 1 00000100:00100000:2.0:1789760787.028489:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.028533:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73519104, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23100 00010000:00010000:2.0:1789760787.028542:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.028559:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.028564:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.028571:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.028585:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.033984:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985257 is committed 00002000:00010000:2.0:1789760787.034189:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73519104 -> 73523200 00002000:00010000:2.0:1789760787.034194:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143616 -> 143624 00010000:00010000:2.0:1789760787.034206:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034220:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034229:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034236:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.034241:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034250:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034269:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.034275:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674e9db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73519104->73523199] (req 73519104->73523199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.034408:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5917us (6180us total) trans 4294985257 rc 0/0 00000100:00100000:2.0:1789760787.034420:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17960 00000100:00100000:2.0:1789760787.034430:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725279708413 time 725288768450 state 0x2 ref 0 00000100:00100000:2.0:1789760787.041997:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.042483:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528448 00000100:00100000:0.0:1789760787.042493:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528448 00000100:00100000:0.0:1789760787.042554:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725279708413 time 725288768450 state 0x0 ref 1 00000100:00100000:0.0:1789760787.042570:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725289028866 time 725288768450 state 0x1 ref 1 00000100:00100000:0.0:1789760787.042610:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725289028866 time 725302902888 state 0x0 ref 1 00000100:00100000:0.0:1789760787.042624:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.042686:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73523200, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23108 00010000:00010000:0.0:1789760787.042697:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.042748:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.042752:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.042759:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.042773:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.047981:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985258 is committed 00002000:00010000:0.0:1789760787.048185:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73523200 -> 73527296 00002000:00010000:0.0:1789760787.048190:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143624 -> 143632 00010000:00010000:0.0:1789760787.048204:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048217:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048227:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048234:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.048239:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048248:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048266:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.048275:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73523200->73527295] (req 73523200->73527295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.048405:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5780us (6413us total) trans 4294985258 rc 0/0 00000100:00100000:0.0:1789760787.048416:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17961 00000100:00100000:0.0:1789760787.048424:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725289028866 time 725302902888 state 0x2 ref 0 00000100:00100000:3.0:1789760787.056446:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.056554:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528576 00000100:00100000:0.0:1789760787.056563:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528576 00000100:00100000:0.0:1789760787.056624:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725289028866 time 725302902888 state 0x0 ref 1 00000100:00100000:0.0:1789760787.056640:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725303163304 time 725302902888 state 0x1 ref 1 00000100:00100000:0.0:1789760787.056676:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725303163304 time 725316968215 state 0x0 ref 1 00000100:00100000:0.0:1789760787.056688:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.056754:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73527296, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23110 00010000:00010000:0.0:1789760787.056764:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.056779:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.056783:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.056790:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.056803:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.062422:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985259 is committed 00002000:00010000:0.0:1789760787.062526:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73527296 -> 73531392 00002000:00010000:0.0:1789760787.062531:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143632 -> 143640 00010000:00010000:0.0:1789760787.062544:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062557:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062566:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062574:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.062579:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062588:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062607:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.062615:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73527296->73531391] (req 73527296->73531391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.062754:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565528576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6063us (6313us total) trans 4294985259 rc 0/0 00000100:00100000:0.0:1789760787.062764:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17962 00000100:00100000:0.0:1789760787.062774:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725303163304 time 725316968215 state 0x2 ref 0 00000100:00100000:2.0:1789760787.066906:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.066991:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528704 00000100:00100000:0.0:1789760787.067002:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528704 00000100:00100000:0.0:1789760787.067058:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725303163304 time 725316968215 state 0x0 ref 1 00000100:00100000:0.0:1789760787.067073:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725317228631 time 725316968215 state 0x1 ref 1 00000100:00100000:0.0:1789760787.067093:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725317228631 time 725327385759 state 0x0 ref 1 00000100:00100000:0.0:1789760787.067104:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565528704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.067147:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73531392, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23118 00010000:00010000:0.0:1789760787.067158:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.067173:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.067177:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.067183:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.067196:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.071095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985260 is committed 00002000:00010000:0.0:1789760787.071796:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73531392 -> 73535488 00002000:00010000:0.0:1789760787.071803:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143640 -> 143648 00010000:00010000:0.0:1789760787.071822:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071842:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071852:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071859:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.071865:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071874:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071891:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.071899:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674e9f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73531392->73535487] (req 73531392->73535487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.072047:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565528704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4940us (5146us total) trans 4294985260 rc 0/0 00000100:00100000:0.0:1789760787.072058:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17963 00000100:00100000:0.0:1789760787.072067:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725317228631 time 725327385759 state 0x2 ref 0 00000100:00100000:3.0:1789760787.075510:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.075590:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528832 00000100:00100000:0.0:1789760787.075607:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528832 00000100:00100000:0.0:1789760787.075675:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725317228631 time 725327385759 state 0x0 ref 1 00000100:00100000:0.0:1789760787.075691:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725327646175 time 725327385759 state 0x1 ref 1 00000100:00100000:0.0:1789760787.075741:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725327646175 time 725336032983 state 0x0 ref 1 00000100:00100000:0.0:1789760787.075754:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.075800:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73535488, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23120 00010000:00010000:0.0:1789760787.075808:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.075824:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.075828:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.075834:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.075848:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.079119:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985261 is committed 00002000:00010000:0.0:1789760787.081441:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73535488 -> 73539584 00002000:00010000:0.0:1789760787.081451:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143648 -> 143656 00010000:00010000:0.0:1789760787.081464:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081477:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081493:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081501:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.081505:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081515:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081535:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.081543:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73535488->73539583] (req 73535488->73539583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.081658:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565528832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5902us (6152us total) trans 4294985261 rc 0/0 00000100:00100000:0.0:1789760787.081678:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17964 00000100:00100000:0.0:1789760787.081689:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725327646175 time 725336032983 state 0x2 ref 0 00000100:00100000:3.0:1789760787.084935:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.086067:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565528960 00000100:00100000:0.0:1789760787.086082:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565528960 00000100:00100000:0.0:1789760787.086139:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725327646175 time 725336032983 state 0x0 ref 1 00000100:00100000:0.0:1789760787.086155:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725336293399 time 725336032983 state 0x1 ref 1 00000100:00100000:0.0:1789760787.086179:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725336293399 time 725346470342 state 0x0 ref 1 00000100:00100000:0.0:1789760787.086192:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565528960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.086243:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73539584, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23128 00010000:00010000:0.0:1789760787.086254:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.086271:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.086276:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.086283:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.086298:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.093120:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985262 is committed 00002000:00010000:0.0:1789760787.094793:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73539584 -> 73543680 00002000:00010000:0.0:1789760787.094801:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143656 -> 143664 00010000:00010000:0.0:1789760787.094815:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094828:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094838:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094852:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.094857:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094866:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094885:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.094893:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674e9fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73539584->73543679] (req 73539584->73543679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.094988:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565528960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8794us (10059us total) trans 4294985262 rc 0/0 00000100:00100000:0.0:1789760787.094998:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17965 00000100:00100000:0.0:1789760787.095007:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725336293399 time 725346470342 state 0x2 ref 0 00000100:00100000:2.0:1789760787.099813:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.099933:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529088 00000100:00100000:0.0:1789760787.099943:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529088 00000100:00100000:0.0:1789760787.099996:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725336293399 time 725346470342 state 0x0 ref 1 00000100:00100000:0.0:1789760787.100011:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725346730758 time 725346470342 state 0x1 ref 1 00000100:00100000:0.0:1789760787.100045:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725346730758 time 725360336651 state 0x0 ref 1 00000100:00100000:0.0:1789760787.100060:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.100108:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73543680, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23130 00010000:00010000:0.0:1789760787.100118:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.100132:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.100137:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.100143:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.100156:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.104233:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985263 is committed 00002000:00010000:0.0:1789760787.104350:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73543680 -> 73547776 00002000:00010000:0.0:1789760787.104356:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143664 -> 143672 00010000:00010000:0.0:1789760787.104369:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104381:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104400:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104408:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.104414:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104429:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104450:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.104458:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73543680->73547775] (req 73543680->73547775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.104549:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4487us (4741us total) trans 4294985263 rc 0/0 00000100:00100000:0.0:1789760787.104560:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17966 00000100:00100000:0.0:1789760787.104569:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725346730758 time 725360336651 state 0x2 ref 0 00000100:00100000:2.0:1789760787.110064:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.110771:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529216 00000100:00100000:0.0:1789760787.110782:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529216 00000100:00100000:0.0:1789760787.110835:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725346730758 time 725360336651 state 0x0 ref 1 00000100:00100000:0.0:1789760787.110850:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725360597067 time 725360336651 state 0x1 ref 1 00000100:00100000:0.0:1789760787.110872:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725360597067 time 725371163718 state 0x0 ref 1 00000100:00100000:0.0:1789760787.110884:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.110928:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73547776, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23138 00010000:00010000:0.0:1789760787.110938:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.110954:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.110958:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.110965:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.110978:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.118252:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985264 is committed 00002000:00010000:1.0:1789760787.118430:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73547776 -> 73551872 00002000:00010000:1.0:1789760787.118436:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143672 -> 143680 00010000:00010000:1.0:1789760787.118450:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118475:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118484:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118492:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.118497:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118507:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118529:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.118537:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ea0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73547776->73551871] (req 73547776->73551871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.118645:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7758us (8585us total) trans 4294985264 rc 0/0 00000100:00100000:1.0:1789760787.118656:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17967 00000100:00100000:1.0:1789760787.118676:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725360597067 time 725371163718 state 0x2 ref 0 00000100:00100000:3.0:1789760787.123247:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.123655:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529344 00000100:00100000:0.0:1789760787.123677:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529344 00000100:00100000:0.0:1789760787.123762:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725360597067 time 725371163718 state 0x0 ref 1 00000100:00100000:0.0:1789760787.123776:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725371424134 time 725371163718 state 0x1 ref 1 00000100:00100000:0.0:1789760787.123808:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725371424134 time 725384100158 state 0x0 ref 1 00000100:00100000:0.0:1789760787.123821:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.123871:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73551872, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23140 00010000:00010000:0.0:1789760787.123881:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.123899:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.123904:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.123912:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.123928:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.133102:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985265 is committed 00002000:00010000:2.0:1789760787.133444:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73551872 -> 73555968 00002000:00010000:2.0:1789760787.133450:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143680 -> 143688 00010000:00010000:2.0:1789760787.133464:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133477:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133487:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133495:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.133499:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133508:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133529:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.133537:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73551872->73555967] (req 73551872->73555967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.133822:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9998us (10578us total) trans 4294985265 rc 0/0 00000100:00100000:2.0:1789760787.133833:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17968 00000100:00100000:2.0:1789760787.133842:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725371424134 time 725384100158 state 0x2 ref 0 00000100:00100000:2.0:1789760787.137789:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.137912:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529472 00000100:00100000:0.0:1789760787.137923:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529472 00000100:00100000:0.0:1789760787.137976:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725371424134 time 725384100158 state 0x0 ref 1 00000100:00100000:0.0:1789760787.137992:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725384360574 time 725384100158 state 0x1 ref 1 00000100:00100000:0.0:1789760787.138022:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725384360574 time 725398314237 state 0x0 ref 1 00000100:00100000:0.0:1789760787.138033:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.138072:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73555968, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23148 00010000:00010000:0.0:1789760787.138080:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.138095:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.138099:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.138105:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.138119:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.144094:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985266 is committed 00002000:00010000:1.0:1789760787.145459:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73555968 -> 73560064 00002000:00010000:1.0:1789760787.145466:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143688 -> 143696 00010000:00010000:1.0:1789760787.145481:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145494:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145504:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145512:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.145518:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145527:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145547:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.145560:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ea1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73555968->73560063] (req 73555968->73560063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.145677:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7626us (7876us total) trans 4294985266 rc 0/0 00000100:00100000:1.0:1789760787.145689:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17969 00000100:00100000:1.0:1789760787.145700:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725384360574 time 725398314237 state 0x2 ref 0 00000100:00100000:3.0:1789760787.151139:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.152128:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529600 00000100:00100000:1.0:1789760787.152143:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529600 00000100:00100000:1.0:1789760787.152204:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725384360574 time 725398314237 state 0x0 ref 1 00000100:00100000:1.0:1789760787.152219:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725398574653 time 725398314237 state 0x1 ref 1 00000100:00100000:1.0:1789760787.153832:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725398574653 time 725414114598 state 0x0 ref 1 00000100:00100000:1.0:1789760787.153856:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.153902:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73560064, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23150 00010000:00010000:1.0:1789760787.153912:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.153929:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.153933:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.153939:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.153959:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.160094:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985267 is committed 00002000:00010000:1.0:1789760787.160199:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73560064 -> 73564160 00002000:00010000:1.0:1789760787.160204:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143696 -> 143704 00010000:00010000:1.0:1789760787.160218:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160231:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160241:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160249:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.160253:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160262:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160281:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.160289:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73560064->73564159] (req 73560064->73564159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.160373:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6521us (9239us total) trans 4294985267 rc 0/0 00000100:00100000:1.0:1789760787.160383:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17970 00000100:00100000:1.0:1789760787.160392:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725398574653 time 725414114598 state 0x2 ref 0 00000100:00100000:3.0:1789760787.165129:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.166073:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529728 00000100:00100000:2.0:1789760787.166086:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529728 00000100:00100000:2.0:1789760787.166158:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725398574653 time 725414114598 state 0x0 ref 1 00000100:00100000:2.0:1789760787.166174:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725414375014 time 725414114598 state 0x1 ref 1 00000100:00100000:2.0:1789760787.166297:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725414375014 time 725426587121 state 0x0 ref 1 00000100:00100000:2.0:1789760787.166311:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.166359:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73564160, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23158 00010000:00010000:2.0:1789760787.166369:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.166385:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.166390:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.166396:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.166410:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.172150:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985268 is committed 00002000:00010000:2.0:1789760787.173488:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73564160 -> 73568256 00002000:00010000:2.0:1789760787.173495:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143704 -> 143712 00010000:00010000:2.0:1789760787.173509:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173523:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173532:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173538:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.173542:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173551:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173574:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.173582:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674ea28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73564160->73568255] (req 73564160->73568255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.173781:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7468us (8657us total) trans 4294985268 rc 0/0 00000100:00100000:2.0:1789760787.173792:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17971 00000100:00100000:2.0:1789760787.173801:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725414375014 time 725426587121 state 0x2 ref 0 00000100:00100000:2.0:1789760787.181862:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.183298:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529856 00000100:00100000:1.0:1789760787.183311:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529856 00000100:00100000:1.0:1789760787.183369:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725414375014 time 725426587121 state 0x0 ref 1 00000100:00100000:1.0:1789760787.183385:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725426847537 time 725426587121 state 0x1 ref 1 00000100:00100000:1.0:1789760787.183420:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725426847537 time 725443712915 state 0x0 ref 1 00000100:00100000:1.0:1789760787.183435:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.183487:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73568256, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23160 00010000:00010000:1.0:1789760787.183497:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.183514:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.183518:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.183525:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.183539:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.189699:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985269 is committed 00002000:00010000:1.0:1789760787.193054:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73568256 -> 73572352 00002000:00010000:1.0:1789760787.193065:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143712 -> 143720 00010000:00010000:1.0:1789760787.193078:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193092:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193101:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193108:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.193112:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193122:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193141:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.193149:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73568256->73572351] (req 73568256->73572351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.193309:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565529856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9872us (11451us total) trans 4294985269 rc 0/0 00000100:00100000:1.0:1789760787.193321:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17972 00000100:00100000:1.0:1789760787.193330:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725426847537 time 725443712915 state 0x2 ref 0 00000100:00100000:3.0:1789760787.200298:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.200617:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565529984 00000100:00100000:1.0:1789760787.200627:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565529984 00000100:00100000:1.0:1789760787.200688:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725426847537 time 725443712915 state 0x0 ref 1 00000100:00100000:1.0:1789760787.200743:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725443973331 time 725443712915 state 0x1 ref 1 00000100:00100000:1.0:1789760787.200780:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725443973331 time 725461071953 state 0x0 ref 1 00000100:00100000:1.0:1789760787.200793:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.200844:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73572352, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23168 00010000:00010000:1.0:1789760787.200853:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.200869:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.200873:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.200880:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.200893:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.207305:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985270 is committed 00002000:00010000:1.0:1789760787.207534:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73572352 -> 73576448 00002000:00010000:1.0:1789760787.207539:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143720 -> 143728 00010000:00010000:1.0:1789760787.207553:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207564:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207572:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207579:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.207584:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207593:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207612:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.207623:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73572352->73576447] (req 73572352->73576447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.207767:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565529984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6971us (7473us total) trans 4294985270 rc 0/0 00000100:00100000:1.0:1789760787.207778:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17973 00000100:00100000:1.0:1789760787.207787:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725443973331 time 725461071953 state 0x2 ref 0 00000100:00100000:3.0:1789760787.221466:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.222256:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530112 00000100:00100000:2.0:1789760787.222268:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530112 00000100:00100000:2.0:1789760787.222325:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725443973331 time 725461071953 state 0x0 ref 1 00000100:00100000:2.0:1789760787.222341:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725461332369 time 725461071953 state 0x1 ref 1 00000100:00100000:2.0:1789760787.222383:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725461332369 time 725482674743 state 0x0 ref 1 00000100:00100000:2.0:1789760787.222397:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.222445:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73576448, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23170 00010000:00010000:2.0:1789760787.222454:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.222480:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.222485:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.222491:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.222504:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.228904:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985271 is committed 00002000:00010000:2.0:1789760787.229169:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73576448 -> 73580544 00002000:00010000:2.0:1789760787.229174:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143728 -> 143736 00010000:00010000:2.0:1789760787.229187:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229200:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229209:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229216:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.229220:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229229:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229252:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.229260:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ea3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73576448->73580543] (req 73576448->73580543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.229400:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7001us (7936us total) trans 4294985271 rc 0/0 00000100:00100000:2.0:1789760787.229409:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17974 00000100:00100000:2.0:1789760787.229419:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725461332369 time 725482674743 state 0x2 ref 0 00000100:00100000:2.0:1789760787.243009:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.243163:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530240 00000100:00100000:1.0:1789760787.243173:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530240 00000100:00100000:1.0:1789760787.243223:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725461332369 time 725482674743 state 0x0 ref 1 00000100:00100000:1.0:1789760787.243239:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725482935159 time 725482674743 state 0x1 ref 1 00000100:00100000:1.0:1789760787.243275:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725482935159 time 725503567618 state 0x0 ref 1 00000100:00100000:1.0:1789760787.243288:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.243347:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73580544, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23178 00010000:00010000:1.0:1789760787.243357:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.243372:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.244010:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.244019:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.244034:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.250969:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985272 is committed 00002000:00010000:1.0:1789760787.251099:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73580544 -> 73584640 00002000:00010000:1.0:1789760787.251105:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143736 -> 143744 00010000:00010000:1.0:1789760787.251120:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251139:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251148:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251156:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.251161:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251169:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251188:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.251195:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73580544->73584639] (req 73580544->73584639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.251334:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8043us (8330us total) trans 4294985272 rc 0/0 00000100:00100000:1.0:1789760787.251345:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17975 00000100:00100000:1.0:1789760787.251354:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725482935159 time 725503567618 state 0x2 ref 0 00000100:00100000:3.0:1789760787.258291:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.258367:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530368 00000100:00100000:1.0:1789760787.258376:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530368 00000100:00100000:1.0:1789760787.258422:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725482935159 time 725503567618 state 0x0 ref 1 00000100:00100000:1.0:1789760787.258437:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725503828034 time 725503567618 state 0x1 ref 1 00000100:00100000:1.0:1789760787.258463:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725503828034 time 725518755858 state 0x0 ref 1 00000100:00100000:1.0:1789760787.258474:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565530368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.258520:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73584640, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23180 00010000:00010000:1.0:1789760787.258529:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.258544:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.258548:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.258555:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.258567:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.262540:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985273 is committed 00002000:00010000:1.0:1789760787.262968:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73584640 -> 73588736 00002000:00010000:1.0:1789760787.262973:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143744 -> 143752 00010000:00010000:1.0:1789760787.263127:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263141:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263157:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263164:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.263169:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263177:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263197:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.263204:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73584640->73588735] (req 73584640->73588735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.263295:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565530368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4817us (5007us total) trans 4294985273 rc 0/0 00000100:00100000:1.0:1789760787.263306:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17976 00000100:00100000:1.0:1789760787.263314:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725503828034 time 725518755858 state 0x2 ref 0 00000100:00100000:3.0:1789760787.272514:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.272857:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530496 00000100:00100000:2.0:1789760787.272866:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530496 00000100:00100000:2.0:1789760787.272922:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725503828034 time 725518755858 state 0x0 ref 1 00000100:00100000:2.0:1789760787.272936:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725519016274 time 725518755858 state 0x1 ref 1 00000100:00100000:2.0:1789760787.272960:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725519016274 time 725533252073 state 0x0 ref 1 00000100:00100000:2.0:1789760787.272972:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565530496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.273029:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73588736, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23188 00010000:00010000:2.0:1789760787.273045:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.273067:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.273071:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.273076:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.273090:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.279146:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985274 is committed 00002000:00010000:2.0:1789760787.279421:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73588736 -> 73592832 00002000:00010000:2.0:1789760787.279610:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143752 -> 143760 00010000:00010000:2.0:1789760787.279625:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279639:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279648:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279655:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.279674:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279684:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279737:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.279745:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ea52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73588736->73592831] (req 73588736->73592831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.279839:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565530496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6865us (7330us total) trans 4294985274 rc 0/0 00000100:00100000:2.0:1789760787.279850:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17977 00000100:00100000:2.0:1789760787.279859:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725519016274 time 725533252073 state 0x2 ref 0 00000100:00100000:2.0:1789760787.282911:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.283391:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530624 00000100:00100000:1.0:1789760787.283401:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530624 00000100:00100000:1.0:1789760787.283649:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725519016274 time 725533252073 state 0x0 ref 1 00000100:00100000:1.0:1789760787.283677:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725533512489 time 725533252073 state 0x1 ref 1 00000100:00100000:3.0:1789760787.283777:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725533512489 time 725544067805 state 0x0 ref 1 00000100:00100000:3.0:1789760787.283792:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.283835:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73592832, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23190 00010000:00010000:3.0:1789760787.283843:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.283858:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.283863:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.283869:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.283884:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.287954:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985275 is committed 00002000:00010000:3.0:1789760787.288185:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73592832 -> 73596928 00002000:00010000:3.0:1789760787.288191:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143760 -> 143768 00010000:00010000:3.0:1789760787.288203:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288216:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288224:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288238:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.288243:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288252:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288268:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.288276:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73592832->73596927] (req 73592832->73596927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.288397:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4603us (5489us total) trans 4294985275 rc 0/0 00000100:00100000:3.0:1789760787.288406:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17978 00000100:00100000:3.0:1789760787.288414:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725533512489 time 725544067805 state 0x2 ref 0 00000100:00100000:2.0:1789760787.292795:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.292847:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530752 00000100:00100000:1.0:1789760787.292857:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530752 00000100:00100000:1.0:1789760787.292909:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725533512489 time 725544067805 state 0x0 ref 1 00000100:00100000:1.0:1789760787.292923:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725544328221 time 725544067805 state 0x1 ref 1 00000100:00100000:1.0:1789760787.292950:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725544328221 time 725553243061 state 0x0 ref 1 00000100:00100000:1.0:1789760787.292963:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565530752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.293035:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73596928, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23198 00010000:00010000:1.0:1789760787.293045:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.293061:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.293066:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.293072:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.293086:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.296634:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985276 is committed 00002000:00010000:1.0:1789760787.296960:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73596928 -> 73601024 00002000:00010000:1.0:1789760787.296966:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143768 -> 143776 00010000:00010000:1.0:1789760787.297062:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297077:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297087:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297094:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.297099:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297107:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297125:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.297133:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73596928->73601023] (req 73596928->73601023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.297204:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565530752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4240us (4417us total) trans 4294985276 rc 0/0 00000100:00100000:1.0:1789760787.297215:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17979 00000100:00100000:1.0:1789760787.297225:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725544328221 time 725553243061 state 0x2 ref 0 00000100:00100000:0.0:1789760787.303408:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.303553:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565530880 00000100:00100000:2.0:1789760787.303562:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565530880 00000100:00100000:2.0:1789760787.303616:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725544328221 time 725553243061 state 0x0 ref 1 00000100:00100000:2.0:1789760787.303632:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725553503477 time 725553243061 state 0x1 ref 1 00000100:00100000:2.0:1789760787.303657:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725553503477 time 725563948555 state 0x0 ref 1 00000100:00100000:2.0:1789760787.303681:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.303792:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73601024, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231a0 00010000:00010000:2.0:1789760787.303802:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.303822:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.303826:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.303832:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.303845:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.307756:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985277 is committed 00002000:00010000:2.0:1789760787.307888:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73601024 -> 73605120 00002000:00010000:2.0:1789760787.307893:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143776 -> 143784 00010000:00010000:2.0:1789760787.307908:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307919:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307927:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307935:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.307939:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307948:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307971:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.307979:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ea67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73601024->73605119] (req 73601024->73605119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.308067:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565530880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4383us (4664us total) trans 4294985277 rc 0/0 00000100:00100000:2.0:1789760787.308079:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17980 00000100:00100000:2.0:1789760787.308089:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725553503477 time 725563948555 state 0x2 ref 0 00000100:00100000:2.0:1789760787.310821:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.310906:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531008 00000100:00100000:3.0:1789760787.310915:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531008 00000100:00100000:3.0:1789760787.310966:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725553503477 time 725563948555 state 0x0 ref 1 00000100:00100000:3.0:1789760787.310992:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725564208971 time 725563948555 state 0x1 ref 1 00000100:00100000:3.0:1789760787.311028:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725564208971 time 725571319766 state 0x0 ref 1 00000100:00100000:3.0:1789760787.311044:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565531008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.311090:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73605120, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231a8 00010000:00010000:3.0:1789760787.311099:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.311112:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.311116:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.311122:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.311135:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.316867:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985278 is committed 00002000:00010000:3.0:1789760787.317048:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73605120 -> 73609216 00002000:00010000:3.0:1789760787.317054:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143784 -> 143792 00010000:00010000:3.0:1789760787.317067:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317081:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317090:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317098:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.317103:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317113:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317133:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.317141:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73605120->73609215] (req 73605120->73609215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.317268:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565531008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6221us (6450us total) trans 4294985278 rc 0/0 00000100:00100000:3.0:1789760787.317278:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17981 00000100:00100000:3.0:1789760787.317288:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725564208971 time 725571319766 state 0x2 ref 0 00000100:00100000:2.0:1789760787.326249:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.326775:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531136 00000100:00100000:1.0:1789760787.326785:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531136 00000100:00100000:1.0:1789760787.326838:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725564208971 time 725571319766 state 0x0 ref 1 00000100:00100000:1.0:1789760787.326854:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725571580182 time 725571319766 state 0x1 ref 1 00000100:00100000:1.0:1789760787.326885:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725571580182 time 725587177197 state 0x0 ref 1 00000100:00100000:1.0:1789760787.326897:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.326944:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73609216, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231b0 00010000:00010000:1.0:1789760787.326954:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326969:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.326973:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.327147:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.327164:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.332391:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985279 is committed 00002000:00010000:1.0:1789760787.332528:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73609216 -> 73613312 00002000:00010000:1.0:1789760787.332534:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143792 -> 143800 00010000:00010000:1.0:1789760787.332546:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332559:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332570:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332578:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.332582:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332591:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332678:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.332686:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73609216->73613311] (req 73609216->73613311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.332821:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5921us (6577us total) trans 4294985279 rc 0/0 00000100:00100000:1.0:1789760787.332831:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17982 00000100:00100000:1.0:1789760787.332840:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725571580182 time 725587177197 state 0x2 ref 0 00000100:00100000:0.0:1789760787.336194:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.336340:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531264 00000100:00100000:3.0:1789760787.336349:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531264 00000100:00100000:3.0:1789760787.336407:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725571580182 time 725587177197 state 0x0 ref 1 00000100:00100000:3.0:1789760787.336421:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725587437613 time 725587177197 state 0x1 ref 1 00000100:00100000:3.0:1789760787.336452:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725587437613 time 725596744089 state 0x0 ref 1 00000100:00100000:3.0:1789760787.336463:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565531264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.336508:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73613312, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231b8 00010000:00010000:3.0:1789760787.336517:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.336532:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.336536:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.336542:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.336556:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.344655:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985280 is committed 00002000:00010000:2.0:1789760787.344796:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73613312 -> 73617408 00002000:00010000:2.0:1789760787.344801:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143800 -> 143808 00010000:00010000:2.0:1789760787.344814:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344828:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344837:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344845:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.344850:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344860:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344878:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.344885:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674ea7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73613312->73617407] (req 73613312->73617407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.344969:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565531264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8503us (8780us total) trans 4294985280 rc 0/0 00000100:00100000:2.0:1789760787.344980:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17983 00000100:00100000:2.0:1789760787.344989:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725587437613 time 725596744089 state 0x2 ref 0 00000100:00100000:2.0:1789760787.351022:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.351096:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531392 00000100:00100000:3.0:1789760787.351106:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531392 00000100:00100000:3.0:1789760787.351157:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725587437613 time 725596744089 state 0x0 ref 1 00000100:00100000:3.0:1789760787.351171:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725597004505 time 725596744089 state 0x1 ref 1 00000100:00100000:3.0:1789760787.351199:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725597004505 time 725611491148 state 0x0 ref 1 00000100:00100000:3.0:1789760787.351210:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.351258:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73617408, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231c0 00010000:00010000:3.0:1789760787.351268:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.351289:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.351293:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.351299:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.351312:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.355969:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985281 is committed 00002000:00010000:3.0:1789760787.356835:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73617408 -> 73621504 00002000:00010000:3.0:1789760787.356840:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143808 -> 143816 00010000:00010000:3.0:1789760787.356853:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356866:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356875:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356883:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.356889:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356898:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356922:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.356930:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674ea83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73617408->73621503] (req 73617408->73621503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.357165:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5950us (6148us total) trans 4294985281 rc 0/0 00000100:00100000:3.0:1789760787.357176:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17984 00000100:00100000:3.0:1789760787.357187:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725597004505 time 725611491148 state 0x2 ref 0 00000100:00100000:2.0:1789760787.365831:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.366909:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531520 00000100:00100000:3.0:1789760787.366922:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531520 00000100:00100000:3.0:1789760787.366985:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725597004505 time 725611491148 state 0x0 ref 1 00000100:00100000:3.0:1789760787.366999:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725611751564 time 725611491148 state 0x1 ref 1 00000100:00100000:3.0:1789760787.367038:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725611751564 time 725627330401 state 0x0 ref 1 00000100:00100000:3.0:1789760787.367051:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.367100:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73621504, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231c8 00010000:00010000:3.0:1789760787.367109:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.367124:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.367129:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.367136:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.367151:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.370805:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985282 is committed 00002000:00010000:1.0:1789760787.379139:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73621504 -> 73625600 00002000:00010000:1.0:1789760787.379151:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143816 -> 143824 00010000:00010000:1.0:1789760787.379165:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379179:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379188:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379195:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.379200:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379209:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379229:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.379237:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674ea8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73621504->73625599] (req 73621504->73625599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.379341:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12287us (13515us total) trans 4294985282 rc 0/0 00000100:00100000:1.0:1789760787.379352:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17985 00000100:00100000:1.0:1789760787.379361:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725611751564 time 725627330401 state 0x2 ref 0 00000100:00100000:0.0:1789760787.384913:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.384984:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531648 00000100:00100000:2.0:1789760787.384994:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531648 00000100:00100000:2.0:1789760787.385045:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725611751564 time 725627330401 state 0x0 ref 1 00000100:00100000:2.0:1789760787.385060:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725627590817 time 725627330401 state 0x1 ref 1 00000100:00100000:2.0:1789760787.385086:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725627590817 time 725645378526 state 0x0 ref 1 00000100:00100000:2.0:1789760787.385098:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.385144:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73625600, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231d0 00010000:00010000:2.0:1789760787.385154:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.385168:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.385173:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.385179:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.385192:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.389076:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985283 is committed 00002000:00010000:2.0:1789760787.389176:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73625600 -> 73629696 00002000:00010000:2.0:1789760787.389182:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143824 -> 143832 00010000:00010000:2.0:1789760787.389195:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389207:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389216:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389224:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.389229:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389243:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389264:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.389272:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ea91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73625600->73629695] (req 73625600->73629695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.389362:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4261us (4454us total) trans 4294985283 rc 0/0 00000100:00100000:2.0:1789760787.389372:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17986 00000100:00100000:2.0:1789760787.389382:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725627590817 time 725645378526 state 0x2 ref 0 00000100:00100000:3.0:1789760787.394808:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.395160:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531776 00000100:00100000:0.0:1789760787.395169:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531776 00000100:00100000:0.0:1789760787.395220:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725627590817 time 725645378526 state 0x0 ref 1 00000100:00100000:0.0:1789760787.395236:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725645638942 time 725645378526 state 0x1 ref 1 00000100:00100000:0.0:1789760787.395270:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725645638942 time 725655562546 state 0x0 ref 1 00000100:00100000:0.0:1789760787.395283:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565531776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.395328:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73629696, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231d8 00010000:00010000:0.0:1789760787.395337:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.395358:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.395363:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.395369:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.395382:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.399164:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985284 is committed 00002000:00010000:0.0:1789760787.399276:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73629696 -> 73633792 00002000:00010000:0.0:1789760787.399281:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143832 -> 143840 00010000:00010000:0.0:1789760787.399294:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399308:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399317:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399325:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.399330:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399339:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399364:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.399372:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ea98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73629696->73633791] (req 73629696->73633791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.399514:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565531776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4228us (4711us total) trans 4294985284 rc 0/0 00000100:00100000:0.0:1789760787.399526:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17987 00000100:00100000:0.0:1789760787.399535:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725645638942 time 725655562546 state 0x2 ref 0 00000100:00100000:3.0:1789760787.405545:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.405630:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565531904 00000100:00100000:1.0:1789760787.405639:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565531904 00000100:00100000:1.0:1789760787.405698:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725645638942 time 725655562546 state 0x0 ref 1 00000100:00100000:1.0:1789760787.405733:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725655822962 time 725655562546 state 0x1 ref 1 00000100:00100000:1.0:1789760787.405766:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725655822962 time 725666058655 state 0x0 ref 1 00000100:00100000:1.0:1789760787.405779:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.405821:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73633792, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231e0 00010000:00010000:1.0:1789760787.405831:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.405846:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.405851:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.405857:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.405869:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.409885:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985285 is committed 00002000:00010000:1.0:1789760787.409992:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73633792 -> 73637888 00002000:00010000:1.0:1789760787.409998:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143840 -> 143848 00010000:00010000:1.0:1789760787.410019:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410038:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410047:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410056:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.410061:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410070:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410089:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.410096:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ea9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73633792->73637887] (req 73633792->73637887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.410193:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565531904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4412us (4651us total) trans 4294985285 rc 0/0 00000100:00100000:1.0:1789760787.410204:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17988 00000100:00100000:1.0:1789760787.410213:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725655822962 time 725666058655 state 0x2 ref 0 00000100:00100000:0.0:1789760787.416563:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.416634:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532032 00000100:00100000:2.0:1789760787.416653:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532032 00000100:00100000:2.0:1789760787.416879:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725655822962 time 725666058655 state 0x0 ref 1 00000100:00100000:2.0:1789760787.416896:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725666319071 time 725666058655 state 0x1 ref 1 00000100:00100000:2.0:1789760787.416926:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725666319071 time 725677218042 state 0x0 ref 1 00000100:00100000:2.0:1789760787.416939:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.416984:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73637888, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231e8 00010000:00010000:2.0:1789760787.416994:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.417011:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1789760787.417015:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.417021:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.417035:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.426829:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985286 is committed 00002000:00010000:0.0:1789760787.426943:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73637888 -> 73641984 00002000:00010000:0.0:1789760787.426949:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143848 -> 143856 00010000:00010000:0.0:1789760787.426962:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.426973:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.426982:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.426990:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.426995:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.427054:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.427076:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.427084:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674eaa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73637888->73641983] (req 73637888->73641983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.427177:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10236us (10619us total) trans 4294985286 rc 0/0 00000100:00100000:0.0:1789760787.427187:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17989 00000100:00100000:0.0:1789760787.427197:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725666319071 time 725677218042 state 0x2 ref 0 00000100:00100000:2.0:1789760787.434795:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.434980:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532160 00000100:00100000:0.0:1789760787.434991:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532160 00000100:00100000:0.0:1789760787.435053:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725666319071 time 725677218042 state 0x0 ref 1 00000100:00100000:0.0:1789760787.435070:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725677478458 time 725677218042 state 0x1 ref 1 00000100:00100000:0.0:1789760787.435102:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725677478458 time 725695393877 state 0x0 ref 1 00000100:00100000:0.0:1789760787.435117:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565532160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.435163:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73641984, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231f0 00010000:00010000:0.0:1789760787.435173:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.435190:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.435194:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.435200:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.435214:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.442220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985287 is committed 00002000:00010000:0.0:1789760787.442860:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73641984 -> 73646080 00002000:00010000:0.0:1789760787.442866:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143856 -> 143864 00010000:00010000:0.0:1789760787.442880:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442892:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442902:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442909:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.442914:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442923:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442946:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.442954:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eaad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73641984->73646079] (req 73641984->73646079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.443927:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565532160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8805us (9134us total) trans 4294985287 rc 0/0 00000100:00100000:0.0:1789760787.443942:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17990 00000100:00100000:0.0:1789760787.443953:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725677478458 time 725695393877 state 0x2 ref 0 00000100:00100000:3.0:1789760787.449188:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.449521:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532288 00000100:00100000:1.0:1789760787.449532:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532288 00000100:00100000:1.0:1789760787.449585:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725677478458 time 725695393877 state 0x0 ref 1 00000100:00100000:1.0:1789760787.449611:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725695654293 time 725695393877 state 0x1 ref 1 00000100:00100000:1.0:1789760787.449641:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725695654293 time 725709933361 state 0x0 ref 1 00000100:00100000:1.0:1789760787.449827:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.449874:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73646080, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x231f8 00010000:00010000:1.0:1789760787.449883:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.449900:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.449904:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.449910:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.449924:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.462477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985288 is committed 00002000:00010000:1.0:1789760787.462670:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73646080 -> 73650176 00002000:00010000:1.0:1789760787.462677:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143864 -> 143872 00010000:00010000:1.0:1789760787.462691:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462733:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462833:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462844:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.462849:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462859:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462879:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.462887:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73646080->73650175] (req 73646080->73650175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.462979:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13151us (13795us total) trans 4294985288 rc 0/0 00000100:00100000:1.0:1789760787.462990:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17991 00000100:00100000:1.0:1789760787.462999:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725695654293 time 725709933361 state 0x2 ref 0 00000100:00100000:2.0:1789760787.467156:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.467275:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532416 00000100:00100000:0.0:1789760787.467284:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532416 00000100:00100000:0.0:1789760787.467336:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725695654293 time 725709933361 state 0x0 ref 1 00000100:00100000:0.0:1789760787.467350:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725710193777 time 725709933361 state 0x1 ref 1 00000100:00100000:0.0:1789760787.467379:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725710193777 time 725727671093 state 0x0 ref 1 00000100:00100000:0.0:1789760787.467390:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.467435:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73650176, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23200 00010000:00010000:0.0:1789760787.467444:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.467459:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.467465:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.467470:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.467483:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.474468:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985289 is committed 00002000:00010000:0.0:1789760787.474741:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73650176 -> 73654272 00002000:00010000:0.0:1789760787.474833:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143872 -> 143880 00010000:00010000:0.0:1789760787.474850:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474864:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474875:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474883:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.474889:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474899:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474922:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.474937:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eabb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73650176->73654271] (req 73650176->73654271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.475137:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7742us (7983us total) trans 4294985289 rc 0/0 00000100:00100000:0.0:1789760787.475149:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17992 00000100:00100000:0.0:1789760787.475159:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725710193777 time 725727671093 state 0x2 ref 0 00000100:00100000:3.0:1789760787.479869:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.479953:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532544 00000100:00100000:0.0:1789760787.479963:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532544 00000100:00100000:0.0:1789760787.480029:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725710193777 time 725727671093 state 0x0 ref 1 00000100:00100000:0.0:1789760787.480044:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725727931509 time 725727671093 state 0x1 ref 1 00000100:00100000:0.0:1789760787.480076:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725727931509 time 725740368166 state 0x0 ref 1 00000100:00100000:0.0:1789760787.480089:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565532544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.480137:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73654272, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23208 00010000:00010000:0.0:1789760787.480147:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.480163:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.480168:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.480174:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.480193:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.485691:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985290 is committed 00002000:00010000:0.0:1789760787.486402:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73654272 -> 73658368 00002000:00010000:0.0:1789760787.486408:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143880 -> 143888 00010000:00010000:0.0:1789760787.486423:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486435:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486444:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486451:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.486456:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486466:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486487:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.486495:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73654272->73658367] (req 73654272->73658367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.486758:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565532544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6657us (6886us total) trans 4294985290 rc 0/0 00000100:00100000:0.0:1789760787.486770:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17993 00000100:00100000:0.0:1789760787.486780:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725727931509 time 725740368166 state 0x2 ref 0 00000100:00100000:2.0:1789760787.491183:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.491397:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532672 00000100:00100000:1.0:1789760787.491407:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532672 00000100:00100000:1.0:1789760787.491458:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725727931509 time 725740368166 state 0x0 ref 1 00000100:00100000:1.0:1789760787.491473:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725740628582 time 725740368166 state 0x1 ref 1 00000100:00100000:1.0:1789760787.491538:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725740628582 time 725751829215 state 0x0 ref 1 00000100:00100000:1.0:1789760787.491552:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.491607:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73658368, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23210 00010000:00010000:1.0:1789760787.491618:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.491633:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.491638:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.491644:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.491666:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.496592:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985291 is committed 00002000:00010000:1.0:1789760787.496836:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73658368 -> 73662464 00002000:00010000:1.0:1789760787.496842:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143888 -> 143896 00010000:00010000:1.0:1789760787.496856:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496868:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496877:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496890:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.496894:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496903:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496922:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.496929:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eac9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73658368->73662463] (req 73658368->73662463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.497066:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5509us (5884us total) trans 4294985291 rc 0/0 00000100:00100000:1.0:1789760787.497077:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17994 00000100:00100000:1.0:1789760787.497086:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725740628582 time 725751829215 state 0x2 ref 0 00000100:00100000:2.0:1789760787.506312:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.509136:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532800 00000100:00100000:0.0:1789760787.509149:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532800 00000100:00100000:1.0:1789760787.509301:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725740628582 time 725751829215 state 0x0 ref 1 00000100:00100000:1.0:1789760787.509316:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725752089631 time 725751829215 state 0x1 ref 1 00000100:00100000:1.0:1789760787.509351:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725752089631 time 725769642524 state 0x0 ref 1 00000100:00100000:1.0:1789760787.509364:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.509411:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73662464, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23218 00010000:00010000:1.0:1789760787.509421:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.509437:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.509441:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.509455:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.509469:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.514113:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985292 is committed 00002000:00010000:1.0:1789760787.514238:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73662464 -> 73666560 00002000:00010000:1.0:1789760787.514243:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143896 -> 143904 00010000:00010000:1.0:1789760787.514257:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514268:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514277:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514284:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.514289:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514304:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514324:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.514332:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ead0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73662464->73666559] (req 73662464->73666559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.514433:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565532800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5066us (8125us total) trans 4294985292 rc 0/0 00000100:00100000:1.0:1789760787.514443:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17995 00000100:00100000:1.0:1789760787.514452:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725752089631 time 725769642524 state 0x2 ref 0 00000100:00100000:2.0:1789760787.522682:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.522854:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565532928 00000100:00100000:0.0:1789760787.522865:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565532928 00000100:00100000:0.0:1789760787.522919:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725752089631 time 725769642524 state 0x0 ref 1 00000100:00100000:0.0:1789760787.522935:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725769902940 time 725769642524 state 0x1 ref 1 00000100:00100000:0.0:1789760787.522966:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725769902940 time 725783257793 state 0x0 ref 1 00000100:00100000:0.0:1789760787.522989:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565532928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.523048:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73666560, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23220 00010000:00010000:0.0:1789760787.523058:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.523075:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.523080:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.523086:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.523101:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.527581:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985293 is committed 00002000:00010000:0.0:1789760787.527789:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73666560 -> 73670656 00002000:00010000:0.0:1789760787.527794:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143904 -> 143912 00010000:00010000:0.0:1789760787.527808:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527821:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527830:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527837:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.527841:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527850:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527869:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.527877:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ead7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73666560->73670655] (req 73666560->73670655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.528090:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565532928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5109us (5413us total) trans 4294985293 rc 0/0 00000100:00100000:0.0:1789760787.528103:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17996 00000100:00100000:0.0:1789760787.528113:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725769902940 time 725783257793 state 0x2 ref 0 00000100:00100000:2.0:1789760787.536515:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.536973:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533056 00000100:00100000:1.0:1789760787.536984:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533056 00000100:00100000:1.0:1789760787.537200:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725769902940 time 725783257793 state 0x0 ref 1 00000100:00100000:1.0:1789760787.537217:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725783518209 time 725783257793 state 0x1 ref 1 00000100:00100000:1.0:1789760787.537287:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725783518209 time 725797577432 state 0x0 ref 1 00000100:00100000:1.0:1789760787.537299:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.537350:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73670656, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23228 00010000:00010000:1.0:1789760787.537359:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.537375:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.537379:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.537385:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.537399:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.541894:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985294 is committed 00002000:00010000:1.0:1789760787.544958:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73670656 -> 73674752 00002000:00010000:1.0:1789760787.544967:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143912 -> 143920 00010000:00010000:1.0:1789760787.544981:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.544995:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.545109:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.545118:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.545124:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.545133:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.545159:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.545166:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eade lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73670656->73674751] (req 73670656->73674751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.545318:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8015us (8807us total) trans 4294985294 rc 0/0 00000100:00100000:1.0:1789760787.545328:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17997 00000100:00100000:1.0:1789760787.545338:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725783518209 time 725797577432 state 0x2 ref 0 00000100:00100000:2.0:1789760787.550824:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.551145:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533184 00000100:00100000:1.0:1789760787.551154:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533184 00000100:00100000:1.0:1789760787.551206:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725783518209 time 725797577432 state 0x0 ref 1 00000100:00100000:1.0:1789760787.551220:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725797837848 time 725797577432 state 0x1 ref 1 00000100:00100000:1.0:1789760787.551287:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725797837848 time 725811577725 state 0x0 ref 1 00000100:00100000:1.0:1789760787.551300:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.551347:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73674752, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23230 00010000:00010000:1.0:1789760787.551357:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.551372:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.551377:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.551384:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.551398:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760787.556546:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985295 is committed 00002000:00010000:1.0:1789760787.556674:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73674752 -> 73678848 00002000:00010000:1.0:1789760787.556679:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143920 -> 143928 00010000:00010000:1.0:1789760787.556692:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556733:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556743:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556750:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.556755:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556765:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556784:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.556797:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73674752->73678847] (req 73674752->73678847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.556915:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5611us (6095us total) trans 4294985295 rc 0/0 00000100:00100000:1.0:1789760787.556925:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17998 00000100:00100000:1.0:1789760787.556934:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725797837848 time 725811577725 state 0x2 ref 0 00000100:00100000:2.0:1789760787.564056:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.564125:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533312 00000100:00100000:0.0:1789760787.564135:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533312 00000100:00100000:0.0:1789760787.564192:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725797837848 time 725811577725 state 0x0 ref 1 00000100:00100000:0.0:1789760787.564206:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725811838141 time 725811577725 state 0x1 ref 1 00000100:00100000:0.0:1789760787.564242:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725811838141 time 725824533657 state 0x0 ref 1 00000100:00100000:0.0:1789760787.564256:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.564303:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73678848, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23238 00010000:00010000:0.0:1789760787.564323:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.564338:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.564343:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.564349:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.564363:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.577529:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985296 is committed 00002000:00010000:0.0:1789760787.577678:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73678848 -> 73682944 00002000:00010000:0.0:1789760787.577683:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143928 -> 143936 00010000:00010000:0.0:1789760787.577698:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577727:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577736:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577744:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.577748:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577757:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577774:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.577782:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674eaec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73678848->73682943] (req 73678848->73682943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.577885:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13628us (13848us total) trans 4294985296 rc 0/0 00000100:00100000:0.0:1789760787.577894:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 17999 00000100:00100000:0.0:1789760787.577904:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725811838141 time 725824533657 state 0x2 ref 0 00000100:00100000:0.0:1789760787.597399:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.598130:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533440 00000100:00100000:1.0:1789760787.598142:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533440 00000100:00100000:1.0:1789760787.598199:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725811838141 time 725824533657 state 0x0 ref 1 00000100:00100000:1.0:1789760787.598215:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725824794073 time 725824533657 state 0x1 ref 1 00000100:00100000:1.0:1789760787.598248:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725824794073 time 725858539947 state 0x0 ref 1 00000100:00100000:1.0:1789760787.598259:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.598309:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73682944, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23240 00010000:00010000:1.0:1789760787.598319:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.598334:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.598339:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.598346:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.598370:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.606523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985297 is committed 00002000:00010000:1.0:1789760787.606641:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73682944 -> 73687040 00002000:00010000:1.0:1789760787.606647:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143936 -> 143944 00010000:00010000:1.0:1789760787.606673:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606686:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606695:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606702:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.606743:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606752:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606771:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.606778:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eaf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73682944->73687039] (req 73682944->73687039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.606873:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8611us (9480us total) trans 4294985297 rc 0/0 00000100:00100000:1.0:1789760787.606884:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18000 00000100:00100000:1.0:1789760787.606893:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725824794073 time 725858539947 state 0x2 ref 0 00000100:00100000:2.0:1789760787.612240:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.612325:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533568 00000100:00100000:1.0:1789760787.612335:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533568 00000100:00100000:1.0:1789760787.612395:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725824794073 time 725858539947 state 0x0 ref 1 00000100:00100000:1.0:1789760787.612412:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725858800363 time 725858539947 state 0x1 ref 1 00000100:00100000:1.0:1789760787.612447:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725858800363 time 725872738239 state 0x0 ref 1 00000100:00100000:1.0:1789760787.612460:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.612512:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73687040, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23248 00010000:00010000:1.0:1789760787.612524:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.612542:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.612546:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.612553:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.612568:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.617671:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985298 is committed 00002000:00010000:1.0:1789760787.617948:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73687040 -> 73691136 00002000:00010000:1.0:1789760787.617954:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143944 -> 143952 00010000:00010000:1.0:1789760787.617967:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.617982:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.617991:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.617999:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.618018:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.618028:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.618049:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.618057:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eafa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73687040->73691135] (req 73687040->73691135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.618156:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565533568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5693us (5920us total) trans 4294985298 rc 0/0 00000100:00100000:1.0:1789760787.618169:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18001 00000100:00100000:1.0:1789760787.618180:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725858800363 time 725872738239 state 0x2 ref 0 00000100:00100000:2.0:1789760787.630258:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760787.630409:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533696 00000100:00100000:0.0:1789760787.630418:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533696 00000100:00100000:0.0:1789760787.630472:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725858800363 time 725872738239 state 0x0 ref 1 00000100:00100000:0.0:1789760787.630488:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725872998655 time 725872738239 state 0x1 ref 1 00000100:00100000:0.0:1789760787.630517:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725872998655 time 725890809341 state 0x0 ref 1 00000100:00100000:0.0:1789760787.630531:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.630580:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73691136, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23250 00010000:00010000:0.0:1789760787.630590:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.630606:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1789760787.630611:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.630617:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.630631:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.647363:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985299 is committed 00002000:00010000:3.0:1789760787.647536:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73691136 -> 73695232 00002000:00010000:3.0:1789760787.647541:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143952 -> 143960 00010000:00010000:3.0:1789760787.647554:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647567:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647577:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647587:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.647592:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647602:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647622:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.647630:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674eb01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73691136->73695231] (req 73691136->73695231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.648138:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17603us (17883us total) trans 4294985299 rc 0/0 00000100:00100000:3.0:1789760787.648149:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18002 00000100:00100000:3.0:1789760787.648158:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725872998655 time 725890809341 state 0x2 ref 0 00000100:00100000:0.0:1789760787.652785:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.653020:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533824 00000100:00100000:1.0:1789760787.653030:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533824 00000100:00100000:1.0:1789760787.653084:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725872998655 time 725890809341 state 0x0 ref 1 00000100:00100000:1.0:1789760787.653100:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725891069757 time 725890809341 state 0x1 ref 1 00000100:00100000:1.0:1789760787.653129:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725891069757 time 725913421528 state 0x0 ref 1 00000100:00100000:1.0:1789760787.653143:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.653187:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73695232, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23258 00010000:00010000:1.0:1789760787.653196:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.653213:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.653217:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.653224:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.653249:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.660609:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760787.661141:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985300 is committed 00002000:00010000:1.0:1789760787.661263:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73695232 -> 73699328 00002000:00010000:1.0:1789760787.661268:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143960 -> 143968 00010000:00010000:1.0:1789760787.661281:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661294:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661302:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661310:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.661315:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661324:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661343:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.661351:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73695232->73699327] (req 73695232->73699327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.661451:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565533824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8304us (8669us total) trans 4294985300 rc 0/0 00000100:00100000:1.0:1789760787.661463:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18003 00000100:00100000:1.0:1789760787.661473:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725891069757 time 725913421528 state 0x2 ref 0 00000100:00100000:2.0:1789760787.670345:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.670453:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565533952 00000100:00100000:1.0:1789760787.670463:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565533952 00000100:00100000:1.0:1789760787.670517:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725891069757 time 725913421528 state 0x0 ref 1 00000100:00100000:1.0:1789760787.670533:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725913681944 time 725913421528 state 0x1 ref 1 00000100:00100000:1.0:1789760787.670575:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725913681944 time 725930866371 state 0x0 ref 1 00000100:00100000:1.0:1789760787.670588:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565533952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.670636:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73699328, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23260 00010000:00010000:1.0:1789760787.670645:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.670669:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.670675:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.670681:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.670695:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.677382:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985301 is committed 00002000:00010000:1.0:1789760787.677899:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73699328 -> 73703424 00002000:00010000:1.0:1789760787.677906:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143968 -> 143976 00010000:00010000:1.0:1789760787.677921:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.677939:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.677949:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.677958:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.677963:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.677972:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.677993:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.678001:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73699328->73703423] (req 73699328->73703423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.678244:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565533952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7652us (7903us total) trans 4294985301 rc 0/0 00000100:00100000:1.0:1789760787.678256:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18004 00000100:00100000:1.0:1789760787.678267:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725913681944 time 725930866371 state 0x2 ref 0 00000100:00100000:2.0:1789760787.683210:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.683316:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534080 00000100:00100000:3.0:1789760787.683325:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534080 00000100:00100000:3.0:1789760787.683377:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725913681944 time 725930866371 state 0x0 ref 1 00000100:00100000:3.0:1789760787.683393:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725931126787 time 725930866371 state 0x1 ref 1 00000100:00100000:3.0:1789760787.683427:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725931126787 time 725943718790 state 0x0 ref 1 00000100:00100000:3.0:1789760787.683439:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.683483:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73703424, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23268 00010000:00010000:3.0:1789760787.683493:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.683508:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.683512:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.683518:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.683531:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.688938:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985302 is committed 00002000:00010000:0.0:1789760787.689070:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73703424 -> 73707520 00002000:00010000:0.0:1789760787.689075:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143976 -> 143984 00010000:00010000:0.0:1789760787.689091:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689105:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689114:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689121:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760787.689126:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689135:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689155:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.689163:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674eb16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73703424->73707519] (req 73703424->73707519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.689373:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5931us (6166us total) trans 4294985302 rc 0/0 00000100:00100000:0.0:1789760787.689386:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18005 00000100:00100000:0.0:1789760787.689394:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725931126787 time 725943718790 state 0x2 ref 0 00000100:00100000:0.0:1789760787.699221:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.699435:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534208 00000100:00100000:1.0:1789760787.699446:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534208 00000100:00100000:1.0:1789760787.699504:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725931126787 time 725943718790 state 0x0 ref 1 00000100:00100000:1.0:1789760787.699520:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725943979206 time 725943718790 state 0x1 ref 1 00000100:00100000:1.0:1789760787.699555:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725943979206 time 725959846538 state 0x0 ref 1 00000100:00100000:1.0:1789760787.699568:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.699694:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73707520, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23270 00010000:00010000:1.0:1789760787.699857:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.699874:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.699879:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.699885:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.699898:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.711103:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985303 is committed 00002000:00010000:2.0:1789760787.711359:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73707520 -> 73711616 00002000:00010000:2.0:1789760787.711364:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143984 -> 143992 00010000:00010000:2.0:1789760787.711376:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711389:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711398:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711405:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.711409:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711418:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711437:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.711445:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674eb1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73707520->73711615] (req 73707520->73711615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.711602:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12030us (12384us total) trans 4294985303 rc 0/0 00000100:00100000:2.0:1789760787.711613:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18006 00000100:00100000:2.0:1789760787.711623:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725943979206 time 725959846538 state 0x2 ref 0 00000100:00100000:2.0:1789760787.716497:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.716654:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534336 00000100:00100000:1.0:1789760787.716672:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534336 00000100:00100000:1.0:1789760787.716834:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725943979206 time 725959846538 state 0x0 ref 1 00000100:00100000:1.0:1789760787.716850:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725960106954 time 725959846538 state 0x1 ref 1 00000100:00100000:1.0:1789760787.716919:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725960106954 time 725977210534 state 0x0 ref 1 00000100:00100000:1.0:1789760787.716931:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.716972:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73711616, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23278 00010000:00010000:1.0:1789760787.716979:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.716993:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1789760787.716996:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.717000:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.717020:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.722837:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985304 is committed 00002000:00010000:1.0:1789760787.723479:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73711616 -> 73715712 00002000:00010000:1.0:1789760787.723485:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143992 -> 144000 00010000:00010000:1.0:1789760787.723499:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723513:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723522:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723529:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.723534:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723543:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723561:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.723569:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73711616->73715711] (req 73711616->73715711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.724588:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7650us (8094us total) trans 4294985304 rc 0/0 00000100:00100000:1.0:1789760787.724608:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18007 00000100:00100000:1.0:1789760787.724618:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725960106954 time 725977210534 state 0x2 ref 0 00000100:00100000:1.0:1789760787.731091:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760787.731114:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e7f1d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580068096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760787.731181:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760787.731425:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068096 00000100:00100000:2.0:1789760787.731435:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068096 00000100:00100000:2.0:1789760787.731498:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760787.731508:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580068096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760787.731530:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3850452992 avail 3615346688 00000100:00100000:2.0:1789760787.731577:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580068096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760787.731583:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760787.731643:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e7f1d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580068096:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760787.731840:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760787.732055:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.732180:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534464 00000100:00100000:3.0:1789760787.732186:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534464 00000100:00100000:3.0:1789760787.732222:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725960106954 time 725977210534 state 0x0 ref 1 00000100:00100000:3.0:1789760787.732246:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725977470950 time 725977210534 state 0x1 ref 1 00000100:00100000:3.0:1789760787.732263:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725977470950 time 725992555786 state 0x0 ref 1 00000100:00100000:3.0:1789760787.732273:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.732313:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73715712, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23280 00010000:00010000:3.0:1789760787.732323:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.732339:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1789760787.732343:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.732350:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.732364:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.740545:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985305 is committed 00002000:00010000:2.0:1789760787.743482:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73715712 -> 73719808 00002000:00010000:2.0:1789760787.743493:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144000 -> 144008 00010000:00010000:2.0:1789760787.743507:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743519:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743528:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743535:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.743539:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743553:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743575:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.743582:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674eb2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73715712->73719807] (req 73715712->73719807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.743880:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11602us (11822us total) trans 4294985305 rc 0/0 00000100:00100000:2.0:1789760787.743890:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18008 00000100:00100000:2.0:1789760787.743900:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725977470950 time 725992555786 state 0x2 ref 0 00000100:00100000:0.0:1789760787.755082:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.756289:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534592 00000100:00100000:2.0:1789760787.757457:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534592 00000100:00100000:2.0:1789760787.757527:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725977470950 time 725992555786 state 0x0 ref 1 00000100:00100000:2.0:1789760787.757543:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725992816202 time 725992555786 state 0x1 ref 1 00000100:00100000:2.0:1789760787.757629:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725992816202 time 726017921106 state 0x0 ref 1 00000100:00100000:2.0:1789760787.757654:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.757747:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73719808, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23288 00010000:00010000:2.0:1789760787.757766:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.757783:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760787.757788:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.757795:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.757809:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.762097:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985306 is committed 00002000:00010000:2.0:1789760787.766411:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73719808 -> 73723904 00002000:00010000:2.0:1789760787.766422:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144008 -> 144016 00010000:00010000:2.0:1789760787.766437:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766450:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766461:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766469:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.766474:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766483:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766510:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.766518:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73719808->73723903] (req 73719808->73723903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.766616:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8971us (11538us total) trans 4294985306 rc 0/0 00000100:00100000:2.0:1789760787.766627:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18009 00000100:00100000:2.0:1789760787.766636:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725992816202 time 726017921106 state 0x2 ref 0 00000100:00100000:0.0:1789760787.774122:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.774214:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534720 00000100:00100000:1.0:1789760787.774225:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534720 00000100:00100000:1.0:1789760787.774281:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 725992816202 time 726017921106 state 0x0 ref 1 00000100:00100000:1.0:1789760787.774302:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726018181522 time 726017921106 state 0x1 ref 1 00000100:00100000:1.0:1789760787.774331:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726018181522 time 726034623299 state 0x0 ref 1 00000100:00100000:1.0:1789760787.774344:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.774397:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73723904, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23290 00010000:00010000:1.0:1789760787.774406:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.774420:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760787.774424:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.774430:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.774445:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.780979:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985307 is committed 00002000:00010000:1.0:1789760787.781152:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73723904 -> 73728000 00002000:00010000:1.0:1789760787.781158:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144016 -> 144024 00010000:00010000:1.0:1789760787.781175:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781190:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781200:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781213:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.781219:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781228:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781252:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.781260:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73723904->73727999] (req 73723904->73727999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.781388:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7038us (7266us total) trans 4294985307 rc 0/0 00000100:00100000:1.0:1789760787.781402:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18010 00000100:00100000:1.0:1789760787.781416:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726018181522 time 726034623299 state 0x2 ref 0 00000100:00100000:0.0:1789760787.786326:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.786519:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534848 00000100:00100000:2.0:1789760787.786534:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534848 00000100:00100000:2.0:1789760787.786600:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726018181522 time 726034623299 state 0x0 ref 1 00000100:00100000:2.0:1789760787.786617:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726034883715 time 726034623299 state 0x1 ref 1 00000100:00100000:2.0:1789760787.786650:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726034883715 time 726046942118 state 0x0 ref 1 00000100:00100000:2.0:1789760787.786675:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.786762:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73728000, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x23298 00010000:00010000:2.0:1789760787.786772:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.786787:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760787.786792:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.786799:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.786813:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.791339:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985308 is committed 00002000:00010000:2.0:1789760787.791476:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73728000 -> 73732096 00002000:00010000:2.0:1789760787.791485:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144024 -> 144032 00010000:00010000:2.0:1789760787.791498:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791511:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791520:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791527:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.791531:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791539:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791558:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.791570:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73728000->73732095] (req 73728000->73732095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.791771:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565534848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5096us (5465us total) trans 4294985308 rc 0/0 00000100:00100000:2.0:1789760787.791780:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18011 00000100:00100000:2.0:1789760787.791791:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726034883715 time 726046942118 state 0x2 ref 0 00000100:00100000:0.0:1789760787.801827:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.801956:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565534976 00000100:00100000:2.0:1789760787.801966:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565534976 00000100:00100000:2.0:1789760787.802031:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726034883715 time 726046942118 state 0x0 ref 1 00000100:00100000:2.0:1789760787.802045:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726047202534 time 726046942118 state 0x1 ref 1 00000100:00100000:2.0:1789760787.802074:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726047202534 time 726062366163 state 0x0 ref 1 00000100:00100000:2.0:1789760787.802089:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.802139:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73732096, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232a0 00010000:00010000:2.0:1789760787.802148:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.802165:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760787.802169:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.802175:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.802193:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760787.806307:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985309 is committed 00002000:00010000:2.0:1789760787.806458:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73732096 -> 73736192 00002000:00010000:2.0:1789760787.806468:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144032 -> 144040 00010000:00010000:2.0:1789760787.806481:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806495:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806505:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806513:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.806518:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806528:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806549:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.806557:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73732096->73736191] (req 73732096->73736191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.807277:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565534976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5184us (5456us total) trans 4294985309 rc 0/0 00000100:00100000:2.0:1789760787.807289:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18012 00000100:00100000:2.0:1789760787.807298:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726047202534 time 726062366163 state 0x2 ref 0 00000100:00100000:0.0:1789760787.817346:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.818863:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535104 00000100:00100000:1.0:1789760787.818883:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535104 00000100:00100000:1.0:1789760787.818992:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726047202534 time 726062366163 state 0x0 ref 1 00000100:00100000:1.0:1789760787.819011:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726062626579 time 726062366163 state 0x1 ref 1 00000100:00100000:1.0:1789760787.819063:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726062626579 time 726079353792 state 0x0 ref 1 00000100:00100000:1.0:1789760787.819079:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.819149:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73736192, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232a8 00010000:00010000:1.0:1789760787.819162:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.819182:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760787.819188:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.819196:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.819212:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.824871:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985310 is committed 00002000:00010000:1.0:1789760787.825069:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73736192 -> 73740288 00002000:00010000:1.0:1789760787.825076:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144040 -> 144048 00010000:00010000:1.0:1789760787.825093:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825109:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825120:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825135:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.825141:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825150:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825176:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.825185:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73736192->73740287] (req 73736192->73740287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.825368:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6285us (8024us total) trans 4294985310 rc 0/0 00000100:00100000:1.0:1789760787.825381:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18013 00000100:00100000:1.0:1789760787.825392:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726062626579 time 726079353792 state 0x2 ref 0 00000100:00100000:0.0:1789760787.836177:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760787.836494:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535232 00000100:00100000:2.0:1789760787.836508:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535232 00000100:00100000:2.0:1789760787.836578:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726062626579 time 726079353792 state 0x0 ref 1 00000100:00100000:2.0:1789760787.836596:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726079614208 time 726079353792 state 0x1 ref 1 00000100:00100000:2.0:1789760787.836635:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726079614208 time 726096926472 state 0x0 ref 1 00000100:00100000:2.0:1789760787.836648:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565535232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760787.836852:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73740288, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232b0 00010000:00010000:2.0:1789760787.836865:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.836884:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760787.836890:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.836897:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.836912:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760787.846407:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985311 is committed 00002000:00010000:2.0:1789760787.846671:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73740288 -> 73744384 00002000:00010000:2.0:1789760787.846677:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144048 -> 144056 00010000:00010000:2.0:1789760787.846695:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846730:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846740:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846749:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.846754:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846764:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846790:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.846799:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674eb55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73740288->73744383] (req 73740288->73744383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.846929:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565535232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10276us (10760us total) trans 4294985311 rc 0/0 00000100:00100000:2.0:1789760787.846943:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18014 00000100:00100000:2.0:1789760787.846955:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726079614208 time 726096926472 state 0x2 ref 0 00000100:00100000:1.0:1789760787.853261:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.853430:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535360 00000100:00100000:3.0:1789760787.853441:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535360 00000100:00100000:3.0:1789760787.853499:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726079614208 time 726096926472 state 0x0 ref 1 00000100:00100000:3.0:1789760787.853513:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726097186888 time 726096926472 state 0x1 ref 1 00000100:00100000:3.0:1789760787.853544:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726097186888 time 726113836450 state 0x0 ref 1 00000100:00100000:0.0:1789760787.857490:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760787.858145:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73744384, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232b8 00010000:00010000:0.0:1789760787.858160:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.858180:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760787.858185:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.858194:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.858213:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.867333:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985312 is committed 00002000:00010000:2.0:1789760787.867775:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73744384 -> 73748480 00002000:00010000:2.0:1789760787.867787:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144056 -> 144064 00010000:00010000:2.0:1789760787.867806:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867822:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867832:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867841:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760787.867847:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867857:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867883:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.867891:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674eb5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73744384->73748479] (req 73744384->73748479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760787.869206:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15631us (15945us total) trans 4294985312 rc 0/0 00000100:00100000:2.0:1789760787.869225:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18015 00000100:00100000:2.0:1789760787.869237:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726097186888 time 726113836450 state 0x2 ref 0 00000100:00100000:0.0:1789760787.876838:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.877133:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535488 00000100:00100000:1.0:1789760787.877149:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535488 00000100:00100000:1.0:1789760787.877214:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726097186888 time 726113836450 state 0x0 ref 1 00000100:00100000:1.0:1789760787.879130:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726114096866 time 726113836450 state 0x1 ref 1 00000100:00100000:1.0:1789760787.879184:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726114096866 time 726139475430 state 0x0 ref 1 00000100:00100000:1.0:1789760787.879208:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565535488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.879274:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73748480, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232c0 00010000:00010000:1.0:1789760787.879284:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.879300:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760787.879305:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.879312:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.879326:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.889969:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985313 is committed 00002000:00010000:1.0:1789760787.890357:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73748480 -> 73752576 00002000:00010000:1.0:1789760787.890362:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144064 -> 144072 00010000:00010000:1.0:1789760787.890377:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890390:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890399:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890406:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.890412:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890421:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890440:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.890448:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73748480->73752575] (req 73748480->73752575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.890541:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565535488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11341us (13712us total) trans 4294985313 rc 0/0 00000100:00100000:1.0:1789760787.890552:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18016 00000100:00100000:1.0:1789760787.890563:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726114096866 time 726139475430 state 0x2 ref 0 00000100:00100000:0.0:1789760787.899751:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.899837:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535616 00000100:00100000:3.0:1789760787.899846:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535616 00000100:00100000:3.0:1789760787.899903:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726114096866 time 726139475430 state 0x0 ref 1 00000100:00100000:3.0:1789760787.899918:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726139735846 time 726139475430 state 0x1 ref 1 00000100:00100000:3.0:1789760787.899940:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726139735846 time 726160232186 state 0x0 ref 1 00000100:00100000:3.0:1789760787.899951:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565535616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.899996:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73752576, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232c8 00010000:00010000:3.0:1789760787.900011:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.900027:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760787.900031:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.900037:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.900051:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.907316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985314 is committed 00002000:00010000:3.0:1789760787.907605:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73752576 -> 73756672 00002000:00010000:3.0:1789760787.907611:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144072 -> 144080 00010000:00010000:3.0:1789760787.907624:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907638:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907647:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907672:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.907677:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907687:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907747:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.907755:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eb6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73752576->73756671] (req 73752576->73756671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.907841:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565535616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7888us (8095us total) trans 4294985314 rc 0/0 00000100:00100000:3.0:1789760787.907852:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18017 00000100:00100000:3.0:1789760787.907861:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726139735846 time 726160232186 state 0x2 ref 0 00000100:00100000:0.0:1789760787.914432:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.914525:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535744 00000100:00100000:3.0:1789760787.914535:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535744 00000100:00100000:3.0:1789760787.914589:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726139735846 time 726160232186 state 0x0 ref 1 00000100:00100000:3.0:1789760787.914603:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726160492602 time 726160232186 state 0x1 ref 1 00000100:00100000:3.0:1789760787.914638:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726160492602 time 726174929467 state 0x0 ref 1 00000100:00100000:3.0:1789760787.914670:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565535744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.914752:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73756672, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232d0 00010000:00010000:3.0:1789760787.914761:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.914777:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760787.914781:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.914787:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.914802:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.919477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985315 is committed 00002000:00010000:3.0:1789760787.919681:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73756672 -> 73760768 00002000:00010000:3.0:1789760787.919686:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144080 -> 144088 00010000:00010000:3.0:1789760787.919699:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919846:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919856:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919864:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.919869:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919878:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919899:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.919907:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73756672->73760767] (req 73756672->73760767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.920036:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565535744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5379us (5610us total) trans 4294985315 rc 0/0 00000100:00100000:3.0:1789760787.920047:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18018 00000100:00100000:3.0:1789760787.920057:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726160492602 time 726174929467 state 0x2 ref 0 00000100:00100000:0.0:1789760787.926933:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.929776:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565535872 00000100:00100000:1.0:1789760787.929791:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565535872 00000100:00100000:1.0:1789760787.929853:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726160492602 time 726174929467 state 0x0 ref 1 00000100:00100000:1.0:1789760787.929870:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726175189883 time 726174929467 state 0x1 ref 1 00000100:00100000:1.0:1789760787.929909:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726175189883 time 726190201601 state 0x0 ref 1 00000100:00100000:1.0:1789760787.929923:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.929973:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73760768, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232d8 00010000:00010000:1.0:1789760787.929983:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.929998:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760787.930003:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.930009:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.930023:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.934981:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985316 is committed 00002000:00010000:1.0:1789760787.935103:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73760768 -> 73764864 00002000:00010000:1.0:1789760787.935108:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144088 -> 144096 00010000:00010000:1.0:1789760787.935120:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935133:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935142:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935150:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.935155:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935164:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935184:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.935191:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73760768->73764863] (req 73760768->73764863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.935284:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565535872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5359us (8355us total) trans 4294985316 rc 0/0 00000100:00100000:1.0:1789760787.935294:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18019 00000100:00100000:1.0:1789760787.935304:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726175189883 time 726190201601 state 0x2 ref 0 00000100:00100000:0.0:1789760787.948179:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.948380:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536000 00000100:00100000:3.0:1789760787.948389:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536000 00000100:00100000:3.0:1789760787.948448:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726175189883 time 726190201601 state 0x0 ref 1 00000100:00100000:3.0:1789760787.948464:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726190462017 time 726190201601 state 0x1 ref 1 00000100:00100000:3.0:1789760787.948499:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726190462017 time 726208791393 state 0x0 ref 1 00000100:00100000:3.0:1789760787.948512:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.948560:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73764864, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0x232e0 00010000:00010000:3.0:1789760787.948570:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.948587:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760787.948592:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.948598:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.948610:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.960441:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985317 is committed 00002000:00010000:3.0:1789760787.960570:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73764864 -> 73768960 00002000:00010000:3.0:1789760787.960574:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760787 -> 1789760788 00002000:00010000:3.0:1789760787.960577:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760787 -> 1789760788 00002000:00010000:3.0:1789760787.960579:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144096 -> 144104 00010000:00010000:3.0:1789760787.960592:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960605:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960613:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960620:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.960625:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960637:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960665:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.960673:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73764864->73768959] (req 73764864->73768959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.960808:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12294us (12634us total) trans 4294985317 rc 0/0 00000100:00100000:3.0:1789760787.960820:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18020 00000100:00100000:3.0:1789760787.960830:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726190462017 time 726208791393 state 0x2 ref 0 00000100:00100000:1.0:1789760787.970813:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760787.970951:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536128 00000100:00100000:3.0:1789760787.970960:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536128 00000100:00100000:3.0:1789760787.971011:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726190462017 time 726208791393 state 0x0 ref 1 00000100:00100000:3.0:1789760787.971026:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726209051809 time 726208791393 state 0x1 ref 1 00000100:00100000:3.0:1789760787.971058:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726209051809 time 726231349593 state 0x0 ref 1 00000100:00100000:3.0:1789760787.971072:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760787.971118:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73768960, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x232e8 00010000:00010000:3.0:1789760787.971128:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.971143:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760787.971148:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760787.971154:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.971166:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.978075:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985318 is committed 00002000:00010000:3.0:1789760787.978193:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73768960 -> 73773056 00002000:00010000:3.0:1789760787.978198:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144104 -> 144112 00010000:00010000:3.0:1789760787.978210:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978222:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978230:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978237:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760787.978242:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978250:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978274:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760787.978282:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73768960->73773055] (req 73768960->73773055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760787.978376:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7302us (7569us total) trans 4294985318 rc 0/0 00000100:00100000:3.0:1789760787.978385:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18021 00000100:00100000:3.0:1789760787.978395:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726209051809 time 726231349593 state 0x2 ref 0 00000100:00100000:2.0:1789760787.986364:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760787.986465:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536256 00000100:00100000:1.0:1789760787.986475:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536256 00000100:00100000:1.0:1789760787.986528:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726209051809 time 726231349593 state 0x0 ref 1 00000100:00100000:1.0:1789760787.986545:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726231610009 time 726231349593 state 0x1 ref 1 00000100:00100000:1.0:1789760787.986574:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726231610009 time 726246866237 state 0x0 ref 1 00000100:00100000:1.0:1789760787.986586:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760787.986630:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73773056, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x232f0 00010000:00010000:1.0:1789760787.986639:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.986676:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760787.986681:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.986687:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.986700:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760787.994031:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985319 is committed 00002000:00010000:1.0:1789760787.994167:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73773056 -> 73777152 00002000:00010000:1.0:1789760787.994173:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144112 -> 144120 00010000:00010000:1.0:1789760787.994185:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994197:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994205:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994213:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760787.994217:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994225:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994250:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.994258:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674eb8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73773056->73777151] (req 73773056->73777151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.994356:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7765us (7994us total) trans 4294985319 rc 0/0 00000100:00100000:1.0:1789760787.994366:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18022 00000100:00100000:1.0:1789760787.994375:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726231610009 time 726246866237 state 0x2 ref 0 00000100:00100000:1.0:1789760788.000291:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760788.000373:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536384 00000100:00100000:3.0:1789760788.000382:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536384 00000100:00100000:3.0:1789760788.000434:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726231610009 time 726246866237 state 0x0 ref 1 00000100:00100000:3.0:1789760788.000448:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726247126653 time 726246866237 state 0x1 ref 1 00000100:00100000:3.0:1789760788.000480:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726247126653 time 726260771838 state 0x0 ref 1 00000100:00100000:3.0:1789760788.000491:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760788.000534:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73777152, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x232f8 00010000:00010000:3.0:1789760788.000543:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.000559:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760788.000565:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760788.000571:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.000584:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.005359:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985320 is committed 00002000:00010000:2.0:1789760788.005556:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73777152 -> 73781248 00002000:00010000:2.0:1789760788.005561:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144120 -> 144128 00010000:00010000:2.0:1789760788.005575:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005587:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005597:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005605:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.005610:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005618:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005638:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.005666:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674eb94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73777152->73781247] (req 73777152->73781247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.005804:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5310us (5525us total) trans 4294985320 rc 0/0 00000100:00100000:2.0:1789760788.005816:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18023 00000100:00100000:2.0:1789760788.005825:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726247126653 time 726260771838 state 0x2 ref 0 00000100:00100000:0.0:1789760788.015973:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760788.016113:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536512 00000100:00100000:3.0:1789760788.016123:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536512 00000100:00100000:3.0:1789760788.016201:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726247126653 time 726260771838 state 0x0 ref 1 00000100:00100000:3.0:1789760788.016216:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726261032254 time 726260771838 state 0x1 ref 1 00000100:00100000:3.0:1789760788.016249:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726261032254 time 726276540861 state 0x0 ref 1 00000100:00100000:3.0:1789760788.016263:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760788.016308:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73781248, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23300 00010000:00010000:3.0:1789760788.016316:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.016332:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760788.016336:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760788.016342:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.016355:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760788.017068:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760788.021522:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985321 is committed 00002000:00010000:2.0:1789760788.021945:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73781248 -> 73785344 00002000:00010000:2.0:1789760788.021950:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144128 -> 144136 00010000:00010000:2.0:1789760788.021965:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.021979:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.021987:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.021994:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.022058:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.022069:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.022093:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.022100:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eb9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73781248->73785343] (req 73781248->73785343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.022231:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565536512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5965us (6261us total) trans 4294985321 rc 0/0 00000100:00100000:2.0:1789760788.022242:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18024 00000100:00100000:2.0:1789760788.022252:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726261032254 time 726276540861 state 0x2 ref 0 00000100:00100000:3.0:1789760788.026347:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.026458:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536640 00000100:00100000:1.0:1789760788.026467:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536640 00000100:00100000:1.0:1789760788.026519:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726261032254 time 726276540861 state 0x0 ref 1 00000100:00100000:1.0:1789760788.026533:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726276801277 time 726276540861 state 0x1 ref 1 00000100:00100000:1.0:1789760788.026617:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726276801277 time 726286908406 state 0x0 ref 1 00000100:00100000:1.0:1789760788.026629:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.026686:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73785344, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23308 00010000:00010000:1.0:1789760788.026696:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.026757:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.026761:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.026767:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.026782:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.039930:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985322 is committed 00002000:00010000:1.0:1789760788.040069:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73785344 -> 73789440 00002000:00010000:1.0:1789760788.040074:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144136 -> 144144 00010000:00010000:1.0:1789760788.040089:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040102:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040111:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040119:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.040124:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040132:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040158:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.040166:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674eba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73785344->73789439] (req 73785344->73789439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.040299:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13665us (13956us total) trans 4294985322 rc 0/0 00000100:00100000:1.0:1789760788.040311:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18025 00000100:00100000:1.0:1789760788.040321:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726276801277 time 726286908406 state 0x2 ref 0 00000100:00100000:1.0:1789760788.046357:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.046845:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536768 00000100:00100000:2.0:1789760788.046855:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536768 00000100:00100000:2.0:1789760788.046921:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726276801277 time 726286908406 state 0x0 ref 1 00000100:00100000:2.0:1789760788.046937:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726287168822 time 726286908406 state 0x1 ref 1 00000100:00100000:2.0:1789760788.046970:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726287168822 time 726307261390 state 0x0 ref 1 00000100:00100000:2.0:1789760788.046982:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.047038:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73789440, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23310 00010000:00010000:2.0:1789760788.047047:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.047063:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.047068:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.047075:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.047089:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.052021:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985323 is committed 00002000:00010000:2.0:1789760788.052166:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73789440 -> 73793536 00002000:00010000:2.0:1789760788.052172:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144144 -> 144152 00010000:00010000:2.0:1789760788.052185:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052197:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052206:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052214:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.052218:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052227:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052245:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.052257:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674eba9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73789440->73793535] (req 73789440->73793535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.052347:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5363us (5995us total) trans 4294985323 rc 0/0 00000100:00100000:2.0:1789760788.052358:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18026 00000100:00100000:2.0:1789760788.052368:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726287168822 time 726307261390 state 0x2 ref 0 00000100:00100000:1.0:1789760788.060995:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.061082:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565536896 00000100:00100000:2.0:1789760788.061092:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565536896 00000100:00100000:2.0:1789760788.061145:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726287168822 time 726307261390 state 0x0 ref 1 00000100:00100000:2.0:1789760788.061160:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726307521806 time 726307261390 state 0x1 ref 1 00000100:00100000:2.0:1789760788.061194:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726307521806 time 726321485823 state 0x0 ref 1 00000100:00100000:2.0:1789760788.061207:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.061254:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73793536, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23318 00010000:00010000:2.0:1789760788.061265:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.061280:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.061285:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.061291:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.061311:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.065877:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985324 is committed 00002000:00010000:2.0:1789760788.065994:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73793536 -> 73797632 00002000:00010000:2.0:1789760788.066010:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144152 -> 144160 00010000:00010000:2.0:1789760788.066024:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066036:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066044:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066052:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.066058:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066067:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066088:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.066096:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73793536->73797631] (req 73793536->73797631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.066195:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565536896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4986us (5205us total) trans 4294985324 rc 0/0 00000100:00100000:2.0:1789760788.066205:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18027 00000100:00100000:2.0:1789760788.066215:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726307521806 time 726321485823 state 0x2 ref 0 00000100:00100000:3.0:1789760788.078841:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.079000:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537024 00000100:00100000:1.0:1789760788.079020:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537024 00000100:00100000:1.0:1789760788.079079:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726307521806 time 726321485823 state 0x0 ref 1 00000100:00100000:1.0:1789760788.079095:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726321746239 time 726321485823 state 0x1 ref 1 00000100:00100000:1.0:1789760788.079133:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726321746239 time 726339424600 state 0x0 ref 1 00000100:00100000:1.0:1789760788.079147:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.079199:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73797632, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23320 00010000:00010000:1.0:1789760788.079210:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.079232:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.079236:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.079243:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.079256:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.083441:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985325 is committed 00002000:00010000:1.0:1789760788.083562:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73797632 -> 73801728 00002000:00010000:1.0:1789760788.083568:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144160 -> 144168 00010000:00010000:1.0:1789760788.083582:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083667:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083678:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083686:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.083691:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083700:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083760:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.083768:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674ebb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73797632->73801727] (req 73797632->73801727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.084796:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5643us (5957us total) trans 4294985325 rc 0/0 00000100:00100000:1.0:1789760788.084811:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18028 00000100:00100000:1.0:1789760788.084820:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726321746239 time 726339424600 state 0x2 ref 0 00000100:00100000:1.0:1789760788.092585:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.092755:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537152 00000100:00100000:2.0:1789760788.092764:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537152 00000100:00100000:2.0:1789760788.092815:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726321746239 time 726339424600 state 0x0 ref 1 00000100:00100000:2.0:1789760788.092831:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726339685016 time 726339424600 state 0x1 ref 1 00000100:00100000:2.0:1789760788.092860:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726339685016 time 726353152384 state 0x0 ref 1 00000100:00100000:2.0:1789760788.092871:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.092917:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73801728, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23328 00010000:00010000:2.0:1789760788.092926:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.092943:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.092947:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.092954:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.092967:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.097960:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985326 is committed 00002000:00010000:2.0:1789760788.098121:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73801728 -> 73805824 00002000:00010000:2.0:1789760788.098127:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144168 -> 144176 00010000:00010000:2.0:1789760788.098140:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098153:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098161:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098168:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.098173:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098181:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098201:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.098209:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73801728->73805823] (req 73801728->73805823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.098300:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5426us (5722us total) trans 4294985326 rc 0/0 00000100:00100000:2.0:1789760788.098312:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18029 00000100:00100000:2.0:1789760788.098322:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726339685016 time 726353152384 state 0x2 ref 0 00000100:00100000:1.0:1789760788.103554:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.103632:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537280 00000100:00100000:2.0:1789760788.103641:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537280 00000100:00100000:2.0:1789760788.103745:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726339685016 time 726353152384 state 0x0 ref 1 00000100:00100000:2.0:1789760788.103762:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726353412800 time 726353152384 state 0x1 ref 1 00000100:00100000:2.0:1789760788.103791:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726353412800 time 726364083718 state 0x0 ref 1 00000100:00100000:2.0:1789760788.103803:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.103851:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73805824, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23330 00010000:00010000:2.0:1789760788.103859:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.103876:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.103880:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.103887:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.103901:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.107649:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985327 is committed 00002000:00010000:2.0:1789760788.107911:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73805824 -> 73809920 00002000:00010000:2.0:1789760788.107916:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144176 -> 144184 00010000:00010000:2.0:1789760788.107929:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.107941:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.107951:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.107958:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.107963:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.107972:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.107991:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.108004:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ebc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73805824->73809919] (req 73805824->73809919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.108090:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4285us (4541us total) trans 4294985327 rc 0/0 00000100:00100000:2.0:1789760788.108098:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18030 00000100:00100000:2.0:1789760788.108106:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726353412800 time 726364083718 state 0x2 ref 0 00000100:00100000:3.0:1789760788.111422:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.111498:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537408 00000100:00100000:1.0:1789760788.111506:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537408 00000100:00100000:1.0:1789760788.111556:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726353412800 time 726364083718 state 0x0 ref 1 00000100:00100000:1.0:1789760788.111570:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726364344134 time 726364083718 state 0x1 ref 1 00000100:00100000:1.0:1789760788.111607:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726364344134 time 726371899524 state 0x0 ref 1 00000100:00100000:1.0:1789760788.111618:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565537408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.111668:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73809920, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23338 00010000:00010000:1.0:1789760788.111678:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.111698:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.111728:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.111736:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.111750:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.117467:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985328 is committed 00002000:00010000:1.0:1789760788.117851:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73809920 -> 73814016 00002000:00010000:1.0:1789760788.117856:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144184 -> 144192 00010000:00010000:1.0:1789760788.117869:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117882:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117891:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117898:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.117903:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117912:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117935:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.117943:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674ebcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73809920->73814015] (req 73809920->73814015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.118809:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565537408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7183us (7386us total) trans 4294985328 rc 0/0 00000100:00100000:1.0:1789760788.118822:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18031 00000100:00100000:1.0:1789760788.118831:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726364344134 time 726371899524 state 0x2 ref 0 00000100:00100000:1.0:1789760788.122381:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.122478:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537536 00000100:00100000:2.0:1789760788.122487:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537536 00000100:00100000:2.0:1789760788.122539:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726364344134 time 726371899524 state 0x0 ref 1 00000100:00100000:2.0:1789760788.122553:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726372159940 time 726371899524 state 0x1 ref 1 00000100:00100000:2.0:1789760788.122617:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726372159940 time 726382909346 state 0x0 ref 1 00000100:00100000:2.0:1789760788.122629:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.122686:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73814016, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23340 00010000:00010000:2.0:1789760788.122696:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.122752:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.122757:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.122763:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.122776:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.126291:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985329 is committed 00002000:00010000:3.0:1789760788.126400:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73814016 -> 73818112 00002000:00010000:3.0:1789760788.126405:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144192 -> 144200 00010000:00010000:3.0:1789760788.126417:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126428:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126437:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126444:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760788.126449:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126457:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126475:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.126482:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ebd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73814016->73818111] (req 73814016->73818111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760788.126571:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 3939us (4195us total) trans 4294985329 rc 0/0 00000100:00100000:3.0:1789760788.126580:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18032 00000100:00100000:3.0:1789760788.126588:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726372159940 time 726382909346 state 0x2 ref 0 00000100:00100000:2.0:1789760788.130780:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.130886:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537664 00000100:00100000:0.0:1789760788.130896:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537664 00000100:00100000:0.0:1789760788.130946:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726372159940 time 726382909346 state 0x0 ref 1 00000100:00100000:0.0:1789760788.130960:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726383169762 time 726382909346 state 0x1 ref 1 00000100:00100000:0.0:1789760788.130991:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726383169762 time 726391283377 state 0x0 ref 1 00000100:00100000:0.0:1789760788.131013:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.131057:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73818112, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23348 00010000:00010000:0.0:1789760788.131066:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.131086:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.131090:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.131096:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.131110:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.134461:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985330 is committed 00002000:00010000:0.0:1789760788.134674:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73818112 -> 73822208 00002000:00010000:0.0:1789760788.134680:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144200 -> 144208 00010000:00010000:0.0:1789760788.134693:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134731:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134741:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134749:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.134754:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134763:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134790:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.134799:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73818112->73822207] (req 73818112->73822207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.134939:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 3924us (4163us total) trans 4294985330 rc 0/0 00000100:00100000:0.0:1789760788.134950:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18033 00000100:00100000:0.0:1789760788.134959:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726383169762 time 726391283377 state 0x2 ref 0 00000100:00100000:2.0:1789760788.139115:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.139217:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537792 00000100:00100000:1.0:1789760788.139227:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537792 00000100:00100000:1.0:1789760788.139278:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726383169762 time 726391283377 state 0x0 ref 1 00000100:00100000:1.0:1789760788.139292:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726391543793 time 726391283377 state 0x1 ref 1 00000100:00100000:1.0:1789760788.139358:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726391543793 time 726399649630 state 0x0 ref 1 00000100:00100000:1.0:1789760788.139371:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.139423:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73822208, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23350 00010000:00010000:1.0:1789760788.139433:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.139453:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.139457:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.139462:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.139476:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760788.150096:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985331 is committed 00002000:00010000:1.0:1789760788.150234:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73822208 -> 73826304 00002000:00010000:1.0:1789760788.150239:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144208 -> 144216 00010000:00010000:1.0:1789760788.150252:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150263:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150272:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150279:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.150284:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150292:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150316:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.150324:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674ebe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73822208->73826303] (req 73822208->73826303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.150468:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565537792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11093us (11357us total) trans 4294985331 rc 0/0 00000100:00100000:1.0:1789760788.150478:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18034 00000100:00100000:1.0:1789760788.150488:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726391543793 time 726399649630 state 0x2 ref 0 00000100:00100000:1.0:1789760788.162045:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760788.162109:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565537920 00000100:00100000:3.0:1789760788.162117:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565537920 00000100:00100000:3.0:1789760788.162166:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726391543793 time 726399649630 state 0x0 ref 1 00000100:00100000:3.0:1789760788.162180:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726399910046 time 726399649630 state 0x1 ref 1 00000100:00100000:3.0:1789760788.162206:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726399910046 time 726422498225 state 0x0 ref 1 00000100:00100000:3.0:1789760788.162216:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760788.162257:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73826304, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23358 00010000:00010000:3.0:1789760788.162266:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.162282:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1789760788.162286:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760788.162292:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.162305:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760788.167625:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985332 is committed 00002000:00010000:0.0:1789760788.171276:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73826304 -> 73830400 00002000:00010000:0.0:1789760788.171284:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144216 -> 144224 00010000:00010000:0.0:1789760788.171298:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171311:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171320:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171327:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.171332:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171347:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171367:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.171375:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ebe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73826304->73830399] (req 73826304->73830399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.171474:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565537920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9253us (9433us total) trans 4294985332 rc 0/0 00000100:00100000:0.0:1789760788.171484:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18035 00000100:00100000:0.0:1789760788.171493:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726399910046 time 726422498225 state 0x2 ref 0 00000100:00100000:2.0:1789760788.180180:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.180868:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538048 00000100:00100000:0.0:1789760788.180877:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538048 00000100:00100000:0.0:1789760788.180929:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726399910046 time 726422498225 state 0x0 ref 1 00000100:00100000:0.0:1789760788.181087:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726422758641 time 726422498225 state 0x1 ref 1 00000100:00100000:2.0:1789760788.181154:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726422758641 time 726441443198 state 0x0 ref 1 00000100:00100000:2.0:1789760788.181174:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.181220:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73830400, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23360 00010000:00010000:2.0:1789760788.181229:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.181244:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.181249:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.181255:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.181270:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760788.186226:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985333 is committed 00002000:00010000:2.0:1789760788.186388:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73830400 -> 73834496 00002000:00010000:2.0:1789760788.186393:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144224 -> 144232 00010000:00010000:2.0:1789760788.186405:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186418:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186428:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186441:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.186447:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186456:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186474:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.186482:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ebef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73830400->73834495] (req 73830400->73834495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.186601:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5430us (6424us total) trans 4294985333 rc 0/0 00000100:00100000:2.0:1789760788.186612:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18036 00000100:00100000:2.0:1789760788.186621:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726422758641 time 726441443198 state 0x2 ref 0 00000100:00100000:2.0:1789760788.190751:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.191145:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538176 00000100:00100000:1.0:1789760788.191154:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538176 00000100:00100000:1.0:1789760788.191206:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726422758641 time 726441443198 state 0x0 ref 1 00000100:00100000:1.0:1789760788.191220:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726441703614 time 726441443198 state 0x1 ref 1 00000100:00100000:1.0:1789760788.191289:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726441703614 time 726451580763 state 0x0 ref 1 00000100:00100000:1.0:1789760788.191302:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.191349:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73834496, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23368 00010000:00010000:1.0:1789760788.191359:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.191377:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.191381:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.191387:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.191401:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.197728:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985334 is committed 00002000:00010000:1.0:1789760788.201520:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73834496 -> 73838592 00002000:00010000:1.0:1789760788.201529:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144232 -> 144240 00010000:00010000:1.0:1789760788.201542:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201556:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201566:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201574:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.201579:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201588:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201612:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.201620:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674ebf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73834496->73838591] (req 73834496->73838591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.201980:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10674us (11270us total) trans 4294985334 rc 0/0 00000100:00100000:1.0:1789760788.201990:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18037 00000100:00100000:1.0:1789760788.202000:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726441703614 time 726451580763 state 0x2 ref 0 00000100:00100000:1.0:1789760788.205210:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.205313:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538304 00000100:00100000:0.0:1789760788.205323:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538304 00000100:00100000:0.0:1789760788.205375:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726441703614 time 726451580763 state 0x0 ref 1 00000100:00100000:0.0:1789760788.205394:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726451841179 time 726451580763 state 0x1 ref 1 00000100:00100000:0.0:1789760788.205454:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726451841179 time 726465745204 state 0x0 ref 1 00000100:00100000:0.0:1789760788.205466:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.205512:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73838592, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23370 00010000:00010000:0.0:1789760788.205522:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.205537:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.205541:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.205547:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.205561:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760788.210932:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985335 is committed 00002000:00010000:0.0:1789760788.214479:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73838592 -> 73842688 00002000:00010000:0.0:1789760788.214489:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144240 -> 144248 00010000:00010000:0.0:1789760788.214503:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214516:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214525:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214538:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.214542:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214550:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214570:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.214577:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ebfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73838592->73842687] (req 73838592->73842687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.214897:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9428us (9689us total) trans 4294985335 rc 0/0 00000100:00100000:0.0:1789760788.214908:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18038 00000100:00100000:0.0:1789760788.214919:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726451841179 time 726465745204 state 0x2 ref 0 00000100:00100000:3.0:1789760788.223340:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.223751:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538432 00000100:00100000:2.0:1789760788.223761:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538432 00000100:00100000:2.0:1789760788.223816:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726451841179 time 726465745204 state 0x0 ref 1 00000100:00100000:2.0:1789760788.223829:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726466005620 time 726465745204 state 0x1 ref 1 00000100:00100000:2.0:1789760788.223861:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726466005620 time 726484153115 state 0x0 ref 1 00000100:00100000:2.0:1789760788.223873:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.223923:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73842688, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23378 00010000:00010000:2.0:1789760788.223933:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.223950:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.223955:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.223961:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.223975:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760788.232976:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985336 is committed 00002000:00010000:2.0:1789760788.233193:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73842688 -> 73846784 00002000:00010000:2.0:1789760788.233199:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144248 -> 144256 00010000:00010000:2.0:1789760788.233212:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233226:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233245:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233253:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.233259:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233269:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233288:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.233296:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ec04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73842688->73846783] (req 73842688->73846783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.233668:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9782us (10323us total) trans 4294985336 rc 0/0 00000100:00100000:2.0:1789760788.233680:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18039 00000100:00100000:2.0:1789760788.233689:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726466005620 time 726484153115 state 0x2 ref 0 00000100:00100000:2.0:1789760788.238010:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.238132:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538560 00000100:00100000:1.0:1789760788.238141:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538560 00000100:00100000:1.0:1789760788.238189:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726466005620 time 726484153115 state 0x0 ref 1 00000100:00100000:1.0:1789760788.238203:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726484413531 time 726484153115 state 0x1 ref 1 00000100:00100000:1.0:1789760788.238231:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726484413531 time 726498523445 state 0x0 ref 1 00000100:00100000:1.0:1789760788.238390:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565538560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.238434:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73846784, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23380 00010000:00010000:1.0:1789760788.238442:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.238458:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.238463:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.238469:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.238481:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.250231:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985337 is committed 00002000:00010000:1.0:1789760788.251074:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73846784 -> 73850880 00002000:00010000:1.0:1789760788.251081:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144256 -> 144264 00010000:00010000:1.0:1789760788.251097:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251111:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251121:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251130:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.251135:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251145:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251170:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.251179:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73846784->73850879] (req 73846784->73850879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.251339:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565538560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13028us (13342us total) trans 4294985337 rc 0/0 00000100:00100000:1.0:1789760788.251350:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18040 00000100:00100000:1.0:1789760788.251360:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726484413531 time 726498523445 state 0x2 ref 0 00000100:00100000:1.0:1789760788.259075:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.259382:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538688 00000100:00100000:0.0:1789760788.259392:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538688 00000100:00100000:0.0:1789760788.259453:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726484413531 time 726498523445 state 0x0 ref 1 00000100:00100000:0.0:1789760788.259469:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726498783861 time 726498523445 state 0x1 ref 1 00000100:00100000:0.0:1789760788.259502:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726498783861 time 726519793505 state 0x0 ref 1 00000100:00100000:0.0:1789760788.259515:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.259563:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73850880, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23388 00010000:00010000:0.0:1789760788.259574:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.259592:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.259596:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.259603:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.259628:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.269963:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985338 is committed 00002000:00010000:0.0:1789760788.270142:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73850880 -> 73854976 00002000:00010000:0.0:1789760788.270147:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144264 -> 144272 00010000:00010000:0.0:1789760788.270160:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270172:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270182:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270190:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.270195:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270204:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270223:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.270231:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674ec12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73850880->73854975] (req 73850880->73854975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.270362:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10845us (11293us total) trans 4294985338 rc 0/0 00000100:00100000:0.0:1789760788.270372:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18041 00000100:00100000:0.0:1789760788.270381:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726498783861 time 726519793505 state 0x2 ref 0 00000100:00100000:3.0:1789760788.274749:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760788.275094:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538816 00000100:00100000:2.0:1789760788.275103:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538816 00000100:00100000:2.0:1789760788.275167:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726498783861 time 726519793505 state 0x0 ref 1 00000100:00100000:2.0:1789760788.275183:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726520053921 time 726519793505 state 0x1 ref 1 00000100:00100000:2.0:1789760788.275222:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726520053921 time 726535514362 state 0x0 ref 1 00000100:00100000:2.0:1789760788.275235:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760788.275282:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73854976, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23390 00010000:00010000:2.0:1789760788.275292:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.275309:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1789760788.275312:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760788.275318:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.275331:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.279627:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985339 is committed 00002000:00010000:2.0:1789760788.279774:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73854976 -> 73859072 00002000:00010000:2.0:1789760788.279779:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144272 -> 144280 00010000:00010000:2.0:1789760788.279792:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279805:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279815:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279833:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.279839:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279955:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279974:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.279982:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674ec19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73854976->73859071] (req 73854976->73859071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.280267:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565538816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5029us (5562us total) trans 4294985339 rc 0/0 00000100:00100000:2.0:1789760788.280278:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18042 00000100:00100000:2.0:1789760788.280288:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726520053921 time 726535514362 state 0x2 ref 0 00000100:00100000:2.0:1789760788.291395:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.292525:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565538944 00000100:00100000:1.0:1789760788.292541:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565538944 00000100:00100000:1.0:1789760788.292611:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726520053921 time 726535514362 state 0x0 ref 1 00000100:00100000:1.0:1789760788.292626:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726535774778 time 726535514362 state 0x1 ref 1 00000100:00100000:1.0:1789760788.292672:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726535774778 time 726552963935 state 0x0 ref 1 00000100:00100000:1.0:1789760788.292686:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.292776:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73859072, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23398 00010000:00010000:1.0:1789760788.292786:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.292807:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.292812:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.292818:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.292832:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.297564:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985340 is committed 00002000:00010000:2.0:1789760788.297902:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73859072 -> 73863168 00002000:00010000:2.0:1789760788.297907:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144280 -> 144288 00010000:00010000:2.0:1789760788.297920:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.297934:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.297943:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.297957:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.297962:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.297971:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.297991:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.298061:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674ec20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73859072->73863167] (req 73859072->73863167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.298205:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565538944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5516us (6815us total) trans 4294985340 rc 0/0 00000100:00100000:2.0:1789760788.298215:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18043 00000100:00100000:2.0:1789760788.298233:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726535774778 time 726552963935 state 0x2 ref 0 00000100:00100000:3.0:1789760788.301534:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.301607:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539072 00000100:00100000:1.0:1789760788.301618:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539072 00000100:00100000:1.0:1789760788.302022:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726535774778 time 726552963935 state 0x0 ref 1 00000100:00100000:1.0:1789760788.302036:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726553224351 time 726552963935 state 0x1 ref 1 00000100:00100000:1.0:1789760788.302113:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726553224351 time 726562403674 state 0x0 ref 1 00000100:00100000:1.0:1789760788.302127:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.302173:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73863168, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233a0 00010000:00010000:1.0:1789760788.302181:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.302197:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.302201:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.302208:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.302227:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.311234:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985341 is committed 00002000:00010000:1.0:1789760788.312179:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73863168 -> 73867264 00002000:00010000:1.0:1789760788.312186:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144288 -> 144296 00010000:00010000:1.0:1789760788.312200:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312214:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312224:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312231:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.312236:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312245:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312264:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.312272:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73863168->73867263] (req 73863168->73867263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.312364:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10235us (10835us total) trans 4294985341 rc 0/0 00000100:00100000:1.0:1789760788.312376:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18044 00000100:00100000:1.0:1789760788.312385:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726553224351 time 726562403674 state 0x2 ref 0 00000100:00100000:2.0:1789760788.318265:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.318748:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539200 00000100:00100000:1.0:1789760788.318758:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539200 00000100:00100000:1.0:1789760788.318813:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726553224351 time 726562403674 state 0x0 ref 1 00000100:00100000:1.0:1789760788.318829:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726562664090 time 726562403674 state 0x1 ref 1 00000100:00100000:1.0:1789760788.318851:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726562664090 time 726579143165 state 0x0 ref 1 00000100:00100000:1.0:1789760788.318862:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.318909:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73867264, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233a8 00010000:00010000:1.0:1789760788.318917:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.318933:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.318938:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.318944:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.318963:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.325669:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985342 is committed 00002000:00010000:1.0:1789760788.326329:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73867264 -> 73871360 00002000:00010000:1.0:1789760788.326335:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144296 -> 144304 00010000:00010000:1.0:1789760788.326349:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326363:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326372:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326380:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.326385:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326395:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326414:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.326670:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73867264->73871359] (req 73867264->73871359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.326889:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8024us (8629us total) trans 4294985342 rc 0/0 00000100:00100000:1.0:1789760788.326902:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18045 00000100:00100000:1.0:1789760788.326912:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726562664090 time 726579143165 state 0x2 ref 0 00000100:00100000:2.0:1789760788.332535:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.332700:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539328 00000100:00100000:0.0:1789760788.332841:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539328 00000100:00100000:0.0:1789760788.332896:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726562664090 time 726579143165 state 0x0 ref 1 00000100:00100000:0.0:1789760788.332911:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726579403581 time 726579143165 state 0x1 ref 1 00000100:00100000:0.0:1789760788.332932:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726579403581 time 726593224579 state 0x0 ref 1 00000100:00100000:0.0:1789760788.332945:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.332992:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73871360, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233b0 00010000:00010000:0.0:1789760788.333384:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.333401:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.333406:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.333412:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.333427:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.339987:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985343 is committed 00002000:00010000:0.0:1789760788.340596:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73871360 -> 73875456 00002000:00010000:0.0:1789760788.340602:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144304 -> 144312 00010000:00010000:0.0:1789760788.340615:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.340629:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.340639:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.340646:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.341537:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.341554:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.341575:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.341582:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ec35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73871360->73875455] (req 73871360->73875455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.342610:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565539328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9659us (10074us total) trans 4294985343 rc 0/0 00000100:00100000:0.0:1789760788.342623:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18046 00000100:00100000:0.0:1789760788.342632:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726579403581 time 726593224579 state 0x2 ref 0 00000100:00100000:0.0:1789760788.351933:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.352073:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539456 00000100:00100000:1.0:1789760788.352084:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539456 00000100:00100000:1.0:1789760788.352137:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726579403581 time 726593224579 state 0x0 ref 1 00000100:00100000:1.0:1789760788.352153:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726593484995 time 726593224579 state 0x1 ref 1 00000100:00100000:1.0:1789760788.352448:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726593484995 time 726612738165 state 0x0 ref 1 00000100:00100000:1.0:1789760788.352462:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.352510:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73875456, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233b8 00010000:00010000:1.0:1789760788.352519:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.352534:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.352539:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.352546:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.352559:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.360390:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985344 is committed 00002000:00010000:1.0:1789760788.361389:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73875456 -> 73879552 00002000:00010000:1.0:1789760788.361397:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144312 -> 144320 00010000:00010000:1.0:1789760788.361417:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361429:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361438:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361445:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.361450:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361459:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361478:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.361486:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73875456->73879551] (req 73875456->73879551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.361594:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9130us (9666us total) trans 4294985344 rc 0/0 00000100:00100000:1.0:1789760788.361605:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18047 00000100:00100000:1.0:1789760788.361614:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726593484995 time 726612738165 state 0x2 ref 0 00000100:00100000:2.0:1789760788.371684:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.371790:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539584 00000100:00100000:1.0:1789760788.371802:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539584 00000100:00100000:1.0:1789760788.371860:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726593484995 time 726612738165 state 0x0 ref 1 00000100:00100000:1.0:1789760788.371876:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726612998581 time 726612738165 state 0x1 ref 1 00000100:00100000:1.0:1789760788.371912:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726612998581 time 726632203597 state 0x0 ref 1 00000100:00100000:1.0:1789760788.371926:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.371980:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73879552, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233c0 00010000:00010000:1.0:1789760788.371989:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.372005:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.372011:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.372017:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.372031:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.377152:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985345 is committed 00002000:00010000:1.0:1789760788.377398:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73879552 -> 73883648 00002000:00010000:1.0:1789760788.377404:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144320 -> 144328 00010000:00010000:1.0:1789760788.377419:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377456:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377465:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377472:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.377478:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377486:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377507:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.377515:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73879552->73883647] (req 73879552->73883647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.377617:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5680us (5928us total) trans 4294985345 rc 0/0 00000100:00100000:1.0:1789760788.377628:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18048 00000100:00100000:1.0:1789760788.377638:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726612998581 time 726632203597 state 0x2 ref 0 00000100:00100000:2.0:1789760788.395216:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.395390:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539712 00000100:00100000:0.0:1789760788.395400:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539712 00000100:00100000:0.0:1789760788.395532:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726612998581 time 726632203597 state 0x0 ref 1 00000100:00100000:0.0:1789760788.395838:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726632464013 time 726632203597 state 0x1 ref 1 00000100:00100000:0.0:1789760788.395910:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726632464013 time 726656200867 state 0x0 ref 1 00000100:00100000:0.0:1789760788.395925:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.395974:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73883648, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233c8 00010000:00010000:0.0:1789760788.395984:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.396009:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.396014:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.396020:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.396034:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.401671:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985346 is committed 00002000:00010000:0.0:1789760788.402241:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73883648 -> 73887744 00002000:00010000:0.0:1789760788.402247:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144328 -> 144336 00010000:00010000:0.0:1789760788.402264:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402278:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402288:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402296:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.402301:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402317:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402338:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.402347:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ec4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73883648->73887743] (req 73883648->73887743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.402444:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565539712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6518us (7234us total) trans 4294985346 rc 0/0 00000100:00100000:0.0:1789760788.402455:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18049 00000100:00100000:0.0:1789760788.402465:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726632464013 time 726656200867 state 0x2 ref 0 00000100:00100000:0.0:1789760788.416362:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.416748:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539840 00000100:00100000:1.0:1789760788.416759:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539840 00000100:00100000:1.0:1789760788.416813:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726632464013 time 726656200867 state 0x0 ref 1 00000100:00100000:1.0:1789760788.416830:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726656461283 time 726656200867 state 0x1 ref 1 00000100:00100000:1.0:1789760788.416922:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726656461283 time 726677213358 state 0x0 ref 1 00000100:00100000:1.0:1789760788.416936:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565539840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.416989:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73887744, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233d0 00010000:00010000:1.0:1789760788.416999:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.417014:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.417019:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.417026:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.417039:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.422313:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985347 is committed 00002000:00010000:1.0:1789760788.424206:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73887744 -> 73891840 00002000:00010000:1.0:1789760788.424217:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144336 -> 144344 00010000:00010000:1.0:1789760788.424231:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424244:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424260:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424269:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.424273:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424283:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424304:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.424312:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73887744->73891839] (req 73887744->73891839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.424412:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565539840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7474us (8053us total) trans 4294985347 rc 0/0 00000100:00100000:1.0:1789760788.424424:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18050 00000100:00100000:1.0:1789760788.424442:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726656461283 time 726677213358 state 0x2 ref 0 00000100:00100000:2.0:1789760788.429819:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.429992:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565539968 00000100:00100000:1.0:1789760788.430002:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565539968 00000100:00100000:1.0:1789760788.430053:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726656461283 time 726677213358 state 0x0 ref 1 00000100:00100000:1.0:1789760788.430069:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726677473774 time 726677213358 state 0x1 ref 1 00000100:00100000:1.0:1789760788.430112:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726677473774 time 726690404510 state 0x0 ref 1 00000100:00100000:1.0:1789760788.430125:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565539968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.430169:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73891840, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233d8 00010000:00010000:1.0:1789760788.430178:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.430193:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.430198:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.430204:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.430219:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.438307:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985348 is committed 00002000:00010000:1.0:1789760788.438428:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73891840 -> 73895936 00002000:00010000:1.0:1789760788.438434:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144344 -> 144352 00010000:00010000:1.0:1789760788.438456:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438469:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438478:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438491:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.438496:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438504:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438521:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.438527:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73891840->73895935] (req 73891840->73895935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.438627:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565539968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8499us (8817us total) trans 4294985348 rc 0/0 00000100:00100000:1.0:1789760788.438638:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18051 00000100:00100000:1.0:1789760788.438647:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726677473774 time 726690404510 state 0x2 ref 0 00000100:00100000:2.0:1789760788.445931:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.446189:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540096 00000100:00100000:0.0:1789760788.446198:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540096 00000100:00100000:0.0:1789760788.446259:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726677473774 time 726690404510 state 0x0 ref 1 00000100:00100000:0.0:1789760788.446270:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726690664926 time 726690404510 state 0x1 ref 1 00000100:00100000:0.0:1789760788.446292:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726690664926 time 726706584439 state 0x0 ref 1 00000100:00100000:0.0:1789760788.446305:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.446363:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73895936, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233e0 00010000:00010000:0.0:1789760788.446373:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.446398:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.446402:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.446407:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.446421:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.455105:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985349 is committed 00002000:00010000:1.0:1789760788.456206:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73895936 -> 73900032 00002000:00010000:1.0:1789760788.456213:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144352 -> 144360 00010000:00010000:1.0:1789760788.456227:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456305:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456319:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456326:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.456331:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456339:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456359:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.456366:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ec5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73895936->73900031] (req 73895936->73900031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.456821:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10510us (10891us total) trans 4294985349 rc 0/0 00000100:00100000:1.0:1789760788.456832:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18052 00000100:00100000:1.0:1789760788.456856:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726690664926 time 726706584439 state 0x2 ref 0 00000100:00100000:0.0:1789760788.468203:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.469162:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540224 00000100:00100000:1.0:1789760788.469173:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540224 00000100:00100000:1.0:1789760788.469233:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726690664926 time 726706584439 state 0x0 ref 1 00000100:00100000:1.0:1789760788.469363:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726706844855 time 726706584439 state 0x1 ref 1 00000100:00100000:1.0:1789760788.469395:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726706844855 time 726729686894 state 0x0 ref 1 00000100:00100000:1.0:1789760788.469409:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.469725:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73900032, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233e8 00010000:00010000:1.0:1789760788.469736:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.469752:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.469757:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.469764:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.469777:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.481636:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985350 is committed 00002000:00010000:1.0:1789760788.481778:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73900032 -> 73904128 00002000:00010000:1.0:1789760788.481784:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144360 -> 144368 00010000:00010000:1.0:1789760788.481799:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481814:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481823:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481836:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.481841:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481850:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481871:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.481878:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73900032->73904127] (req 73900032->73904127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.481980:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12569us (13782us total) trans 4294985350 rc 0/0 00000100:00100000:1.0:1789760788.481991:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18053 00000100:00100000:1.0:1789760788.482011:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726706844855 time 726729686894 state 0x2 ref 0 00000100:00100000:2.0:1789760788.492747:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.492845:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540352 00000100:00100000:1.0:1789760788.492854:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540352 00000100:00100000:1.0:1789760788.492905:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726706844855 time 726729686894 state 0x0 ref 1 00000100:00100000:1.0:1789760788.492920:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726729947310 time 726729686894 state 0x1 ref 1 00000100:00100000:1.0:1789760788.492949:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726729947310 time 726753241636 state 0x0 ref 1 00000100:00100000:1.0:1789760788.492964:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.493018:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73904128, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233f0 00010000:00010000:1.0:1789760788.493027:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.493042:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.493046:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.493052:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.493064:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.500673:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985351 is committed 00002000:00010000:1.0:1789760788.500862:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73904128 -> 73908224 00002000:00010000:1.0:1789760788.500867:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144368 -> 144376 00010000:00010000:1.0:1789760788.500880:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500893:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500903:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500911:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.500916:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500925:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500943:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.500951:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73904128->73908223] (req 73904128->73908223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.501098:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8130us (8399us total) trans 4294985351 rc 0/0 00000100:00100000:1.0:1789760788.501109:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18054 00000100:00100000:1.0:1789760788.501118:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726729947310 time 726753241636 state 0x2 ref 0 00000100:00100000:2.0:1789760788.505851:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.506221:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540480 00000100:00100000:1.0:1789760788.506233:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540480 00000100:00100000:1.0:1789760788.506290:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726729947310 time 726753241636 state 0x0 ref 1 00000100:00100000:1.0:1789760788.506306:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726753502052 time 726753241636 state 0x1 ref 1 00000100:00100000:1.0:1789760788.506339:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726753502052 time 726766631116 state 0x0 ref 1 00000100:00100000:1.0:1789760788.506352:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565540480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.506400:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73908224, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x233f8 00010000:00010000:1.0:1789760788.506410:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.506425:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.506430:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.506436:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.506451:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.514552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985352 is committed 00002000:00010000:1.0:1789760788.516195:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73908224 -> 73912320 00002000:00010000:1.0:1789760788.516204:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144376 -> 144384 00010000:00010000:1.0:1789760788.516218:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516231:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516240:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516248:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.516253:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516261:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516281:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.516290:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73908224->73912319] (req 73908224->73912319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.516385:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565540480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10032us (10540us total) trans 4294985352 rc 0/0 00000100:00100000:1.0:1789760788.516396:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18055 00000100:00100000:1.0:1789760788.516405:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726753502052 time 726766631116 state 0x2 ref 0 00000100:00100000:0.0:1789760788.523837:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.529832:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540608 00000100:00100000:1.0:1789760788.529846:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540608 00000100:00100000:1.0:1789760788.529906:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726753502052 time 726766631116 state 0x0 ref 1 00000100:00100000:1.0:1789760788.529922:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726766891532 time 726766631116 state 0x1 ref 1 00000100:00100000:1.0:1789760788.529957:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726766891532 time 726790248761 state 0x0 ref 1 00000100:00100000:1.0:1789760788.529971:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.530019:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73912320, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23400 00010000:00010000:1.0:1789760788.530028:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.530042:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.530048:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.530054:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.530068:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.537027:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985353 is committed 00002000:00010000:1.0:1789760788.537189:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73912320 -> 73916416 00002000:00010000:1.0:1789760788.537194:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144384 -> 144392 00010000:00010000:1.0:1789760788.537208:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537220:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537228:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537236:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.537241:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537250:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537273:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.537286:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73912320->73916415] (req 73912320->73916415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.537382:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7411us (13550us total) trans 4294985353 rc 0/0 00000100:00100000:1.0:1789760788.537392:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18056 00000100:00100000:1.0:1789760788.537401:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726766891532 time 726790248761 state 0x2 ref 0 00000100:00100000:2.0:1789760788.541420:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.541525:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540736 00000100:00100000:1.0:1789760788.541534:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540736 00000100:00100000:1.0:1789760788.541587:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726766891532 time 726790248761 state 0x0 ref 1 00000100:00100000:1.0:1789760788.541615:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726790509177 time 726790248761 state 0x1 ref 1 00000100:00100000:1.0:1789760788.541646:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726790509177 time 726801938068 state 0x0 ref 1 00000100:00100000:1.0:1789760788.541668:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.541750:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73916416, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23408 00010000:00010000:1.0:1789760788.541760:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.541775:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.541780:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.541786:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.541804:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760788.551600:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985354 is committed 00002000:00010000:2.0:1789760788.551767:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73916416 -> 73920512 00002000:00010000:2.0:1789760788.551772:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144392 -> 144400 00010000:00010000:2.0:1789760788.551786:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551799:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551809:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551816:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760788.551821:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551830:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551850:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.551862:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674ec82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73916416->73920511] (req 73916416->73920511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.551964:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10293us (10549us total) trans 4294985354 rc 0/0 00000100:00100000:2.0:1789760788.551976:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18057 00000100:00100000:2.0:1789760788.551985:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726790509177 time 726801938068 state 0x2 ref 0 00000100:00100000:2.0:1789760788.556026:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.556164:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540864 00000100:00100000:1.0:1789760788.556173:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540864 00000100:00100000:1.0:1789760788.556229:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726790509177 time 726801938068 state 0x0 ref 1 00000100:00100000:1.0:1789760788.556245:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726802198484 time 726801938068 state 0x1 ref 1 00000100:00100000:1.0:1789760788.556276:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726802198484 time 726816568237 state 0x0 ref 1 00000100:00100000:1.0:1789760788.556289:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.556340:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73920512, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23410 00010000:00010000:1.0:1789760788.556349:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.556365:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.556370:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.556377:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.556391:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.563331:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985355 is committed 00002000:00010000:0.0:1789760788.566418:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73920512 -> 73924608 00002000:00010000:0.0:1789760788.566429:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144400 -> 144408 00010000:00010000:0.0:1789760788.566552:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566566:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566574:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566582:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.566587:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566597:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566616:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.566624:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674ec89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73920512->73924607] (req 73920512->73924607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.567188:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565540864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10896us (11178us total) trans 4294985355 rc 0/0 00000100:00100000:0.0:1789760788.567200:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18058 00000100:00100000:0.0:1789760788.567210:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726802198484 time 726816568237 state 0x2 ref 0 00000100:00100000:0.0:1789760788.575352:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.575464:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565540992 00000100:00100000:1.0:1789760788.575476:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565540992 00000100:00100000:1.0:1789760788.575549:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726802198484 time 726816568237 state 0x0 ref 1 00000100:00100000:1.0:1789760788.575568:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726816828653 time 726816568237 state 0x1 ref 1 00000100:00100000:1.0:1789760788.575600:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726816828653 time 726835891865 state 0x0 ref 1 00000100:00100000:1.0:1789760788.575613:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.575672:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73924608, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23418 00010000:00010000:1.0:1789760788.575683:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.575698:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.575753:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.575760:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.575775:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.581957:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985356 is committed 00002000:00010000:1.0:1789760788.582121:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73924608 -> 73928704 00002000:00010000:1.0:1789760788.582258:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144408 -> 144416 00010000:00010000:1.0:1789760788.582272:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582286:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582301:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582309:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.582314:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582323:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582345:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.582353:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ec90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73924608->73928703] (req 73924608->73928703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.582451:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565540992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6834us (7102us total) trans 4294985356 rc 0/0 00000100:00100000:1.0:1789760788.582462:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18059 00000100:00100000:1.0:1789760788.582472:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726816828653 time 726835891865 state 0x2 ref 0 00000100:00100000:2.0:1789760788.593798:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.593915:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541120 00000100:00100000:0.0:1789760788.593926:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541120 00000100:00100000:0.0:1789760788.594057:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726816828653 time 726835891865 state 0x0 ref 1 00000100:00100000:0.0:1789760788.594075:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726836152281 time 726835891865 state 0x1 ref 1 00000100:00100000:0.0:1789760788.594142:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726836152281 time 726854433460 state 0x0 ref 1 00000100:00100000:0.0:1789760788.594156:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.594203:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73928704, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23420 00010000:00010000:0.0:1789760788.594212:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.594227:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.594232:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.594238:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.594253:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.602023:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985357 is committed 00002000:00010000:0.0:1789760788.602193:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73928704 -> 73932800 00002000:00010000:0.0:1789760788.602197:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144416 -> 144424 00010000:00010000:0.0:1789760788.602211:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602222:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602232:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602239:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.602244:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602252:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602270:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.602277:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baa9441/0x721975f94674ec97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73928704->73932799] (req 73928704->73932799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.602372:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8215us (8579us total) trans 4294985357 rc 0/0 00000100:00100000:0.0:1789760788.602383:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18060 00000100:00100000:0.0:1789760788.602393:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726836152281 time 726854433460 state 0x2 ref 0 00000100:00100000:2.0:1789760788.606382:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.606756:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541248 00000100:00100000:0.0:1789760788.606766:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541248 00000100:00100000:0.0:1789760788.606823:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726836152281 time 726854433460 state 0x0 ref 1 00000100:00100000:0.0:1789760788.606839:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726854693876 time 726854433460 state 0x1 ref 1 00000100:00100000:0.0:1789760788.606862:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726854693876 time 726867154721 state 0x0 ref 1 00000100:00100000:0.0:1789760788.606874:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.606922:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73932800, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23428 00010000:00010000:0.0:1789760788.606932:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.606948:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.606953:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.606960:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.606984:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.611767:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985358 is committed 00002000:00010000:0.0:1789760788.612032:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73932800 -> 73936896 00002000:00010000:0.0:1789760788.612038:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144424 -> 144432 00010000:00010000:0.0:1789760788.612050:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612062:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612072:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612080:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.612085:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612095:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612115:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.612122:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ec9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73932800->73936895] (req 73932800->73936895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.612214:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5337us (5839us total) trans 4294985358 rc 0/0 00000100:00100000:0.0:1789760788.612224:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18061 00000100:00100000:0.0:1789760788.612233:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726854693876 time 726867154721 state 0x2 ref 0 00000100:00100000:2.0:1789760788.618099:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.618207:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541376 00000100:00100000:1.0:1789760788.618226:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541376 00000100:00100000:1.0:1789760788.618274:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726854693876 time 726867154721 state 0x0 ref 1 00000100:00100000:1.0:1789760788.618289:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726867415137 time 726867154721 state 0x1 ref 1 00000100:00100000:1.0:1789760788.618318:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726867415137 time 726878610870 state 0x0 ref 1 00000100:00100000:1.0:1789760788.618330:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.618381:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73936896, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23430 00010000:00010000:1.0:1789760788.618390:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.618405:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.618410:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.618417:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.618430:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.624318:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985359 is committed 00002000:00010000:1.0:1789760788.627947:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73936896 -> 73940992 00002000:00010000:1.0:1789760788.627957:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144432 -> 144440 00010000:00010000:1.0:1789760788.627972:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.627984:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.627993:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.628005:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.628010:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.628019:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.628038:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.628045:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eca5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73936896->73940991] (req 73936896->73940991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.628142:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9808us (10046us total) trans 4294985359 rc 0/0 00000100:00100000:1.0:1789760788.628152:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18062 00000100:00100000:1.0:1789760788.628161:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726867415137 time 726878610870 state 0x2 ref 0 00000100:00100000:2.0:1789760788.648368:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.648444:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541504 00000100:00100000:0.0:1789760788.648454:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541504 00000100:00100000:0.0:1789760788.648512:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726867415137 time 726878610870 state 0x0 ref 1 00000100:00100000:0.0:1789760788.648528:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726878871286 time 726878610870 state 0x1 ref 1 00000100:00100000:0.0:1789760788.648567:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726878871286 time 726908858478 state 0x0 ref 1 00000100:00100000:0.0:1789760788.648580:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.648632:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73940992, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23438 00010000:00010000:0.0:1789760788.648641:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.648673:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.648678:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.648685:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.648699:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.653442:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985360 is committed 00002000:00010000:0.0:1789760788.653996:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73940992 -> 73945088 00002000:00010000:0.0:1789760788.654002:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144440 -> 144448 00010000:00010000:0.0:1789760788.654016:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654029:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654039:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654046:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.654051:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654060:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654080:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.654231:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73940992->73945087] (req 73940992->73945087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.654331:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565541504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5748us (5968us total) trans 4294985360 rc 0/0 00000100:00100000:0.0:1789760788.654341:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18063 00000100:00100000:0.0:1789760788.654351:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726878871286 time 726908858478 state 0x2 ref 0 00000100:00100000:2.0:1789760788.666593:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.671371:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541632 00000100:00100000:0.0:1789760788.671459:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541632 00000100:00100000:0.0:1789760788.671528:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726878871286 time 726908858478 state 0x0 ref 1 00000100:00100000:0.0:1789760788.671544:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726909118894 time 726908858478 state 0x1 ref 1 00000100:00100000:0.0:1789760788.671637:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726909118894 time 726931928554 state 0x0 ref 1 00000100:00100000:0.0:1789760788.671662:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565541632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.671737:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73945088, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23440 00010000:00010000:0.0:1789760788.671746:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.671769:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.671773:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.671780:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.671798:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.676887:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985361 is committed 00002000:00010000:0.0:1789760788.677002:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73945088 -> 73949184 00002000:00010000:0.0:1789760788.677007:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144448 -> 144456 00010000:00010000:0.0:1789760788.677020:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677034:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677049:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677058:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.677063:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677072:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677091:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.677099:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73945088->73949183] (req 73945088->73949183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.677190:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565541632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5537us (10601us total) trans 4294985361 rc 0/0 00000100:00100000:0.0:1789760788.677200:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18064 00000100:00100000:0.0:1789760788.677209:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726909118894 time 726931928554 state 0x2 ref 0 00010000:00010000:0.0:1789760788.683968:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760788.695035:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.695106:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541760 00000100:00100000:1.0:1789760788.695116:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541760 00000100:00100000:1.0:1789760788.695167:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726909118894 time 726931928554 state 0x0 ref 1 00000100:00100000:1.0:1789760788.695183:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726932188970 time 726931928554 state 0x1 ref 1 00000100:00100000:1.0:1789760788.695215:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726932188970 time 726955507433 state 0x0 ref 1 00000100:00100000:1.0:1789760788.695231:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565541760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.695278:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73949184, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23448 00010000:00010000:1.0:1789760788.695287:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.695303:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1789760788.695308:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.695315:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.695328:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.699766:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985362 is committed 00002000:00010000:1.0:1789760788.699887:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73949184 -> 73953280 00002000:00010000:1.0:1789760788.699892:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144456 -> 144464 00010000:00010000:1.0:1789760788.699906:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699920:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699929:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699942:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.699947:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699957:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699978:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.699987:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73949184->73953279] (req 73949184->73953279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.700099:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565541760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4864us (5069us total) trans 4294985362 rc 0/0 00000100:00100000:1.0:1789760788.700109:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18065 00000100:00100000:1.0:1789760788.700120:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726932188970 time 726955507433 state 0x2 ref 0 00000100:00100000:2.0:1789760788.713234:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.713335:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565541888 00000100:00100000:0.0:1789760788.713345:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565541888 00000100:00100000:0.0:1789760788.713404:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726932188970 time 726955507433 state 0x0 ref 1 00000100:00100000:0.0:1789760788.713419:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726955767849 time 726955507433 state 0x1 ref 1 00000100:00100000:0.0:1789760788.713450:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726955767849 time 726973741922 state 0x0 ref 1 00000100:00100000:0.0:1789760788.713464:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565541888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.713514:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73953280, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23450 00010000:00010000:0.0:1789760788.713523:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.713540:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.713545:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.713552:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.713565:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.728323:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985363 is committed 00002000:00010000:1.0:1789760788.728550:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73953280 -> 73957376 00002000:00010000:1.0:1789760788.728555:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144464 -> 144472 00010000:00010000:1.0:1789760788.728569:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728582:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728590:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728603:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.728609:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728617:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728636:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.728643:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674ecc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73953280->73957375] (req 73953280->73957375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.728790:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565541888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15324us (15561us total) trans 4294985363 rc 0/0 00000100:00100000:1.0:1789760788.728800:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18066 00000100:00100000:1.0:1789760788.728811:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726955767849 time 726973741922 state 0x2 ref 0 00000100:00100000:3.0:1789760788.732310:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.732465:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542016 00000100:00100000:0.0:1789760788.732475:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542016 00000100:00100000:0.0:1789760788.732532:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726955767849 time 726973741922 state 0x0 ref 1 00000100:00100000:0.0:1789760788.732546:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726974002338 time 726973741922 state 0x1 ref 1 00000100:00100000:0.0:1789760788.732577:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726974002338 time 726992869382 state 0x0 ref 1 00000100:00100000:0.0:1789760788.732589:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565542016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.732639:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73957376, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23458 00010000:00010000:0.0:1789760788.732656:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.732672:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1789760788.732676:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.732682:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.732735:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.739100:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985364 is committed 00002000:00010000:0.0:1789760788.739443:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73957376 -> 73961472 00002000:00010000:0.0:1789760788.739448:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144472 -> 144480 00010000:00010000:0.0:1789760788.739462:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739481:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739490:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739497:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.739502:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739511:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739531:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.739539:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674ecc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73957376->73961471] (req 73957376->73961471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.739669:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565542016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7077us (7364us total) trans 4294985364 rc 0/0 00000100:00100000:0.0:1789760788.739680:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18067 00000100:00100000:0.0:1789760788.739689:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726974002338 time 726992869382 state 0x2 ref 0 00000100:00100000:0.0:1789760788.750389:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.750488:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542144 00000100:00100000:1.0:1789760788.750498:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542144 00000100:00100000:1.0:1789760788.750550:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726974002338 time 726992869382 state 0x0 ref 1 00000100:00100000:1.0:1789760788.750565:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726993129798 time 726992869382 state 0x1 ref 1 00000100:00100000:1.0:1789760788.750609:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726993129798 time 727010900816 state 0x0 ref 1 00000100:00100000:1.0:1789760788.750624:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.750680:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73961472, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23460 00010000:00010000:1.0:1789760788.750690:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.750735:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.750741:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.750748:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.750765:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.755954:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985365 is committed 00002000:00010000:1.0:1789760788.762336:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73961472 -> 73965568 00002000:00010000:1.0:1789760788.762345:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144480 -> 144488 00010000:00010000:1.0:1789760788.762359:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762373:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762383:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762390:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.762395:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762403:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762422:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.762430:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eccf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73961472->73965567] (req 73961472->73965567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.762605:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11978us (12221us total) trans 4294985365 rc 0/0 00000100:00100000:1.0:1789760788.762617:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18068 00000100:00100000:1.0:1789760788.762627:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726993129798 time 727010900816 state 0x2 ref 0 00000100:00100000:2.0:1789760788.773484:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.773602:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542272 00000100:00100000:1.0:1789760788.773613:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542272 00000100:00100000:1.0:1789760788.773674:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 726993129798 time 727010900816 state 0x0 ref 1 00000100:00100000:1.0:1789760788.773690:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727011161232 time 727010900816 state 0x1 ref 1 00000100:00100000:1.0:1789760788.773764:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727011161232 time 727034056124 state 0x0 ref 1 00000100:00100000:1.0:1789760788.773776:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.773823:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73965568, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23468 00010000:00010000:1.0:1789760788.773832:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.773847:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.773852:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.773859:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.773873:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.778477:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985366 is committed 00002000:00010000:1.0:1789760788.782401:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73965568 -> 73969664 00002000:00010000:1.0:1789760788.782412:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144488 -> 144496 00010000:00010000:1.0:1789760788.782425:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782437:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782445:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782452:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.782457:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782466:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782486:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.782494:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ecd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73965568->73969663] (req 73965568->73969663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.782749:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8970us (9271us total) trans 4294985366 rc 0/0 00000100:00100000:1.0:1789760788.782761:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18069 00000100:00100000:1.0:1789760788.782771:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727011161232 time 727034056124 state 0x2 ref 0 00000100:00100000:3.0:1789760788.787094:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.787320:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542400 00000100:00100000:0.0:1789760788.787331:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542400 00000100:00100000:0.0:1789760788.787386:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727011161232 time 727034056124 state 0x0 ref 1 00000100:00100000:0.0:1789760788.787403:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727034316540 time 727034056124 state 0x1 ref 1 00000100:00100000:0.0:1789760788.787475:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727034316540 time 727047765716 state 0x0 ref 1 00000100:00100000:0.0:1789760788.787488:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.787541:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73969664, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23470 00010000:00010000:0.0:1789760788.787552:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.787568:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.787573:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.787579:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.787594:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.794272:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985367 is committed 00002000:00010000:0.0:1789760788.794391:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73969664 -> 73973760 00002000:00010000:0.0:1789760788.794397:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144496 -> 144504 00010000:00010000:0.0:1789760788.794410:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794421:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794431:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794438:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.794442:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794450:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794470:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.794477:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73969664->73973759] (req 73969664->73973759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.794573:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7083us (7484us total) trans 4294985367 rc 0/0 00000100:00100000:0.0:1789760788.794584:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18070 00000100:00100000:0.0:1789760788.794603:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727034316540 time 727047765716 state 0x2 ref 0 00000100:00100000:0.0:1789760788.800676:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.800809:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542528 00000100:00100000:1.0:1789760788.800818:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542528 00000100:00100000:1.0:1789760788.800872:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727034316540 time 727047765716 state 0x0 ref 1 00000100:00100000:1.0:1789760788.800888:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727048026132 time 727047765716 state 0x1 ref 1 00000100:00100000:1.0:1789760788.800907:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727048026132 time 727061199957 state 0x0 ref 1 00000100:00100000:1.0:1789760788.800919:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.800963:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73973760, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23478 00010000:00010000:1.0:1789760788.800973:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.800989:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.800994:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.801000:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.801014:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.806265:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985368 is committed 00002000:00010000:1.0:1789760788.806387:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73973760 -> 73977856 00002000:00010000:1.0:1789760788.806392:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144504 -> 144512 00010000:00010000:1.0:1789760788.806406:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806418:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806427:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806434:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.806439:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806447:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806466:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.806480:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ece4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73973760->73977855] (req 73973760->73977855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.806577:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5655us (5922us total) trans 4294985368 rc 0/0 00000100:00100000:1.0:1789760788.806589:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18071 00000100:00100000:1.0:1789760788.806598:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727048026132 time 727061199957 state 0x2 ref 0 00000100:00100000:2.0:1789760788.812052:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.812386:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542656 00000100:00100000:1.0:1789760788.812395:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542656 00000100:00100000:1.0:1789760788.812461:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727048026132 time 727061199957 state 0x0 ref 1 00000100:00100000:1.0:1789760788.812478:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727061460373 time 727061199957 state 0x1 ref 1 00000100:00100000:1.0:1789760788.812508:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727061460373 time 727072799936 state 0x0 ref 1 00000100:00100000:1.0:1789760788.812520:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.812565:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73977856, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23480 00010000:00010000:1.0:1789760788.812575:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.812601:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.812607:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.812613:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.812633:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.817135:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985369 is committed 00002000:00010000:1.0:1789760788.817439:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73977856 -> 73981952 00002000:00010000:1.0:1789760788.817444:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144512 -> 144520 00010000:00010000:1.0:1789760788.817457:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817468:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817475:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817482:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.817486:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817495:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817514:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.817522:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674eceb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73977856->73981951] (req 73977856->73981951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.817622:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5099us (5575us total) trans 4294985369 rc 0/0 00000100:00100000:1.0:1789760788.817633:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18072 00000100:00100000:1.0:1789760788.817642:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727061460373 time 727072799936 state 0x2 ref 0 00000100:00100000:3.0:1789760788.822329:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.822406:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542784 00000100:00100000:0.0:1789760788.822416:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542784 00000100:00100000:0.0:1789760788.822473:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727061460373 time 727072799936 state 0x0 ref 1 00000100:00100000:0.0:1789760788.822492:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727073060352 time 727072799936 state 0x1 ref 1 00000100:00100000:0.0:1789760788.822524:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727073060352 time 727082816088 state 0x0 ref 1 00000100:00100000:0.0:1789760788.822538:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.822585:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73981952, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23488 00010000:00010000:0.0:1789760788.822605:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.822620:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.822624:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.822630:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.822643:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.827132:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985370 is committed 00002000:00010000:0.0:1789760788.831048:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73981952 -> 73986048 00002000:00010000:0.0:1789760788.831060:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144520 -> 144528 00010000:00010000:0.0:1789760788.831074:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831088:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831097:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831106:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.831111:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831120:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831474:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.831485:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ecf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73981952->73986047] (req 73981952->73986047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.832113:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565542784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9047us (9262us total) trans 4294985370 rc 0/0 00000100:00100000:0.0:1789760788.832138:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18073 00000100:00100000:0.0:1789760788.832148:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727073060352 time 727082816088 state 0x2 ref 0 00000100:00100000:3.0:1789760788.837437:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.837535:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565542912 00000100:00100000:0.0:1789760788.837545:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565542912 00000100:00100000:0.0:1789760788.837612:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727073060352 time 727082816088 state 0x0 ref 1 00000100:00100000:0.0:1789760788.837627:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727083076504 time 727082816088 state 0x1 ref 1 00000100:00100000:0.0:1789760788.837670:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727083076504 time 727097961186 state 0x0 ref 1 00000100:00100000:0.0:1789760788.837686:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.837755:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73986048, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23490 00010000:00010000:0.0:1789760788.837765:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.837782:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.837787:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.837794:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.837808:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.845401:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985371 is committed 00002000:00010000:0.0:1789760788.845532:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73986048 -> 73990144 00002000:00010000:0.0:1789760788.845538:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144528 -> 144536 00010000:00010000:0.0:1789760788.845551:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845564:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845574:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845581:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.845597:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845606:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845624:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.845630:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ecf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73986048->73990143] (req 73986048->73990143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.845788:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565542912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8099us (8354us total) trans 4294985371 rc 0/0 00000100:00100000:0.0:1789760788.845798:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18074 00000100:00100000:0.0:1789760788.845808:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727083076504 time 727097961186 state 0x2 ref 0 00000100:00100000:3.0:1789760788.856261:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.856438:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543040 00000100:00100000:1.0:1789760788.856450:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543040 00000100:00100000:1.0:1789760788.856509:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727083076504 time 727097961186 state 0x0 ref 1 00000100:00100000:1.0:1789760788.856524:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727098221602 time 727097961186 state 0x1 ref 1 00000100:00100000:1.0:1789760788.856558:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727098221602 time 727116850049 state 0x0 ref 1 00000100:00100000:1.0:1789760788.856572:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565543040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.856622:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73990144, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x23498 00010000:00010000:1.0:1789760788.856632:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.856656:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.856662:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.856668:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.856682:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.861913:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985372 is committed 00002000:00010000:1.0:1789760788.862251:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73990144 -> 73994240 00002000:00010000:1.0:1789760788.862257:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144536 -> 144544 00010000:00010000:1.0:1789760788.862271:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862284:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862294:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862302:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.862306:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862315:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862335:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.862343:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73990144->73994239] (req 73990144->73994239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.862444:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565543040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5870us (6186us total) trans 4294985372 rc 0/0 00000100:00100000:1.0:1789760788.862456:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18075 00000100:00100000:1.0:1789760788.862467:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727098221602 time 727116850049 state 0x2 ref 0 00000100:00100000:3.0:1789760788.869372:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.869537:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543168 00000100:00100000:0.0:1789760788.869548:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543168 00000100:00100000:0.0:1789760788.869602:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727098221602 time 727116850049 state 0x0 ref 1 00000100:00100000:0.0:1789760788.869619:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727117110465 time 727116850049 state 0x1 ref 1 00000100:00100000:0.0:1789760788.869646:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727117110465 time 727129937975 state 0x0 ref 1 00000100:00100000:0.0:1789760788.869668:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565543168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.869756:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73994240, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x234a0 00010000:00010000:0.0:1789760788.869765:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.869780:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.869784:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.869791:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.869805:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.876764:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985373 is committed 00002000:00010000:0.0:1789760788.876882:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73994240 -> 73998336 00002000:00010000:0.0:1789760788.876887:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144544 -> 144552 00010000:00010000:0.0:1789760788.876902:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876915:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876924:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876933:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.876937:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876946:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876965:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.876973:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73994240->73998335] (req 73994240->73998335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.877065:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565543168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7395us (7698us total) trans 4294985373 rc 0/0 00000100:00100000:0.0:1789760788.877074:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18076 00000100:00100000:0.0:1789760788.877084:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727117110465 time 727129937975 state 0x2 ref 0 00000100:00100000:2.0:1789760788.889541:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.889701:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543296 00000100:00100000:0.0:1789760788.889743:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543296 00000100:00100000:0.0:1789760788.889810:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727117110465 time 727129937975 state 0x0 ref 1 00000100:00100000:0.0:1789760788.889825:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727130198391 time 727129937975 state 0x1 ref 1 00000100:00100000:0.0:1789760788.889855:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727130198391 time 727150146131 state 0x0 ref 1 00000100:00100000:0.0:1789760788.889869:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.889919:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73998336, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x234a8 00010000:00010000:0.0:1789760788.889929:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.889944:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.889949:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.889955:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.889969:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.898659:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985374 is committed 00002000:00010000:0.0:1789760788.898788:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73998336 -> 74002432 00002000:00010000:0.0:1789760788.898794:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144552 -> 144560 00010000:00010000:0.0:1789760788.898809:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898823:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898833:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898844:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.898850:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898859:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898877:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.898891:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674ed0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73998336->74002431] (req 73998336->74002431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.899034:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9163us (9497us total) trans 4294985374 rc 0/0 00000100:00100000:0.0:1789760788.899046:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18077 00000100:00100000:0.0:1789760788.899057:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727130198391 time 727150146131 state 0x2 ref 0 00000100:00100000:3.0:1789760788.906492:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.907275:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543424 00000100:00100000:1.0:1789760788.907286:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543424 00000100:00100000:1.0:1789760788.907343:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727130198391 time 727150146131 state 0x0 ref 1 00000100:00100000:1.0:1789760788.907359:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727150406547 time 727150146131 state 0x1 ref 1 00000100:00100000:1.0:1789760788.907390:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727150406547 time 727167682648 state 0x0 ref 1 00000100:00100000:1.0:1789760788.907403:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565543424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.907447:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74002432, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x234b0 00010000:00010000:1.0:1789760788.907456:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.907471:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.907476:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.907483:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.907497:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.914080:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985375 is committed 00002000:00010000:1.0:1789760788.914210:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74002432 -> 74006528 00002000:00010000:1.0:1789760788.914216:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144560 -> 144568 00010000:00010000:1.0:1789760788.914230:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914243:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914252:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914260:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.914264:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914274:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914295:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.914303:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74002432->74006527] (req 74002432->74006527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.914885:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565543424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7478us (8395us total) trans 4294985375 rc 0/0 00000100:00100000:1.0:1789760788.914897:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18078 00000100:00100000:1.0:1789760788.914907:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727150406547 time 727167682648 state 0x2 ref 0 00000100:00100000:3.0:1789760788.923284:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.923856:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543552 00000100:00100000:0.0:1789760788.923868:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543552 00000100:00100000:0.0:1789760788.923922:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727150406547 time 727167682648 state 0x0 ref 1 00000100:00100000:0.0:1789760788.923939:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727167943064 time 727167682648 state 0x1 ref 1 00000100:00100000:0.0:1789760788.923983:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727167943064 time 727184274572 state 0x0 ref 1 00000100:00100000:0.0:1789760788.923997:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565543552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.924043:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74006528, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x234b8 00010000:00010000:0.0:1789760788.924053:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.924069:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.924073:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.924080:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.924100:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760788.932904:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985376 is committed 00002000:00010000:0.0:1789760788.933109:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74006528 -> 74010624 00002000:00010000:0.0:1789760788.933114:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144568 -> 144576 00010000:00010000:0.0:1789760788.933233:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933247:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933258:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933265:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.933269:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933278:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933296:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.933303:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674ed1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74006528->74010623] (req 74006528->74010623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.933395:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565543552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9397us (10117us total) trans 4294985376 rc 0/0 00000100:00100000:0.0:1789760788.933406:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18079 00000100:00100000:0.0:1789760788.933416:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727167943064 time 727184274572 state 0x2 ref 0 00000100:00100000:0.0:1789760788.944337:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.944884:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543680 00000100:00100000:1.0:1789760788.944894:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543680 00000100:00100000:1.0:1789760788.944946:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727167943064 time 727184274572 state 0x0 ref 1 00000100:00100000:1.0:1789760788.944960:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727184534988 time 727184274572 state 0x1 ref 1 00000100:00100000:1.0:1789760788.945000:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727184534988 time 727205283394 state 0x0 ref 1 00000100:00100000:1.0:1789760788.945013:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565543680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.945060:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74010624, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0x234c0 00010000:00010000:1.0:1789760788.945070:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.945086:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.945091:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.945096:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.945110:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760788.954035:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985377 is committed 00002000:00010000:0.0:1789760788.954163:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74010624 -> 74014720 00002000:00010000:0.0:1789760788.954168:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760788 -> 1789760789 00002000:00010000:0.0:1789760788.954170:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760788 -> 1789760789 00002000:00010000:0.0:1789760788.954173:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144576 -> 144584 00010000:00010000:0.0:1789760788.954185:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954197:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954206:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954213:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.954218:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954226:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954249:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.954255:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674ed23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74010624->74014719] (req 74010624->74014719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.954343:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565543680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9326us (10008us total) trans 4294985377 rc 0/0 00000100:00100000:0.0:1789760788.954353:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18080 00000100:00100000:0.0:1789760788.954362:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727184534988 time 727205283394 state 0x2 ref 0 00000100:00100000:3.0:1789760788.965965:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760788.966059:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543808 00000100:00100000:1.0:1789760788.966068:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543808 00000100:00100000:1.0:1789760788.966130:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727184534988 time 727205283394 state 0x0 ref 1 00000100:00100000:1.0:1789760788.966146:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727205543810 time 727205283394 state 0x1 ref 1 00000100:00100000:1.0:1789760788.966177:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727205543810 time 727226468715 state 0x0 ref 1 00000100:00100000:1.0:1789760788.966189:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760788.966237:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74014720, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234c8 00010000:00010000:1.0:1789760788.966247:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.966264:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760788.966268:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.966275:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.966289:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760788.975581:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985378 is committed 00002000:00010000:1.0:1789760788.976398:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74014720 -> 74018816 00002000:00010000:1.0:1789760788.976406:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144584 -> 144592 00010000:00010000:1.0:1789760788.976420:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976434:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976443:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976456:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760788.976462:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976472:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976492:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.976501:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74014720->74018815] (req 74014720->74018815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.976859:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10666us (10896us total) trans 4294985378 rc 0/0 00000100:00100000:1.0:1789760788.976871:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18081 00000100:00100000:1.0:1789760788.976881:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727205543810 time 727226468715 state 0x2 ref 0 00000100:00100000:3.0:1789760788.983665:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760788.984236:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565543936 00000100:00100000:0.0:1789760788.984247:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565543936 00000100:00100000:0.0:1789760788.984311:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727205543810 time 727226468715 state 0x0 ref 1 00000100:00100000:0.0:1789760788.984328:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727226729131 time 727226468715 state 0x1 ref 1 00000100:00100000:0.0:1789760788.984357:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727226729131 time 727244649855 state 0x0 ref 1 00000100:00100000:0.0:1789760788.984371:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760788.984418:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74018816, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234d0 00010000:00010000:0.0:1789760788.984429:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.984446:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760788.984451:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.984458:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.984470:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760788.992892:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985379 is committed 00002000:00010000:0.0:1789760788.993034:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74018816 -> 74022912 00002000:00010000:0.0:1789760788.993039:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144592 -> 144600 00010000:00010000:0.0:1789760788.993053:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993065:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993073:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993081:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760788.993085:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993095:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993115:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.993889:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674ed31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74018816->74022911] (req 74018816->74022911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.995787:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565543936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11407us (12129us total) trans 4294985379 rc 0/0 00000100:00100000:0.0:1789760788.995801:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18082 00000100:00100000:0.0:1789760788.995811:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727226729131 time 727244649855 state 0x2 ref 0 00000100:00100000:0.0:1789760789.015361:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.015471:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544064 00000100:00100000:2.0:1789760789.015481:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544064 00000100:00100000:2.0:1789760789.015537:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727226729131 time 727244649855 state 0x0 ref 1 00000100:00100000:2.0:1789760789.015553:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727244910271 time 727244649855 state 0x1 ref 1 00000100:00100000:2.0:1789760789.015588:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727244910271 time 727275879181 state 0x0 ref 1 00000100:00100000:2.0:1789760789.015601:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565544064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.015661:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74022912, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234d8 00010000:00010000:2.0:1789760789.015670:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.015686:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.015692:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.015698:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.015758:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.022701:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985380 is committed 00002000:00010000:2.0:1789760789.022914:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74022912 -> 74027008 00002000:00010000:2.0:1789760789.022920:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144600 -> 144608 00010000:00010000:2.0:1789760789.022932:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023271:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023280:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023288:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.023293:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023302:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023394:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.023409:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74022912->74027007] (req 74022912->74027007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.024313:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565544064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8708us (8955us total) trans 4294985380 rc 0/0 00000100:00100000:2.0:1789760789.024337:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18083 00000100:00100000:2.0:1789760789.024347:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727244910271 time 727275879181 state 0x2 ref 0 00000100:00100000:3.0:1789760789.028419:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.029378:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544192 00000100:00100000:1.0:1789760789.029391:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544192 00000100:00100000:1.0:1789760789.029452:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727244910271 time 727275879181 state 0x0 ref 1 00000100:00100000:1.0:1789760789.029470:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727276139597 time 727275879181 state 0x1 ref 1 00000100:00100000:1.0:1789760789.029545:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727276139597 time 727289837006 state 0x0 ref 1 00000100:00100000:1.0:1789760789.029562:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565544192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.029611:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74027008, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234e0 00010000:00010000:1.0:1789760789.029621:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.029638:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.029643:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.029661:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.029676:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.037867:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985381 is committed 00002000:00010000:2.0:1789760789.038079:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74027008 -> 74031104 00002000:00010000:2.0:1789760789.038086:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144608 -> 144616 00010000:00010000:2.0:1789760789.038099:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038114:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038124:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038132:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.038137:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038147:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038170:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.038178:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674ed3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74027008->74031103] (req 74027008->74031103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.038277:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565544192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8711us (9862us total) trans 4294985381 rc 0/0 00000100:00100000:2.0:1789760789.038288:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18084 00000100:00100000:2.0:1789760789.038298:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727276139597 time 727289837006 state 0x2 ref 0 00000100:00100000:3.0:1789760789.057005:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760789.057347:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544320 00000100:00100000:0.0:1789760789.057358:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544320 00000100:00100000:0.0:1789760789.057415:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727276139597 time 727289837006 state 0x0 ref 1 00000100:00100000:0.0:1789760789.057430:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727290097422 time 727289837006 state 0x1 ref 1 00000100:00100000:0.0:1789760789.057465:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727290097422 time 727317756908 state 0x0 ref 1 00000100:00100000:0.0:1789760789.057477:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565544320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760789.057525:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74031104, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234e8 00010000:00010000:0.0:1789760789.057534:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.057549:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:0.0:1789760789.057554:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.057560:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.057575:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.063134:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985382 is committed 00002000:00010000:1.0:1789760789.063262:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74031104 -> 74035200 00002000:00010000:1.0:1789760789.063266:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144616 -> 144624 00010000:00010000:1.0:1789760789.063280:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063292:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063301:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063308:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.063313:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063321:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063339:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.063347:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674ed46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74031104->74035199] (req 74031104->74035199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.063438:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565544320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5958us (6446us total) trans 4294985382 rc 0/0 00000100:00100000:1.0:1789760789.063449:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18085 00000100:00100000:1.0:1789760789.063457:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727290097422 time 727317756908 state 0x2 ref 0 00000100:00100000:0.0:1789760789.067321:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.067403:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544448 00000100:00100000:3.0:1789760789.067412:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544448 00000100:00100000:3.0:1789760789.067461:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727290097422 time 727317756908 state 0x0 ref 1 00000100:00100000:3.0:1789760789.067475:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727318017324 time 727317756908 state 0x1 ref 1 00000100:00100000:3.0:1789760789.067505:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727318017324 time 727327797467 state 0x0 ref 1 00000100:00100000:3.0:1789760789.067517:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565544448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.067561:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74035200, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234f0 00010000:00010000:3.0:1789760789.067569:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.067594:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.067598:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.067604:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.067617:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.072163:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985383 is committed 00002000:00010000:3.0:1789760789.072513:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74035200 -> 74039296 00002000:00010000:3.0:1789760789.072519:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144624 -> 144632 00010000:00010000:3.0:1789760789.072533:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072545:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072554:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072560:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.072565:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072574:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072672:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.072681:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74035200->74039295] (req 74035200->74039295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.072848:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565544448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5327us (5531us total) trans 4294985383 rc 0/0 00000100:00100000:3.0:1789760789.072859:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18086 00000100:00100000:3.0:1789760789.072868:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727318017324 time 727327797467 state 0x2 ref 0 00000100:00100000:3.0:1789760789.082900:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.083009:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544576 00000100:00100000:2.0:1789760789.083018:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544576 00000100:00100000:2.0:1789760789.083073:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727318017324 time 727327797467 state 0x0 ref 1 00000100:00100000:2.0:1789760789.083086:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727328057883 time 727327797467 state 0x1 ref 1 00000100:00100000:2.0:1789760789.083121:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727328057883 time 727343413119 state 0x0 ref 1 00000100:00100000:2.0:1789760789.083133:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565544576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.083178:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74039296, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x234f8 00010000:00010000:2.0:1789760789.083188:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.083203:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.083208:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.083214:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.083228:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.089402:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985384 is committed 00002000:00010000:2.0:1789760789.091109:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74039296 -> 74043392 00002000:00010000:2.0:1789760789.091121:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144632 -> 144640 00010000:00010000:2.0:1789760789.091137:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091153:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091164:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091172:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.091699:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091741:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091762:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.091774:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74039296->74043391] (req 74039296->74043391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.091874:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565544576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8739us (8980us total) trans 4294985384 rc 0/0 00000100:00100000:2.0:1789760789.091884:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18087 00000100:00100000:2.0:1789760789.091893:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727328057883 time 727343413119 state 0x2 ref 0 00000100:00100000:0.0:1789760789.101196:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.101291:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544704 00000100:00100000:1.0:1789760789.101300:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544704 00000100:00100000:1.0:1789760789.101357:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727328057883 time 727343413119 state 0x0 ref 1 00000100:00100000:1.0:1789760789.101373:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727343673535 time 727343413119 state 0x1 ref 1 00000100:00100000:1.0:1789760789.101405:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727343673535 time 727361697504 state 0x0 ref 1 00000100:00100000:1.0:1789760789.101418:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.101471:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74043392, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23500 00010000:00010000:1.0:1789760789.101480:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.101495:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.101499:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.101506:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.101520:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.108982:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985385 is committed 00002000:00010000:1.0:1789760789.109169:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74043392 -> 74047488 00002000:00010000:1.0:1789760789.109175:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144640 -> 144648 00010000:00010000:1.0:1789760789.109188:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109202:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109211:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109219:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.109223:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109237:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109257:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.109266:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74043392->74047487] (req 74043392->74047487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.109359:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7938us (8179us total) trans 4294985385 rc 0/0 00000100:00100000:1.0:1789760789.109370:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18088 00000100:00100000:1.0:1789760789.109381:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727343673535 time 727361697504 state 0x2 ref 0 00000100:00100000:0.0:1789760789.114786:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.114913:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544832 00000100:00100000:3.0:1789760789.114923:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544832 00000100:00100000:3.0:1789760789.114982:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727343673535 time 727361697504 state 0x0 ref 1 00000100:00100000:3.0:1789760789.114996:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727361957920 time 727361697504 state 0x1 ref 1 00000100:00100000:3.0:1789760789.115026:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727361957920 time 727375318265 state 0x0 ref 1 00000100:00100000:3.0:1789760789.115038:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.115084:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74047488, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23508 00010000:00010000:3.0:1789760789.115093:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.115107:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.115111:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.115117:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.115131:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.118866:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985386 is committed 00002000:00010000:3.0:1789760789.119241:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74047488 -> 74051584 00002000:00010000:3.0:1789760789.119247:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144648 -> 144656 00010000:00010000:3.0:1789760789.119261:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119274:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119283:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119290:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.119295:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119308:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119327:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.119334:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ed62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74047488->74051583] (req 74047488->74051583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.119425:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4384us (4643us total) trans 4294985386 rc 0/0 00000100:00100000:3.0:1789760789.119435:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18089 00000100:00100000:3.0:1789760789.119444:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727361957920 time 727375318265 state 0x2 ref 0 00000100:00100000:3.0:1789760789.127200:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.127319:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565544960 00000100:00100000:2.0:1789760789.127329:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565544960 00000100:00100000:2.0:1789760789.127385:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727361957920 time 727375318265 state 0x0 ref 1 00000100:00100000:2.0:1789760789.127401:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727375578681 time 727375318265 state 0x1 ref 1 00000100:00100000:2.0:1789760789.127437:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727375578681 time 727387729040 state 0x0 ref 1 00000100:00100000:2.0:1789760789.127450:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.127498:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74051584, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23510 00010000:00010000:2.0:1789760789.127508:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.127525:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.127529:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.127536:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.127554:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.137321:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985387 is committed 00002000:00010000:2.0:1789760789.137453:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74051584 -> 74055680 00002000:00010000:2.0:1789760789.137458:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144656 -> 144664 00010000:00010000:2.0:1789760789.137472:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137484:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137492:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137500:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.137505:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137514:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137533:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.137541:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74051584->74055679] (req 74051584->74055679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.137701:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565544960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10248us (10506us total) trans 4294985387 rc 0/0 00000100:00100000:2.0:1789760789.137769:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18090 00000100:00100000:2.0:1789760789.137780:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727375578681 time 727387729040 state 0x2 ref 0 00000100:00100000:0.0:1789760789.147914:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.150827:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545088 00000100:00100000:1.0:1789760789.150948:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545088 00000100:00100000:1.0:1789760789.151019:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727375578681 time 727387729040 state 0x0 ref 1 00000100:00100000:1.0:1789760789.151035:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727387989456 time 727387729040 state 0x1 ref 1 00000100:00100000:1.0:1789760789.151123:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727387989456 time 727411414670 state 0x0 ref 1 00000100:00100000:1.0:1789760789.151137:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.151187:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74055680, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23518 00010000:00010000:1.0:1789760789.151197:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.151223:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.151228:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.151235:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.151248:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.155975:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985388 is committed 00002000:00010000:1.0:1789760789.156102:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74055680 -> 74059776 00002000:00010000:1.0:1789760789.156108:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144664 -> 144672 00010000:00010000:1.0:1789760789.156123:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156136:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156145:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156153:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.156157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156172:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156205:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.156214:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74055680->74059775] (req 74055680->74059775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.156343:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5203us (8434us total) trans 4294985388 rc 0/0 00000100:00100000:1.0:1789760789.156354:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18091 00000100:00100000:1.0:1789760789.156364:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727387989456 time 727411414670 state 0x2 ref 0 00000100:00100000:0.0:1789760789.167449:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.167790:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545216 00000100:00100000:3.0:1789760789.167799:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545216 00000100:00100000:3.0:1789760789.167852:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727387989456 time 727411414670 state 0x0 ref 1 00000100:00100000:3.0:1789760789.167868:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727411675086 time 727411414670 state 0x1 ref 1 00000100:00100000:3.0:1789760789.167900:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727411675086 time 727428191469 state 0x0 ref 1 00000100:00100000:3.0:1789760789.167913:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565545216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.167965:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74059776, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23520 00010000:00010000:3.0:1789760789.167975:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.168001:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.168006:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.168011:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.168026:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.172112:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985389 is committed 00002000:00010000:3.0:1789760789.172239:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74059776 -> 74063872 00002000:00010000:3.0:1789760789.172245:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144672 -> 144680 00010000:00010000:3.0:1789760789.172260:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172285:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172296:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172304:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.172309:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172323:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172343:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.172350:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74059776->74063871] (req 74059776->74063871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.172448:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565545216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4535us (5006us total) trans 4294985389 rc 0/0 00000100:00100000:3.0:1789760789.172459:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18092 00000100:00100000:3.0:1789760789.172469:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727411675086 time 727428191469 state 0x2 ref 0 00000100:00100000:3.0:1789760789.180872:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.180953:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545344 00000100:00100000:2.0:1789760789.180963:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545344 00000100:00100000:2.0:1789760789.181017:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727411675086 time 727428191469 state 0x0 ref 1 00000100:00100000:2.0:1789760789.181032:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727428451885 time 727428191469 state 0x1 ref 1 00000100:00100000:2.0:1789760789.181071:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727428451885 time 727441362960 state 0x0 ref 1 00000100:00100000:2.0:1789760789.181083:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.181131:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74063872, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23528 00010000:00010000:2.0:1789760789.181140:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.181155:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.181160:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.181166:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.181180:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.185058:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985390 is committed 00002000:00010000:2.0:1789760789.185186:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74063872 -> 74067968 00002000:00010000:2.0:1789760789.185191:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144680 -> 144688 00010000:00010000:2.0:1789760789.185205:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185218:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185227:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185236:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.185241:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185251:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185273:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.185291:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74063872->74067967] (req 74063872->74067967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.185390:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4304us (4523us total) trans 4294985390 rc 0/0 00000100:00100000:2.0:1789760789.185401:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18093 00000100:00100000:2.0:1789760789.185411:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727428451885 time 727441362960 state 0x2 ref 0 00000100:00100000:0.0:1789760789.188237:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.188403:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545472 00000100:00100000:1.0:1789760789.188413:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545472 00000100:00100000:1.0:1789760789.188467:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727428451885 time 727441362960 state 0x0 ref 1 00000100:00100000:1.0:1789760789.188483:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727441623376 time 727441362960 state 0x1 ref 1 00000100:00100000:1.0:1789760789.188515:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727441623376 time 727448807578 state 0x0 ref 1 00000100:00100000:1.0:1789760789.188527:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565545472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.188572:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74067968, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23530 00010000:00010000:1.0:1789760789.188580:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.188660:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.188664:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.188671:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.188684:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.199374:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985391 is committed 00002000:00010000:1.0:1789760789.200351:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74067968 -> 74072064 00002000:00010000:1.0:1789760789.200360:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144688 -> 144696 00010000:00010000:1.0:1789760789.200372:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200386:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200395:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200403:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.200408:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200422:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200442:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.200450:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74067968->74072063] (req 74067968->74072063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.200548:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565545472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12018us (12315us total) trans 4294985391 rc 0/0 00000100:00100000:1.0:1789760789.200558:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18094 00000100:00100000:1.0:1789760789.200568:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727441623376 time 727448807578 state 0x2 ref 0 00000100:00100000:0.0:1789760789.205933:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.206027:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545600 00000100:00100000:3.0:1789760789.206037:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545600 00000100:00100000:3.0:1789760789.206096:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727441623376 time 727448807578 state 0x0 ref 1 00000100:00100000:3.0:1789760789.206111:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727449067994 time 727448807578 state 0x1 ref 1 00000100:00100000:3.0:1789760789.206146:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727449067994 time 727466437188 state 0x0 ref 1 00000100:00100000:3.0:1789760789.206158:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.206216:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74072064, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23538 00010000:00010000:3.0:1789760789.206226:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.206241:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.206246:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.206252:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.206266:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.213469:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985392 is committed 00002000:00010000:3.0:1789760789.214272:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74072064 -> 74076160 00002000:00010000:3.0:1789760789.214278:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144696 -> 144704 00010000:00010000:3.0:1789760789.214291:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214303:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214312:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214320:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.214325:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214334:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214354:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.214362:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ed8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74072064->74076159] (req 74072064->74076159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.214512:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8350us (8583us total) trans 4294985392 rc 0/0 00000100:00100000:3.0:1789760789.214523:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18095 00000100:00100000:3.0:1789760789.214533:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727449067994 time 727466437188 state 0x2 ref 0 00000100:00100000:0.0:1789760789.224944:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.225242:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545728 00000100:00100000:2.0:1789760789.225251:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545728 00000100:00100000:2.0:1789760789.225301:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727449067994 time 727466437188 state 0x0 ref 1 00000100:00100000:2.0:1789760789.225316:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727466697604 time 727466437188 state 0x1 ref 1 00000100:00100000:2.0:1789760789.225376:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727466697604 time 727485667753 state 0x0 ref 1 00000100:00100000:2.0:1789760789.225390:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.225432:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74076160, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23540 00010000:00010000:2.0:1789760789.225441:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.225456:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.225461:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.225467:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.225482:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.234023:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985393 is committed 00002000:00010000:2.0:1789760789.234611:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74076160 -> 74080256 00002000:00010000:2.0:1789760789.234616:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144704 -> 144712 00010000:00010000:2.0:1789760789.234630:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234642:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234664:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234672:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.234677:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234685:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234720:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.234729:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674ed93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74076160->74080255] (req 74076160->74080255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.234824:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9432us (9885us total) trans 4294985393 rc 0/0 00000100:00100000:2.0:1789760789.234836:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18096 00000100:00100000:2.0:1789760789.234847:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727466697604 time 727485667753 state 0x2 ref 0 00000100:00100000:0.0:1789760789.239929:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.240217:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545856 00000100:00100000:1.0:1789760789.240227:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545856 00000100:00100000:1.0:1789760789.240282:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727466697604 time 727485667753 state 0x0 ref 1 00000100:00100000:1.0:1789760789.240298:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727485928169 time 727485667753 state 0x1 ref 1 00000100:00100000:1.0:1789760789.240455:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727485928169 time 727500745939 state 0x0 ref 1 00000100:00100000:1.0:1789760789.240469:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.240517:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74080256, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23548 00010000:00010000:1.0:1789760789.240527:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.240542:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.240547:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.240553:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.240566:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.252274:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985394 is committed 00002000:00010000:0.0:1789760789.257130:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74080256 -> 74084352 00002000:00010000:0.0:1789760789.257143:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144712 -> 144720 00010000:00010000:0.0:1789760789.257158:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257172:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257182:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257189:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.257194:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257203:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257224:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.257231:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ed9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74080256->74084351] (req 74080256->74084351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.257394:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565545856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16922us (17468us total) trans 4294985394 rc 0/0 00000100:00100000:0.0:1789760789.257405:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18097 00000100:00100000:0.0:1789760789.257416:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727485928169 time 727500745939 state 0x2 ref 0 00000100:00100000:0.0:1789760789.265275:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.265354:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565545984 00000100:00100000:3.0:1789760789.265363:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565545984 00000100:00100000:3.0:1789760789.265423:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727485928169 time 727500745939 state 0x0 ref 1 00000100:00100000:3.0:1789760789.265437:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727501006355 time 727500745939 state 0x1 ref 1 00000100:00100000:3.0:1789760789.265511:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727501006355 time 727525802099 state 0x0 ref 1 00000100:00100000:3.0:1789760789.265525:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.265575:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74084352, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23550 00010000:00010000:3.0:1789760789.265595:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.265612:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.265617:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.265624:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.265638:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.274231:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985395 is committed 00002000:00010000:3.0:1789760789.274354:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74084352 -> 74088448 00002000:00010000:3.0:1789760789.274358:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144720 -> 144728 00010000:00010000:3.0:1789760789.274370:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274383:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274392:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274399:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.274404:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274413:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274434:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.274445:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eda1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74084352->74088447] (req 74084352->74088447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.274537:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565545984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9011us (9269us total) trans 4294985395 rc 0/0 00000100:00100000:3.0:1789760789.274547:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18098 00000100:00100000:3.0:1789760789.274557:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727501006355 time 727525802099 state 0x2 ref 0 00000100:00100000:3.0:1789760789.278493:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.278607:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546112 00000100:00100000:2.0:1789760789.278617:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546112 00000100:00100000:2.0:1789760789.278680:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727501006355 time 727525802099 state 0x0 ref 1 00000100:00100000:2.0:1789760789.278695:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727526062515 time 727525802099 state 0x1 ref 1 00000100:00100000:2.0:1789760789.278767:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727526062515 time 727539058813 state 0x0 ref 1 00000100:00100000:2.0:1789760789.278780:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565546112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.278826:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74088448, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23558 00010000:00010000:2.0:1789760789.278835:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.278850:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.278854:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.278860:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.278873:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.286171:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985396 is committed 00002000:00010000:2.0:1789760789.286327:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74088448 -> 74092544 00002000:00010000:2.0:1789760789.286333:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144728 -> 144736 00010000:00010000:2.0:1789760789.286347:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286360:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286370:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286378:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.286383:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286392:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286411:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.286419:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674eda8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74088448->74092543] (req 74088448->74092543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.286556:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565546112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7771us (8067us total) trans 4294985396 rc 0/0 00000100:00100000:2.0:1789760789.286567:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18099 00000100:00100000:2.0:1789760789.286576:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727526062515 time 727539058813 state 0x2 ref 0 00000100:00100000:0.0:1789760789.289862:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.290107:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546240 00000100:00100000:2.0:1789760789.290117:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546240 00000100:00100000:2.0:1789760789.290176:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727526062515 time 727539058813 state 0x0 ref 1 00000100:00100000:2.0:1789760789.290191:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727539319229 time 727539058813 state 0x1 ref 1 00000100:00100000:2.0:1789760789.290254:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727539319229 time 727550545690 state 0x0 ref 1 00000100:00100000:2.0:1789760789.290268:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.290314:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74092544, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23560 00010000:00010000:2.0:1789760789.290322:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.290338:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.290343:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.290349:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.290362:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.295513:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985397 is committed 00002000:00010000:2.0:1789760789.295660:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74092544 -> 74096640 00002000:00010000:2.0:1789760789.295665:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144736 -> 144744 00010000:00010000:2.0:1789760789.295677:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295692:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295700:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295725:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.295730:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295738:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295759:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.295767:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74092544->74096639] (req 74092544->74096639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.295864:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5594us (6006us total) trans 4294985397 rc 0/0 00000100:00100000:2.0:1789760789.295875:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18100 00000100:00100000:2.0:1789760789.295885:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727539319229 time 727550545690 state 0x2 ref 0 00000100:00100000:0.0:1789760789.301440:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.301539:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546368 00000100:00100000:3.0:1789760789.301549:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546368 00000100:00100000:3.0:1789760789.301607:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727539319229 time 727550545690 state 0x0 ref 1 00000100:00100000:3.0:1789760789.301622:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727550806106 time 727550545690 state 0x1 ref 1 00000100:00100000:3.0:1789760789.301678:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727550806106 time 727561961813 state 0x0 ref 1 00000100:00100000:3.0:1789760789.301693:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.301767:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74096640, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23568 00010000:00010000:3.0:1789760789.301776:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.301793:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.301797:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.301803:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.301818:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.308567:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985398 is committed 00002000:00010000:3.0:1789760789.308824:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74096640 -> 74100736 00002000:00010000:3.0:1789760789.308830:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144744 -> 144752 00010000:00010000:3.0:1789760789.308844:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308856:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308864:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308872:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.308877:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308887:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308908:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.308916:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674edb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74096640->74100735] (req 74096640->74100735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.309142:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7445us (7706us total) trans 4294985398 rc 0/0 00000100:00100000:3.0:1789760789.309154:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18101 00000100:00100000:3.0:1789760789.309164:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727550806106 time 727561961813 state 0x2 ref 0 00000100:00100000:3.0:1789760789.312528:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.312628:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546496 00000100:00100000:2.0:1789760789.312638:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546496 00000100:00100000:2.0:1789760789.312700:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727550806106 time 727561961813 state 0x0 ref 1 00000100:00100000:2.0:1789760789.312757:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727562222229 time 727561961813 state 0x1 ref 1 00000100:00100000:2.0:1789760789.312779:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727562222229 time 727573071661 state 0x0 ref 1 00000100:00100000:2.0:1789760789.312793:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.312855:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74100736, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23570 00010000:00010000:2.0:1789760789.312865:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.312879:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.312883:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.312889:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.312901:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.318238:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985399 is committed 00002000:00010000:2.0:1789760789.319692:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74100736 -> 74104832 00002000:00010000:2.0:1789760789.319716:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144752 -> 144760 00010000:00010000:2.0:1789760789.319732:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319746:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319762:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319769:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.319774:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319783:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319804:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.319812:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74100736->74104831] (req 74100736->74104831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.319954:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7158us (7431us total) trans 4294985399 rc 0/0 00000100:00100000:2.0:1789760789.319965:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18102 00000100:00100000:2.0:1789760789.319975:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727562222229 time 727573071661 state 0x2 ref 0 00000100:00100000:0.0:1789760789.323913:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.324935:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546624 00000100:00100000:2.0:1789760789.324948:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546624 00000100:00100000:2.0:1789760789.325083:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727562222229 time 727573071661 state 0x0 ref 1 00000100:00100000:2.0:1789760789.325103:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727573332077 time 727573071661 state 0x1 ref 1 00000100:00100000:2.0:1789760789.325195:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727573332077 time 727585486565 state 0x0 ref 1 00000100:00100000:2.0:1789760789.325210:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.325261:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74104832, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23578 00010000:00010000:2.0:1789760789.325270:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.325286:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.325291:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.325297:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.325310:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.336023:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985400 is committed 00002000:00010000:0.0:1789760789.336164:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74104832 -> 74108928 00002000:00010000:0.0:1789760789.336169:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144760 -> 144768 00010000:00010000:0.0:1789760789.336188:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336207:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336216:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336223:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.336228:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336237:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336257:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.336265:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674edc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74104832->74108927] (req 74104832->74108927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.336364:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11153us (12457us total) trans 4294985400 rc 0/0 00000100:00100000:0.0:1789760789.336375:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18103 00000100:00100000:0.0:1789760789.336385:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727573332077 time 727585486565 state 0x2 ref 0 00000100:00100000:0.0:1789760789.339886:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.340017:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546752 00000100:00100000:3.0:1789760789.340027:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546752 00000100:00100000:3.0:1789760789.340085:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727573332077 time 727585486565 state 0x0 ref 1 00000100:00100000:3.0:1789760789.340101:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727585746981 time 727585486565 state 0x1 ref 1 00000100:00100000:3.0:1789760789.340132:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727585746981 time 727600423580 state 0x0 ref 1 00000100:00100000:3.0:1789760789.340145:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.340194:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74108928, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23580 00010000:00010000:3.0:1789760789.340203:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.340220:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.340224:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.340231:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.340251:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.346326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985401 is committed 00002000:00010000:3.0:1789760789.347070:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74108928 -> 74113024 00002000:00010000:3.0:1789760789.347076:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144768 -> 144776 00010000:00010000:3.0:1789760789.347090:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347105:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347115:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347123:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.347128:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347137:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347158:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.347166:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674edcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74108928->74113023] (req 74108928->74113023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.347387:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565546752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7239us (7506us total) trans 4294985401 rc 0/0 00000100:00100000:3.0:1789760789.347399:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18104 00000100:00100000:3.0:1789760789.347410:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727585746981 time 727600423580 state 0x2 ref 0 00000100:00100000:3.0:1789760789.352486:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.352991:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565546880 00000100:00100000:2.0:1789760789.353058:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565546880 00000100:00100000:2.0:1789760789.353127:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727585746981 time 727600423580 state 0x0 ref 1 00000100:00100000:2.0:1789760789.353143:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727600683996 time 727600423580 state 0x1 ref 1 00000100:00100000:2.0:1789760789.353248:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727600683996 time 727613538499 state 0x0 ref 1 00000100:00100000:2.0:1789760789.353262:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.353402:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74113024, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23588 00010000:00010000:2.0:1789760789.353415:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.353432:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.353437:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.353443:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.353457:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.361264:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985402 is committed 00002000:00010000:2.0:1789760789.361495:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74113024 -> 74117120 00002000:00010000:2.0:1789760789.361501:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144776 -> 144784 00010000:00010000:2.0:1789760789.361515:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361527:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361535:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361543:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.361548:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361557:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361577:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.361659:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74113024->74117119] (req 74113024->74117119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.361905:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565546880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8640us (9425us total) trans 4294985402 rc 0/0 00000100:00100000:2.0:1789760789.361919:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18105 00000100:00100000:2.0:1789760789.361930:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727600683996 time 727613538499 state 0x2 ref 0 00000100:00100000:0.0:1789760789.372152:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.372249:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547008 00000100:00100000:2.0:1789760789.372259:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547008 00000100:00100000:2.0:1789760789.372327:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727600683996 time 727613538499 state 0x0 ref 1 00000100:00100000:2.0:1789760789.372343:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727613798915 time 727613538499 state 0x1 ref 1 00000100:00100000:2.0:1789760789.372374:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727613798915 time 727632666484 state 0x0 ref 1 00000100:00100000:2.0:1789760789.372387:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565547008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.372442:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74117120, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23590 00010000:00010000:2.0:1789760789.372451:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.372468:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.372473:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.372479:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.372493:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.377518:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985403 is committed 00002000:00010000:2.0:1789760789.378276:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74117120 -> 74121216 00002000:00010000:2.0:1789760789.378282:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144784 -> 144792 00010000:00010000:2.0:1789760789.378296:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378377:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378386:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378393:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.378398:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378408:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378429:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.378443:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674edd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74117120->74121215] (req 74117120->74121215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.380538:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565547008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8140us (8382us total) trans 4294985403 rc 0/0 00000100:00100000:2.0:1789760789.380553:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18106 00000100:00100000:2.0:1789760789.380564:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727613798915 time 727632666484 state 0x2 ref 0 00000100:00100000:3.0:1789760789.387994:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.388728:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547136 00000100:00100000:2.0:1789760789.388738:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547136 00000100:00100000:2.0:1789760789.388795:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727613798915 time 727632666484 state 0x0 ref 1 00000100:00100000:2.0:1789760789.388810:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727632926900 time 727632666484 state 0x1 ref 1 00000100:00100000:2.0:1789760789.388838:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727632926900 time 727649130096 state 0x0 ref 1 00000100:00100000:2.0:1789760789.388851:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.388900:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74121216, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23598 00010000:00010000:2.0:1789760789.388909:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.388924:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.388928:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.388934:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.388953:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.396303:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985404 is committed 00002000:00010000:2.0:1789760789.397682:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74121216 -> 74125312 00002000:00010000:2.0:1789760789.397697:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144792 -> 144800 00010000:00010000:2.0:1789760789.397734:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397748:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397757:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397765:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.397770:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397779:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397800:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.397808:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ede0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74121216->74125311] (req 74121216->74125311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.397906:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9054us (9925us total) trans 4294985404 rc 0/0 00000100:00100000:2.0:1789760789.397918:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18107 00000100:00100000:2.0:1789760789.397926:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727632926900 time 727649130096 state 0x2 ref 0 00000100:00100000:3.0:1789760789.405079:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.406421:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547264 00000100:00100000:2.0:1789760789.406433:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547264 00000100:00100000:2.0:1789760789.406496:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727632926900 time 727649130096 state 0x0 ref 1 00000100:00100000:2.0:1789760789.406512:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727649390512 time 727649130096 state 0x1 ref 1 00000100:00100000:2.0:1789760789.406531:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727649390512 time 727666823253 state 0x0 ref 1 00000100:00100000:2.0:1789760789.406545:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565547264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.406602:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74125312, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235a0 00010000:00010000:2.0:1789760789.406612:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.406629:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.406633:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.406639:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.406663:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.416625:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985405 is committed 00002000:00010000:3.0:1789760789.416818:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74125312 -> 74129408 00002000:00010000:3.0:1789760789.416823:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144800 -> 144808 00010000:00010000:3.0:1789760789.416837:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416849:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416858:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416865:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.416869:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416878:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416902:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.416909:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674ede7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74125312->74129407] (req 74125312->74129407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.417068:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565547264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10521us (11994us total) trans 4294985405 rc 0/0 00000100:00100000:3.0:1789760789.417079:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18108 00000100:00100000:3.0:1789760789.417088:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727649390512 time 727666823253 state 0x2 ref 0 00000100:00100000:0.0:1789760789.424131:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.424200:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547392 00000100:00100000:2.0:1789760789.424210:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547392 00000100:00100000:2.0:1789760789.424266:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727649390512 time 727666823253 state 0x0 ref 1 00000100:00100000:2.0:1789760789.424292:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727667083669 time 727666823253 state 0x1 ref 1 00000100:00100000:2.0:1789760789.424331:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727667083669 time 727684622861 state 0x0 ref 1 00000100:00100000:2.0:1789760789.424343:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.424390:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74129408, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235a8 00010000:00010000:2.0:1789760789.424399:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.424415:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.424419:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.424425:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.424439:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.435590:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985406 is committed 00002000:00010000:2.0:1789760789.435760:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74129408 -> 74133504 00002000:00010000:2.0:1789760789.435765:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144808 -> 144816 00010000:00010000:2.0:1789760789.435779:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435798:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435807:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435815:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.435820:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435829:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435849:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.435857:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674edee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74129408->74133503] (req 74129408->74133503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.435955:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11608us (11829us total) trans 4294985406 rc 0/0 00000100:00100000:2.0:1789760789.435965:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18109 00000100:00100000:2.0:1789760789.435975:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727667083669 time 727684622861 state 0x2 ref 0 00000100:00100000:0.0:1789760789.440292:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.441467:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547520 00000100:00100000:2.0:1789760789.441480:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547520 00000100:00100000:2.0:1789760789.441538:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727667083669 time 727684622861 state 0x0 ref 1 00000100:00100000:2.0:1789760789.441554:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727684883277 time 727684622861 state 0x1 ref 1 00000100:00100000:2.0:1789760789.441578:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727684883277 time 727701869353 state 0x0 ref 1 00000100:00100000:2.0:1789760789.441591:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565547520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.441640:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74133504, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235b0 00010000:00010000:2.0:1789760789.441660:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.441676:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.441681:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.441687:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.441701:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.452365:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985407 is committed 00002000:00010000:3.0:1789760789.452480:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74133504 -> 74137600 00002000:00010000:3.0:1789760789.452485:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144816 -> 144824 00010000:00010000:3.0:1789760789.452499:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452513:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452522:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452530:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.452535:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452544:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452562:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.452569:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674edf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74133504->74137599] (req 74133504->74137599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.452679:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565547520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11086us (12392us total) trans 4294985407 rc 0/0 00000100:00100000:3.0:1789760789.452698:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18110 00000100:00100000:3.0:1789760789.452743:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727684883277 time 727701869353 state 0x2 ref 0 00000100:00100000:3.0:1789760789.459044:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.459141:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547648 00000100:00100000:1.0:1789760789.460221:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547648 00000100:00100000:1.0:1789760789.460286:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727684883277 time 727701869353 state 0x0 ref 1 00000100:00100000:1.0:1789760789.460301:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727702129769 time 727701869353 state 0x1 ref 1 00000100:00100000:1.0:1789760789.460342:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727702129769 time 727720634025 state 0x0 ref 1 00000100:00100000:1.0:1789760789.460356:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565547648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.460406:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74137600, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235b8 00010000:00010000:1.0:1789760789.460415:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.460432:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.460436:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.460442:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.460467:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.471417:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985408 is committed 00002000:00010000:1.0:1789760789.471539:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74137600 -> 74141696 00002000:00010000:1.0:1789760789.471545:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144824 -> 144832 00010000:00010000:1.0:1789760789.471559:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471571:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471580:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471587:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.471592:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471605:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471624:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.471631:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674edfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74137600->74141695] (req 74137600->74141695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.472438:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565547648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12077us (13396us total) trans 4294985408 rc 0/0 00000100:00100000:1.0:1789760789.472450:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18111 00000100:00100000:1.0:1789760789.472460:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727702129769 time 727720634025 state 0x2 ref 0 00000100:00100000:0.0:1789760789.477842:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.478381:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547776 00000100:00100000:2.0:1789760789.478397:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547776 00000100:00100000:2.0:1789760789.478454:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727702129769 time 727720634025 state 0x0 ref 1 00000100:00100000:2.0:1789760789.478469:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727720894441 time 727720634025 state 0x1 ref 1 00000100:00100000:2.0:1789760789.478502:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727720894441 time 727738794233 state 0x0 ref 1 00000100:00100000:2.0:1789760789.478515:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.478565:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74141696, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235c0 00010000:00010000:2.0:1789760789.478575:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.478590:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.478595:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.478601:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.478614:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.486530:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985409 is committed 00002000:00010000:2.0:1789760789.486658:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74141696 -> 74145792 00002000:00010000:2.0:1789760789.486662:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144832 -> 144840 00010000:00010000:2.0:1789760789.486675:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486688:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486697:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486731:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.486736:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486745:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486769:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.486777:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74141696->74145791] (req 74141696->74145791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.486882:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565547776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8364us (9044us total) trans 4294985409 rc 0/0 00000100:00100000:2.0:1789760789.486892:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18112 00000100:00100000:2.0:1789760789.486902:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727720894441 time 727738794233 state 0x2 ref 0 00000100:00100000:0.0:1789760789.491569:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.492097:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565547904 00000100:00100000:3.0:1789760789.492108:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565547904 00000100:00100000:3.0:1789760789.493522:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727720894441 time 727738794233 state 0x0 ref 1 00000100:00100000:3.0:1789760789.493545:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727739054649 time 727738794233 state 0x1 ref 1 00000100:00100000:3.0:1789760789.493792:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727739054649 time 727754082460 state 0x0 ref 1 00000100:00100000:3.0:1789760789.493818:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565547904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.493871:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74145792, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235c8 00010000:00010000:3.0:1789760789.493882:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.493900:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.493905:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.493911:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.493925:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.500010:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985410 is committed 00002000:00010000:3.0:1789760789.500129:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74145792 -> 74149888 00002000:00010000:3.0:1789760789.500134:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144840 -> 144848 00010000:00010000:3.0:1789760789.500147:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500166:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500174:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500183:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.500188:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500197:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500216:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.500225:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ee0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74145792->74149887] (req 74145792->74149887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.500322:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565547904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6512us (8759us total) trans 4294985410 rc 0/0 00000100:00100000:3.0:1789760789.500334:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18113 00000100:00100000:3.0:1789760789.500343:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727739054649 time 727754082460 state 0x2 ref 0 00000100:00100000:3.0:1789760789.507150:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.507304:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548032 00000100:00100000:1.0:1789760789.507315:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548032 00000100:00100000:1.0:1789760789.507378:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727739054649 time 727754082460 state 0x0 ref 1 00000100:00100000:1.0:1789760789.507397:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727754342876 time 727754082460 state 0x1 ref 1 00000100:00100000:1.0:1789760789.507432:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727754342876 time 727767724421 state 0x0 ref 1 00000100:00100000:1.0:1789760789.507444:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565548032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.507495:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74149888, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235d0 00010000:00010000:1.0:1789760789.507504:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.507522:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.507526:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.507532:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.507546:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.512829:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985411 is committed 00002000:00010000:1.0:1789760789.512946:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74149888 -> 74153984 00002000:00010000:1.0:1789760789.512952:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144848 -> 144856 00010000:00010000:1.0:1789760789.512965:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.512979:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.513103:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.513113:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.513119:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.513133:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.513152:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.513161:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74149888->74153983] (req 74149888->74153983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.513303:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565548032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5855us (6158us total) trans 4294985411 rc 0/0 00000100:00100000:1.0:1789760789.513314:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18114 00000100:00100000:1.0:1789760789.513324:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727754342876 time 727767724421 state 0x2 ref 0 00000100:00100000:0.0:1789760789.523153:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.523299:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548160 00000100:00100000:2.0:1789760789.523310:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548160 00000100:00100000:2.0:1789760789.523364:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727754342876 time 727767724421 state 0x0 ref 1 00000100:00100000:2.0:1789760789.523379:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727767984837 time 727767724421 state 0x1 ref 1 00000100:00100000:2.0:1789760789.523411:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727767984837 time 727783703647 state 0x0 ref 1 00000100:00100000:2.0:1789760789.523423:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565548160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.523478:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74153984, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235d8 00010000:00010000:2.0:1789760789.523489:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.523506:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.523510:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.523516:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.523532:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.528760:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985412 is committed 00002000:00010000:2.0:1789760789.528876:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74153984 -> 74158080 00002000:00010000:2.0:1789760789.528881:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144856 -> 144864 00010000:00010000:2.0:1789760789.528895:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528906:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528915:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528923:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.528929:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528937:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528956:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.528974:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74153984->74158079] (req 74153984->74158079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.529068:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565548160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5640us (5920us total) trans 4294985412 rc 0/0 00000100:00100000:2.0:1789760789.529079:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18115 00000100:00100000:2.0:1789760789.529088:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727767984837 time 727783703647 state 0x2 ref 0 00000100:00100000:0.0:1789760789.535270:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.535365:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548288 00000100:00100000:3.0:1789760789.535375:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548288 00000100:00100000:3.0:1789760789.535434:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727767984837 time 727783703647 state 0x0 ref 1 00000100:00100000:3.0:1789760789.535449:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727783964063 time 727783703647 state 0x1 ref 1 00000100:00100000:3.0:1789760789.535517:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727783964063 time 727795808528 state 0x0 ref 1 00000100:00100000:3.0:1789760789.535531:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.535579:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74158080, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235e0 00010000:00010000:3.0:1789760789.535600:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.535630:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1789760789.535636:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.535654:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.535669:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760789.543537:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985413 is committed 00002000:00010000:3.0:1789760789.543767:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74158080 -> 74162176 00002000:00010000:3.0:1789760789.543772:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144864 -> 144872 00010000:00010000:3.0:1789760789.543785:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.543799:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.543808:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.543817:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.543821:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.543830:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.543992:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.544001:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674ee1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74158080->74162175] (req 74158080->74162175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.544102:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8569us (8837us total) trans 4294985413 rc 0/0 00000100:00100000:3.0:1789760789.544114:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18116 00000100:00100000:3.0:1789760789.544123:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727783964063 time 727795808528 state 0x2 ref 0 00000100:00100000:3.0:1789760789.550469:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.550734:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548416 00000100:00100000:1.0:1789760789.550744:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548416 00000100:00100000:1.0:1789760789.550803:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727783964063 time 727795808528 state 0x0 ref 1 00000100:00100000:1.0:1789760789.550817:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727796068944 time 727795808528 state 0x1 ref 1 00000100:00100000:1.0:1789760789.550854:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727796068944 time 727811146183 state 0x0 ref 1 00000100:00100000:1.0:1789760789.550868:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565548416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.550918:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74162176, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235e8 00010000:00010000:1.0:1789760789.550928:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.550957:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.550962:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.550977:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.550991:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.566326:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985414 is committed 00002000:00010000:1.0:1789760789.568232:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74162176 -> 74166272 00002000:00010000:1.0:1789760789.568242:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144872 -> 144880 00010000:00010000:1.0:1789760789.568256:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568269:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568278:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568285:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.568290:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568302:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568322:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.568331:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74162176->74166271] (req 74162176->74166271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.568429:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565548416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17559us (17968us total) trans 4294985414 rc 0/0 00000100:00100000:1.0:1789760789.568439:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18117 00000100:00100000:1.0:1789760789.568449:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727796068944 time 727811146183 state 0x2 ref 0 00000100:00100000:0.0:1789760789.578835:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.578946:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548544 00000100:00100000:2.0:1789760789.578957:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548544 00000100:00100000:2.0:1789760789.579017:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727796068944 time 727811146183 state 0x0 ref 1 00000100:00100000:2.0:1789760789.579034:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727811406599 time 727811146183 state 0x1 ref 1 00000100:00100000:2.0:1789760789.579069:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727811406599 time 727839360935 state 0x0 ref 1 00000100:00100000:2.0:1789760789.579082:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.579134:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74166272, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235f0 00010000:00010000:2.0:1789760789.579144:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.579280:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.579286:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.579293:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.579309:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.590861:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985415 is committed 00002000:00010000:0.0:1789760789.591037:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74166272 -> 74170368 00002000:00010000:0.0:1789760789.591042:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144880 -> 144888 00010000:00010000:0.0:1789760789.591056:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591069:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591078:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591085:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.591091:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591101:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591122:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.591130:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674ee2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74166272->74170367] (req 74166272->74170367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.591287:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12202us (12456us total) trans 4294985415 rc 0/0 00000100:00100000:0.0:1789760789.591297:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18118 00000100:00100000:0.0:1789760789.591307:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727811406599 time 727839360935 state 0x2 ref 0 00000100:00100000:0.0:1789760789.601803:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.602240:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548672 00000100:00100000:3.0:1789760789.602250:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548672 00000100:00100000:3.0:1789760789.602303:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727811406599 time 727839360935 state 0x0 ref 1 00000100:00100000:3.0:1789760789.602322:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727839621351 time 727839360935 state 0x1 ref 1 00000100:00100000:2.0:1789760789.602428:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727839621351 time 727862716835 state 0x0 ref 1 00000100:00100000:2.0:1789760789.602444:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.602495:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74170368, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x235f8 00010000:00010000:2.0:1789760789.602504:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.602520:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.602524:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.602529:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.602544:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.609838:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985416 is committed 00002000:00010000:2.0:1789760789.610033:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74170368 -> 74174464 00002000:00010000:2.0:1789760789.610039:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144888 -> 144896 00010000:00010000:2.0:1789760789.610053:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610066:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610075:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610083:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.610088:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610096:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610115:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.610123:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74170368->74174463] (req 74170368->74174463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.610278:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7833us (8481us total) trans 4294985416 rc 0/0 00000100:00100000:2.0:1789760789.610288:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18119 00000100:00100000:2.0:1789760789.610297:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727839621351 time 727862716835 state 0x2 ref 0 00000100:00100000:3.0:1789760789.615928:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.616046:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548800 00000100:00100000:1.0:1789760789.616056:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548800 00000100:00100000:1.0:1789760789.616108:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727839621351 time 727862716835 state 0x0 ref 1 00000100:00100000:1.0:1789760789.616122:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727862977251 time 727862716835 state 0x1 ref 1 00000100:00100000:1.0:1789760789.616166:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727862977251 time 727876449655 state 0x0 ref 1 00000100:00100000:1.0:1789760789.616179:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565548800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.616226:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74174464, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23600 00010000:00010000:1.0:1789760789.616235:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.616251:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.616256:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.616261:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.616274:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.625522:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985417 is committed 00002000:00010000:1.0:1789760789.626947:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74174464 -> 74178560 00002000:00010000:1.0:1789760789.626955:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144896 -> 144904 00010000:00010000:1.0:1789760789.626968:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.626981:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.626998:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.627006:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.627011:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.627021:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.627046:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.627054:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74174464->74178559] (req 74174464->74178559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.627164:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565548800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10974us (11234us total) trans 4294985417 rc 0/0 00000100:00100000:1.0:1789760789.627175:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18120 00000100:00100000:1.0:1789760789.627186:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727862977251 time 727876449655 state 0x2 ref 0 00000100:00100000:0.0:1789760789.634169:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.634315:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565548928 00000100:00100000:2.0:1789760789.634325:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565548928 00000100:00100000:2.0:1789760789.634377:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727862977251 time 727876449655 state 0x0 ref 1 00000100:00100000:2.0:1789760789.634393:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727876710071 time 727876449655 state 0x1 ref 1 00000100:00100000:2.0:1789760789.634429:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727876710071 time 727894720504 state 0x0 ref 1 00000100:00100000:2.0:1789760789.634441:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.634489:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74178560, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23608 00010000:00010000:2.0:1789760789.634498:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.634514:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.634519:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.634525:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.634540:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.640631:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985418 is committed 00002000:00010000:0.0:1789760789.640877:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74178560 -> 74182656 00002000:00010000:0.0:1789760789.640882:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144904 -> 144912 00010000:00010000:0.0:1789760789.640896:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.640908:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.640919:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.640926:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.640930:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.640944:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.640961:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.641087:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674ee42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74178560->74182655] (req 74178560->74182655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.641180:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565548928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6736us (7027us total) trans 4294985418 rc 0/0 00000100:00100000:0.0:1789760789.641190:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18121 00000100:00100000:0.0:1789760789.641200:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727876710071 time 727894720504 state 0x2 ref 0 00000100:00100000:0.0:1789760789.647358:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.647435:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549056 00000100:00100000:2.0:1789760789.647446:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549056 00000100:00100000:2.0:1789760789.647504:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727876710071 time 727894720504 state 0x0 ref 1 00000100:00100000:2.0:1789760789.647520:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727894980920 time 727894720504 state 0x1 ref 1 00000100:00100000:2.0:1789760789.647589:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727894980920 time 727907880274 state 0x0 ref 1 00000100:00100000:2.0:1789760789.647602:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565549056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.647669:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74182656, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23610 00010000:00010000:2.0:1789760789.647678:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.647693:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.647697:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.647724:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.647739:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.653783:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985419 is committed 00002000:00010000:2.0:1789760789.653898:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74182656 -> 74186752 00002000:00010000:2.0:1789760789.653905:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144912 -> 144920 00010000:00010000:2.0:1789760789.653919:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.653933:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.653944:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.653951:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.653956:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.653966:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.653997:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.654006:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74182656->74186751] (req 74182656->74186751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.654103:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565549056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6498us (6750us total) trans 4294985419 rc 0/0 00000100:00100000:2.0:1789760789.654114:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18122 00000100:00100000:2.0:1789760789.654124:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727894980920 time 727907880274 state 0x2 ref 0 00000100:00100000:3.0:1789760789.665751:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.666385:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549184 00000100:00100000:1.0:1789760789.666396:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549184 00000100:00100000:1.0:1789760789.666446:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727894980920 time 727907880274 state 0x0 ref 1 00000100:00100000:1.0:1789760789.666458:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727908140690 time 727907880274 state 0x1 ref 1 00000100:00100000:1.0:1789760789.666524:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727908140690 time 727926816189 state 0x0 ref 1 00000100:00100000:1.0:1789760789.666534:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565549184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.666575:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74186752, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23618 00010000:00010000:1.0:1789760789.666584:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.666598:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.666603:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.666608:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.666619:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.672439:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985420 is committed 00002000:00010000:1.0:1789760789.672564:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74186752 -> 74190848 00002000:00010000:1.0:1789760789.672570:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144920 -> 144928 00010000:00010000:1.0:1789760789.672583:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672596:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672605:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672612:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.672618:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672697:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672740:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.672753:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74186752->74190847] (req 74186752->74190847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.672894:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565549184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6355us (7194us total) trans 4294985420 rc 0/0 00000100:00100000:1.0:1789760789.672905:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18123 00000100:00100000:1.0:1789760789.672915:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727908140690 time 727926816189 state 0x2 ref 0 00000100:00100000:0.0:1789760789.678300:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.678442:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549312 00000100:00100000:2.0:1789760789.678451:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549312 00000100:00100000:2.0:1789760789.678507:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727908140690 time 727926816189 state 0x0 ref 1 00000100:00100000:2.0:1789760789.678521:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727927076605 time 727926816189 state 0x1 ref 1 00000100:00100000:2.0:1789760789.679452:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727927076605 time 727939736254 state 0x0 ref 1 00000100:00100000:2.0:1789760789.679474:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565549312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.679525:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74190848, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23620 00010000:00010000:2.0:1789760789.679535:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.679551:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.679555:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.679562:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.679577:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.684840:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985421 is committed 00002000:00010000:2.0:1789760789.684953:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74190848 -> 74194944 00002000:00010000:2.0:1789760789.684959:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144928 -> 144936 00010000:00010000:2.0:1789760789.684972:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.684984:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.684994:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.685006:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.685011:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.685021:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.685051:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.685060:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74190848->74194943] (req 74190848->74194943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.685153:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565549312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5682us (6857us total) trans 4294985421 rc 0/0 00000100:00100000:2.0:1789760789.685162:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18124 00000100:00100000:2.0:1789760789.685170:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727927076605 time 727939736254 state 0x2 ref 0 00000100:00100000:0.0:1789760789.693909:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.695168:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549440 00000100:00100000:2.0:1789760789.695181:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549440 00000100:00100000:2.0:1789760789.695323:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727927076605 time 727939736254 state 0x0 ref 1 00000100:00100000:2.0:1789760789.695339:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727939996670 time 727939736254 state 0x1 ref 1 00000100:00100000:2.0:1789760789.695418:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727939996670 time 727955709602 state 0x0 ref 1 00000100:00100000:2.0:1789760789.695435:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565549440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.695491:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74194944, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23628 00010000:00010000:2.0:1789760789.695501:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.695517:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.695521:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.695528:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.695541:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.704883:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985422 is committed 00002000:00010000:2.0:1789760789.705108:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74194944 -> 74199040 00002000:00010000:2.0:1789760789.705113:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144936 -> 144944 00010000:00010000:2.0:1789760789.705126:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705138:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705147:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705155:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.705160:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705168:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705187:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.705194:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74194944->74199039] (req 74194944->74199039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.705599:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565549440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10161us (11693us total) trans 4294985422 rc 0/0 00000100:00100000:2.0:1789760789.705610:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18125 00000100:00100000:2.0:1789760789.705618:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727939996670 time 727955709602 state 0x2 ref 0 00010000:00010000:1.0:1789760789.708314:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760789.709177:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.709657:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549568 00000100:00100000:1.0:1789760789.709667:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549568 00000100:00100000:1.0:1789760789.712343:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727939996670 time 727955709602 state 0x0 ref 1 00000100:00100000:1.0:1789760789.712503:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727955970018 time 727955709602 state 0x1 ref 1 00000100:00100000:1.0:1789760789.712550:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727955970018 time 727972841760 state 0x0 ref 1 00000100:00100000:1.0:1789760789.712575:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.712952:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74199040, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23630 00010000:00010000:1.0:1789760789.712962:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.712979:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:1.0:1789760789.712984:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.713066:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.713081:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.719557:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985423 is committed 00002000:00010000:1.0:1789760789.719949:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74199040 -> 74203136 00002000:00010000:1.0:1789760789.719955:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144944 -> 144952 00010000:00010000:1.0:1789760789.719967:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.719980:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.720046:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.720054:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.720059:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.720068:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.720087:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.720095:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74199040->74203135] (req 74199040->74203135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.720274:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7708us (11098us total) trans 4294985423 rc 0/0 00000100:00100000:1.0:1789760789.720285:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18126 00000100:00100000:1.0:1789760789.720293:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727955970018 time 727972841760 state 0x2 ref 0 00000100:00100000:0.0:1789760789.724608:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.724733:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549696 00000100:00100000:2.0:1789760789.724742:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549696 00000100:00100000:2.0:1789760789.724790:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727955970018 time 727972841760 state 0x0 ref 1 00000100:00100000:2.0:1789760789.724804:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727973102176 time 727972841760 state 0x1 ref 1 00000100:00100000:2.0:1789760789.724831:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727973102176 time 727985123483 state 0x0 ref 1 00000100:00100000:2.0:1789760789.724842:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.724883:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74203136, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23638 00010000:00010000:2.0:1789760789.724892:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.724908:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.724912:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.724917:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.724931:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.730081:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985424 is committed 00002000:00010000:2.0:1789760789.730437:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74203136 -> 74207232 00002000:00010000:2.0:1789760789.730443:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144952 -> 144960 00010000:00010000:2.0:1789760789.730455:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730468:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730477:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730484:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.730489:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730497:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730517:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.730523:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74203136->74207231] (req 74203136->74207231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.730872:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6026us (6267us total) trans 4294985424 rc 0/0 00000100:00100000:2.0:1789760789.730884:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18127 00000100:00100000:2.0:1789760789.730893:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727973102176 time 727985123483 state 0x2 ref 0 00000100:00100000:0.0:1789760789.735075:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.735276:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549824 00000100:00100000:2.0:1789760789.735286:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549824 00000100:00100000:2.0:1789760789.735339:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727973102176 time 727985123483 state 0x0 ref 1 00000100:00100000:2.0:1789760789.735355:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727985383899 time 727985123483 state 0x1 ref 1 00000100:00100000:2.0:1789760789.735944:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727985383899 time 727996233811 state 0x0 ref 1 00000100:00100000:2.0:1789760789.735961:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565549824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.736019:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74207232, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23640 00010000:00010000:2.0:1789760789.736028:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.736045:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789760789.736050:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.736056:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.736069:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.742446:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985425 is committed 00002000:00010000:1.0:1789760789.742858:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74207232 -> 74211328 00002000:00010000:1.0:1789760789.742863:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144960 -> 144968 00010000:00010000:1.0:1789760789.742878:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742891:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742899:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742907:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.742911:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742919:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742940:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742954:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674ee73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74207232->74211327] (req 74207232->74211327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.743152:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565549824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7191us (8083us total) trans 4294985425 rc 0/0 00000100:00100000:1.0:1789760789.743164:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18128 00000100:00100000:1.0:1789760789.743172:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727985383899 time 727996233811 state 0x2 ref 0 00000100:00100000:0.0:1789760789.748662:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.748832:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565549952 00000100:00100000:1.0:1789760789.748842:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565549952 00000100:00100000:1.0:1789760789.748897:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727985383899 time 727996233811 state 0x0 ref 1 00000100:00100000:1.0:1789760789.748913:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727996494227 time 727996233811 state 0x1 ref 1 00000100:00100000:1.0:1789760789.748977:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727996494227 time 728009268341 state 0x0 ref 1 00000100:00100000:1.0:1789760789.749000:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.749052:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74211328, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23648 00010000:00010000:1.0:1789760789.749061:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.749077:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.749081:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.749089:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.749107:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.755121:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985426 is committed 00002000:00010000:1.0:1789760789.755893:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74211328 -> 74215424 00002000:00010000:1.0:1789760789.755899:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144968 -> 144976 00010000:00010000:1.0:1789760789.755913:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.755985:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.756063:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.756070:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.756075:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.756085:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.756105:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.756113:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74211328->74215423] (req 74211328->74215423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.756320:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565549952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7326us (7729us total) trans 4294985426 rc 0/0 00000100:00100000:1.0:1789760789.756330:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18129 00000100:00100000:1.0:1789760789.756341:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727996494227 time 728009268341 state 0x2 ref 0 00000100:00100000:0.0:1789760789.760890:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.761108:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550080 00000100:00100000:2.0:1789760789.761118:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550080 00000100:00100000:2.0:1789760789.761171:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 727996494227 time 728009268341 state 0x0 ref 1 00000100:00100000:2.0:1789760789.761188:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728009528757 time 728009268341 state 0x1 ref 1 00000100:00100000:2.0:1789760789.761446:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728009528757 time 728021737444 state 0x0 ref 1 00000100:00100000:2.0:1789760789.761460:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.761510:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74215424, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23650 00010000:00010000:2.0:1789760789.761519:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.761534:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.761538:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.761545:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.761559:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.767862:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985427 is committed 00002000:00010000:2.0:1789760789.767978:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74215424 -> 74219520 00002000:00010000:2.0:1789760789.768043:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144976 -> 144984 00010000:00010000:2.0:1789760789.768059:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768072:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768081:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768087:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.768092:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768101:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768120:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.768128:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74215424->74219519] (req 74215424->74219519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.768325:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6863us (7442us total) trans 4294985427 rc 0/0 00000100:00100000:2.0:1789760789.768337:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18130 00000100:00100000:2.0:1789760789.768346:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728009528757 time 728021737444 state 0x2 ref 0 00000100:00100000:0.0:1789760789.779153:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.779247:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550208 00000100:00100000:1.0:1789760789.779256:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550208 00000100:00100000:1.0:1789760789.779306:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728009528757 time 728021737444 state 0x0 ref 1 00000100:00100000:1.0:1789760789.779321:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728021997860 time 728021737444 state 0x1 ref 1 00000100:00100000:1.0:1789760789.779352:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728021997860 time 728039644032 state 0x0 ref 1 00000100:00100000:1.0:1789760789.779374:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.779423:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74219520, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23658 00010000:00010000:1.0:1789760789.779432:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.779448:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.779452:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.779458:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.779471:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.785057:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985428 is committed 00002000:00010000:1.0:1789760789.785298:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74219520 -> 74223616 00002000:00010000:1.0:1789760789.785303:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144984 -> 144992 00010000:00010000:1.0:1789760789.785316:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785330:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785339:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785346:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.785350:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785434:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785457:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.785464:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674ee88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74219520->74223615] (req 74219520->74223615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.785598:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6231us (6449us total) trans 4294985428 rc 0/0 00000100:00100000:1.0:1789760789.785609:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18131 00000100:00100000:1.0:1789760789.785618:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728021997860 time 728039644032 state 0x2 ref 0 00000100:00100000:0.0:1789760789.790986:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.791109:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550336 00000100:00100000:1.0:1789760789.791119:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550336 00000100:00100000:1.0:1789760789.791173:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728021997860 time 728039644032 state 0x0 ref 1 00000100:00100000:1.0:1789760789.791189:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728039904448 time 728039644032 state 0x1 ref 1 00000100:00100000:1.0:1789760789.791224:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728039904448 time 728051515407 state 0x0 ref 1 00000100:00100000:1.0:1789760789.791236:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.791281:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74223616, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23660 00010000:00010000:1.0:1789760789.791290:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.791306:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.791310:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.791315:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.791329:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.795482:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985429 is committed 00002000:00010000:1.0:1789760789.795830:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74223616 -> 74227712 00002000:00010000:1.0:1789760789.795836:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 144992 -> 145000 00010000:00010000:1.0:1789760789.795852:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795865:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795874:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795882:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.795886:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795895:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795915:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.795990:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74223616->74227711] (req 74223616->74227711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.796079:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4840us (5097us total) trans 4294985429 rc 0/0 00000100:00100000:1.0:1789760789.796090:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18132 00000100:00100000:1.0:1789760789.796100:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728039904448 time 728051515407 state 0x2 ref 0 00000100:00100000:0.0:1789760789.803268:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.803456:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550464 00000100:00100000:2.0:1789760789.803465:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550464 00000100:00100000:2.0:1789760789.803518:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728039904448 time 728051515407 state 0x0 ref 1 00000100:00100000:2.0:1789760789.803532:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728051775823 time 728051515407 state 0x1 ref 1 00000100:00100000:2.0:1789760789.803559:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728051775823 time 728063851506 state 0x0 ref 1 00000100:00100000:2.0:1789760789.803571:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.804266:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74227712, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23668 00010000:00010000:2.0:1789760789.804277:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.804292:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.804297:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.804303:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.804317:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.809478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985430 is committed 00002000:00010000:2.0:1789760789.809686:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74227712 -> 74231808 00002000:00010000:2.0:1789760789.809692:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145000 -> 145008 00010000:00010000:2.0:1789760789.809761:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809775:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809784:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809791:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.809797:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809806:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809825:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.809833:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674ee96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74227712->74231807] (req 74227712->74231807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.809962:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6387us (6696us total) trans 4294985430 rc 0/0 00000100:00100000:2.0:1789760789.809973:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18133 00000100:00100000:2.0:1789760789.809982:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728051775823 time 728063851506 state 0x2 ref 0 00000100:00100000:0.0:1789760789.814687:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.814863:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550592 00000100:00100000:1.0:1789760789.814873:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550592 00000100:00100000:1.0:1789760789.814923:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728051775823 time 728063851506 state 0x0 ref 1 00000100:00100000:1.0:1789760789.814937:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728064111922 time 728063851506 state 0x1 ref 1 00000100:00100000:1.0:1789760789.814954:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728064111922 time 728075246661 state 0x0 ref 1 00000100:00100000:1.0:1789760789.814964:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.815020:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74231808, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23670 00010000:00010000:1.0:1789760789.815029:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.815044:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.815048:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.815054:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.815066:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.819527:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985431 is committed 00002000:00010000:1.0:1789760789.819777:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74231808 -> 74235904 00002000:00010000:1.0:1789760789.819783:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145008 -> 145016 00010000:00010000:1.0:1789760789.819799:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819826:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819836:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819843:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.819848:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819856:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819873:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.819879:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674ee9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74231808->74235903] (req 74231808->74235903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.819967:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565550592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4999us (5285us total) trans 4294985431 rc 0/0 00000100:00100000:1.0:1789760789.819977:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18134 00000100:00100000:1.0:1789760789.819986:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728064111922 time 728075246661 state 0x2 ref 0 00000100:00100000:0.0:1789760789.822801:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.822961:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550720 00000100:00100000:1.0:1789760789.822970:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550720 00000100:00100000:1.0:1789760789.823025:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728064111922 time 728075246661 state 0x0 ref 1 00000100:00100000:1.0:1789760789.823040:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728075507077 time 728075246661 state 0x1 ref 1 00000100:00100000:1.0:1789760789.823070:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728075507077 time 728083361882 state 0x0 ref 1 00000100:00100000:1.0:1789760789.823082:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.823129:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74235904, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23678 00010000:00010000:1.0:1789760789.823139:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.823164:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.823170:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.823176:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.823189:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.828282:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985432 is committed 00002000:00010000:1.0:1789760789.828824:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74235904 -> 74240000 00002000:00010000:1.0:1789760789.828830:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145016 -> 145024 00010000:00010000:1.0:1789760789.828843:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828857:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828933:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828942:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.828947:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828956:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828975:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.828984:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74235904->74239999] (req 74235904->74239999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.829114:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6029us (6317us total) trans 4294985432 rc 0/0 00000100:00100000:1.0:1789760789.829123:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18135 00000100:00100000:1.0:1789760789.829133:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728075507077 time 728083361882 state 0x2 ref 0 00000100:00100000:0.0:1789760789.833321:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.833946:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550848 00000100:00100000:2.0:1789760789.833956:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550848 00000100:00100000:2.0:1789760789.834256:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728075507077 time 728083361882 state 0x0 ref 1 00000100:00100000:2.0:1789760789.834271:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728083622298 time 728083361882 state 0x1 ref 1 00000100:00100000:2.0:1789760789.834293:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728083622298 time 728094585959 state 0x0 ref 1 00000100:00100000:2.0:1789760789.834306:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.834354:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74240000, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23680 00010000:00010000:2.0:1789760789.834365:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.834382:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.834387:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.834393:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.834949:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.840789:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985433 is committed 00002000:00010000:0.0:1789760789.841052:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74240000 -> 74244096 00002000:00010000:0.0:1789760789.841058:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145024 -> 145032 00010000:00010000:0.0:1789760789.841072:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841085:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841095:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841103:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.841108:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841116:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841135:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.841143:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674eeab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74240000->74244095] (req 74240000->74244095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.841362:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7054us (8044us total) trans 4294985433 rc 0/0 00000100:00100000:0.0:1789760789.841373:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18136 00000100:00100000:0.0:1789760789.841382:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728083622298 time 728094585959 state 0x2 ref 0 00000100:00100000:0.0:1789760789.845336:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.845435:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565550976 00000100:00100000:1.0:1789760789.845445:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565550976 00000100:00100000:1.0:1789760789.845503:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728083622298 time 728094585959 state 0x0 ref 1 00000100:00100000:1.0:1789760789.845518:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728094846375 time 728094585959 state 0x1 ref 1 00000100:00100000:1.0:1789760789.845551:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728094846375 time 728105842806 state 0x0 ref 1 00000100:00100000:1.0:1789760789.845564:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.845610:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74244096, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23688 00010000:00010000:1.0:1789760789.845619:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.845635:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.845649:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.845656:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.845671:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.853623:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985434 is committed 00002000:00010000:1.0:1789760789.856697:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74244096 -> 74248192 00002000:00010000:1.0:1789760789.856859:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145032 -> 145040 00010000:00010000:1.0:1789760789.856876:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.856890:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.856900:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.856912:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.856917:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.856926:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.858229:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.858251:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74244096->74248191] (req 74244096->74248191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.858434:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565550976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12867us (13103us total) trans 4294985434 rc 0/0 00000100:00100000:1.0:1789760789.858445:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18137 00000100:00100000:1.0:1789760789.858454:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728094846375 time 728105842806 state 0x2 ref 0 00000100:00100000:3.0:1789760789.868792:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.868957:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551104 00000100:00100000:1.0:1789760789.868966:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551104 00000100:00100000:1.0:1789760789.869028:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728094846375 time 728105842806 state 0x0 ref 1 00000100:00100000:1.0:1789760789.869044:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728106103222 time 728105842806 state 0x1 ref 1 00000100:00100000:1.0:1789760789.869064:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728106103222 time 728129356844 state 0x0 ref 1 00000100:00100000:1.0:1789760789.869078:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.869123:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74248192, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23690 00010000:00010000:1.0:1789760789.869132:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.869149:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.869153:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.869169:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.869183:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.875112:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985435 is committed 00002000:00010000:1.0:1789760789.875332:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74248192 -> 74252288 00002000:00010000:1.0:1789760789.875337:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145040 -> 145048 00010000:00010000:1.0:1789760789.875349:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875361:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875371:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875378:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.875383:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875392:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875465:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.875473:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eeb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74248192->74252287] (req 74248192->74252287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.875892:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6810us (7102us total) trans 4294985435 rc 0/0 00000100:00100000:1.0:1789760789.875902:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18138 00000100:00100000:1.0:1789760789.875910:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728106103222 time 728129356844 state 0x2 ref 0 00000100:00100000:0.0:1789760789.884069:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.884285:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551232 00000100:00100000:2.0:1789760789.884296:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551232 00000100:00100000:2.0:1789760789.884352:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728106103222 time 728129356844 state 0x0 ref 1 00000100:00100000:2.0:1789760789.884493:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728129617260 time 728129356844 state 0x1 ref 1 00000100:00100000:2.0:1789760789.884623:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728129617260 time 728144913030 state 0x0 ref 1 00000100:00100000:2.0:1789760789.884637:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565551232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.884730:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74252288, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x23698 00010000:00010000:2.0:1789760789.884740:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.884754:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.884758:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.884764:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.884778:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760789.890161:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985436 is committed 00002000:00010000:2.0:1789760789.890364:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74252288 -> 74256384 00002000:00010000:2.0:1789760789.890370:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145048 -> 145056 00010000:00010000:2.0:1789760789.890381:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890393:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890857:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890865:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.890870:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890880:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890901:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.890908:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eec0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74252288->74256383] (req 74252288->74256383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.891618:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565551232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6976us (7550us total) trans 4294985436 rc 0/0 00000100:00100000:2.0:1789760789.891631:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18139 00000100:00100000:2.0:1789760789.891650:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728129617260 time 728144913030 state 0x2 ref 0 00000100:00100000:0.0:1789760789.903568:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.903771:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551360 00000100:00100000:1.0:1789760789.903781:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551360 00000100:00100000:1.0:1789760789.903834:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728129617260 time 728144913030 state 0x0 ref 1 00000100:00100000:1.0:1789760789.903849:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728145173446 time 728144913030 state 0x1 ref 1 00000100:00100000:1.0:1789760789.903883:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728145173446 time 728164174541 state 0x0 ref 1 00000100:00100000:1.0:1789760789.903895:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760789.903948:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74256384, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x236a0 00010000:00010000:1.0:1789760789.903959:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.903976:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760789.903980:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.903986:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.904269:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.915015:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985437 is committed 00002000:00010000:1.0:1789760789.915172:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74256384 -> 74260480 00002000:00010000:1.0:1789760789.915177:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145056 -> 145064 00010000:00010000:1.0:1789760789.915189:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915201:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915211:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915218:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.915223:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915232:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915249:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.915257:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674eec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74256384->74260479] (req 74256384->74260479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.915340:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11443us (11778us total) trans 4294985437 rc 0/0 00000100:00100000:1.0:1789760789.915350:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18140 00000100:00100000:1.0:1789760789.915360:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728145173446 time 728164174541 state 0x2 ref 0 00000100:00100000:3.0:1789760789.927250:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760789.928143:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551488 00000100:00100000:1.0:1789760789.928218:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551488 00000100:00100000:0.0:1789760789.928406:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728145173446 time 728164174541 state 0x0 ref 1 00000100:00100000:0.0:1789760789.928421:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728164434957 time 728164174541 state 0x1 ref 1 00000100:00100000:0.0:1789760789.928503:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728164434957 time 728188794430 state 0x0 ref 1 00000100:00100000:0.0:1789760789.928518:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760789.928571:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74260480, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0x236a8 00010000:00010000:0.0:1789760789.928581:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.928598:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760789.928602:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.928608:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.928627:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.935769:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985438 is committed 00002000:00010000:3.0:1789760789.936017:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74260480 -> 74264576 00002000:00010000:3.0:1789760789.936022:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760789 -> 1789760790 00002000:00010000:3.0:1789760789.936025:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760789 -> 1789760790 00002000:00010000:3.0:1789760789.936027:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145064 -> 145072 00010000:00010000:3.0:1789760789.936041:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936055:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936064:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936071:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760789.936076:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936084:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936109:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.936118:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674eece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74260480->74264575] (req 74260480->74264575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760789.936220:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7702us (8975us total) trans 4294985438 rc 0/0 00000100:00100000:3.0:1789760789.936230:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18141 00000100:00100000:3.0:1789760789.936240:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728164434957 time 728188794430 state 0x2 ref 0 00000100:00100000:0.0:1789760789.940529:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.943038:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551616 00000100:00100000:2.0:1789760789.943052:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551616 00000100:00100000:2.0:1789760789.943116:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728164434957 time 728188794430 state 0x0 ref 1 00000100:00100000:2.0:1789760789.943133:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728189054846 time 728188794430 state 0x1 ref 1 00000100:00100000:2.0:1789760789.943171:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728189054846 time 728203462331 state 0x0 ref 1 00000100:00100000:2.0:1789760789.943185:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.943232:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74264576, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236b0 00010000:00010000:2.0:1789760789.943242:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.943258:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.943263:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.943269:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.943284:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.949768:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985439 is committed 00002000:00010000:2.0:1789760789.949949:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74264576 -> 74268672 00002000:00010000:2.0:1789760789.949954:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145072 -> 145080 00010000:00010000:2.0:1789760789.949968:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.949981:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.949999:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.950011:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760789.950016:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.950025:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.950044:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.950052:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74264576->74268671] (req 74264576->74268671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.950143:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565551616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6957us (9619us total) trans 4294985439 rc 0/0 00000100:00100000:2.0:1789760789.950154:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18142 00000100:00100000:2.0:1789760789.950163:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728189054846 time 728203462331 state 0x2 ref 0 00000100:00100000:1.0:1789760789.955843:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.955967:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551744 00000100:00100000:3.0:1789760789.955977:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551744 00000100:00100000:3.0:1789760789.956043:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728189054846 time 728203462331 state 0x0 ref 1 00000100:00100000:3.0:1789760789.956058:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728203722747 time 728203462331 state 0x1 ref 1 00000100:00100000:3.0:1789760789.956088:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728203722747 time 728216379769 state 0x0 ref 1 00000100:00100000:3.0:1789760789.956101:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.956152:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74268672, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236b8 00010000:00010000:3.0:1789760789.956172:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.956194:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1789760789.956198:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.956204:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.956218:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.961904:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985440 is committed 00002000:00010000:1.0:1789760789.962151:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74268672 -> 74272768 00002000:00010000:1.0:1789760789.962234:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145080 -> 145088 00010000:00010000:1.0:1789760789.962249:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962264:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962275:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962283:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760789.962290:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962300:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962320:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.962328:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674eedc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74268672->74272767] (req 74268672->74272767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.962495:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6390us (6657us total) trans 4294985440 rc 0/0 00000100:00100000:1.0:1789760789.962507:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18143 00000100:00100000:1.0:1789760789.962517:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728203722747 time 728216379769 state 0x2 ref 0 00000100:00100000:3.0:1789760789.967258:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760789.967388:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565551872 00000100:00100000:0.0:1789760789.967397:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565551872 00000100:00100000:0.0:1789760789.967450:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728203722747 time 728216379769 state 0x0 ref 1 00000100:00100000:0.0:1789760789.967466:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728216640185 time 728216379769 state 0x1 ref 1 00000100:00100000:0.0:1789760789.967499:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728216640185 time 728227790845 state 0x0 ref 1 00000100:00100000:0.0:1789760789.967512:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760789.967570:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74272768, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236c0 00010000:00010000:0.0:1789760789.967589:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.967605:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760789.967609:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.967616:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.967630:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760789.973302:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985441 is committed 00002000:00010000:0.0:1789760789.974794:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74272768 -> 74276864 00002000:00010000:0.0:1789760789.974804:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145088 -> 145096 00010000:00010000:0.0:1789760789.974818:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974828:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974842:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974853:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.974858:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974867:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974887:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.974895:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674eee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74272768->74276863] (req 74272768->74276863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.975782:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565551872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7476us (7736us total) trans 4294985441 rc 0/0 00000100:00100000:0.0:1789760789.975796:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18144 00000100:00100000:0.0:1789760789.975807:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728216640185 time 728227790845 state 0x2 ref 0 00000100:00100000:0.0:1789760789.978411:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760789.978698:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552000 00000100:00100000:2.0:1789760789.978736:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552000 00000100:00100000:2.0:1789760789.978790:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728216640185 time 728227790845 state 0x0 ref 1 00000100:00100000:2.0:1789760789.978806:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728228051261 time 728227790845 state 0x1 ref 1 00000100:00100000:2.0:1789760789.978836:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728228051261 time 728239127626 state 0x0 ref 1 00000100:00100000:2.0:1789760789.978852:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760789.978905:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74276864, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236c8 00010000:00010000:2.0:1789760789.978915:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.978930:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760789.978935:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760789.978941:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.978955:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760789.984300:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985442 is committed 00002000:00010000:0.0:1789760789.984530:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74276864 -> 74280960 00002000:00010000:0.0:1789760789.984535:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145096 -> 145104 00010000:00010000:0.0:1789760789.984548:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984562:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984571:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984580:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760789.984585:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984594:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984614:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.984623:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eeea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74276864->74280959] (req 74276864->74280959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.985492:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6635us (7080us total) trans 4294985442 rc 0/0 00000100:00100000:0.0:1789760789.985504:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18145 00000100:00100000:0.0:1789760789.985514:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728228051261 time 728239127626 state 0x2 ref 0 00000100:00100000:1.0:1789760789.992518:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760789.992617:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552128 00000100:00100000:3.0:1789760789.992627:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552128 00000100:00100000:3.0:1789760789.992697:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728228051261 time 728239127626 state 0x0 ref 1 00000100:00100000:3.0:1789760789.992772:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728239388042 time 728239127626 state 0x1 ref 1 00000100:00100000:3.0:1789760789.992795:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728239388042 time 728253088255 state 0x0 ref 1 00000100:00100000:3.0:1789760789.992808:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760789.992856:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74280960, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236d0 00010000:00010000:3.0:1789760789.992866:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.992881:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1789760789.992887:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760789.992894:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760789.992910:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.001161:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985443 is committed 00002000:00010000:1.0:1789760790.010096:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74280960 -> 74285056 00002000:00010000:1.0:1789760790.010105:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145104 -> 145112 00010000:00010000:1.0:1789760790.010119:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010132:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010140:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010149:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.010153:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010161:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010180:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.010188:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674eef1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74280960->74285055] (req 74280960->74285055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.010276:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17467us (17764us total) trans 4294985443 rc 0/0 00000100:00100000:1.0:1789760790.010286:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18146 00000100:00100000:1.0:1789760790.010296:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728239388042 time 728253088255 state 0x2 ref 0 00000100:00100000:2.0:1789760790.019361:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.019548:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552256 00000100:00100000:0.0:1789760790.019559:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552256 00000100:00100000:0.0:1789760790.019694:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728239388042 time 728253088255 state 0x0 ref 1 00000100:00100000:0.0:1789760790.019762:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728253348671 time 728253088255 state 0x1 ref 1 00000100:00100000:0.0:1789760790.019793:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728253348671 time 728280084623 state 0x0 ref 1 00000100:00100000:0.0:1789760790.019808:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.019854:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74285056, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236d8 00010000:00010000:0.0:1789760790.019864:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.019893:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.019898:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.019905:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.019920:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760790.020771:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760790.025823:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985444 is committed 00002000:00010000:0.0:1789760790.026020:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74285056 -> 74289152 00002000:00010000:0.0:1789760790.026025:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145112 -> 145120 00010000:00010000:0.0:1789760790.026185:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026199:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026208:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026216:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.026221:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026230:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026498:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.026506:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674eef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74285056->74289151] (req 74285056->74289151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.026606:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6798us (7249us total) trans 4294985444 rc 0/0 00000100:00100000:0.0:1789760790.026618:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18147 00000100:00100000:0.0:1789760790.026628:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728253348671 time 728280084623 state 0x2 ref 0 00000100:00100000:0.0:1789760790.032345:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.032449:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552384 00000100:00100000:2.0:1789760790.032459:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552384 00000100:00100000:2.0:1789760790.032513:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728253348671 time 728280084623 state 0x0 ref 1 00000100:00100000:2.0:1789760790.032528:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728280345039 time 728280084623 state 0x1 ref 1 00000100:00100000:2.0:1789760790.032565:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728280345039 time 728292857384 state 0x0 ref 1 00000100:00100000:2.0:1789760790.032589:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.032649:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74289152, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236e0 00010000:00010000:2.0:1789760790.032660:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.032675:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.032679:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.032686:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.032701:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.038998:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985445 is committed 00002000:00010000:2.0:1789760790.039156:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74289152 -> 74293248 00002000:00010000:2.0:1789760790.039162:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145120 -> 145128 00010000:00010000:2.0:1789760790.039175:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039187:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039196:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039203:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.039208:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039217:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039247:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.039256:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674eeff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74289152->74293247] (req 74289152->74293247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.039351:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6771us (7011us total) trans 4294985445 rc 0/0 00000100:00100000:2.0:1789760790.039361:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18148 00000100:00100000:2.0:1789760790.039371:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728280345039 time 728292857384 state 0x2 ref 0 00000100:00100000:1.0:1789760790.045330:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760790.045441:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552512 00000100:00100000:3.0:1789760790.045450:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552512 00000100:00100000:3.0:1789760790.045508:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728280345039 time 728292857384 state 0x0 ref 1 00000100:00100000:3.0:1789760790.045524:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728293117800 time 728292857384 state 0x1 ref 1 00000100:00100000:3.0:1789760790.045596:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728293117800 time 728305887187 state 0x0 ref 1 00000100:00100000:3.0:1789760790.045609:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760790.045671:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74293248, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236e8 00010000:00010000:3.0:1789760790.045680:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.045696:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1789760790.045700:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760790.045723:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.045737:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.053561:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985446 is committed 00002000:00010000:3.0:1789760790.053765:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74293248 -> 74297344 00002000:00010000:3.0:1789760790.053771:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145128 -> 145136 00010000:00010000:3.0:1789760790.053785:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053799:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053808:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053815:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760790.053820:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053828:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053849:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.053857:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674ef06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74293248->74297343] (req 74293248->74297343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760790.053958:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8346us (8634us total) trans 4294985446 rc 0/0 00000100:00100000:3.0:1789760790.053969:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18149 00000100:00100000:3.0:1789760790.053979:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728293117800 time 728305887187 state 0x2 ref 0 00000100:00100000:0.0:1789760790.058100:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760790.058214:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552640 00000100:00100000:3.0:1789760790.058224:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552640 00000100:00100000:3.0:1789760790.058278:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728293117800 time 728305887187 state 0x0 ref 1 00000100:00100000:3.0:1789760790.058294:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728306147603 time 728305887187 state 0x1 ref 1 00000100:00100000:3.0:1789760790.058329:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728306147603 time 728318620099 state 0x0 ref 1 00000100:00100000:3.0:1789760790.058343:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760790.058389:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74297344, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236f0 00010000:00010000:3.0:1789760790.058399:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.058414:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1789760790.058418:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760790.058424:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.058437:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.063170:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985447 is committed 00002000:00010000:3.0:1789760790.063297:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74297344 -> 74301440 00002000:00010000:3.0:1789760790.063302:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145136 -> 145144 00010000:00010000:3.0:1789760790.063316:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063330:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063338:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063345:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760790.063350:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063360:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063379:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.063387:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74297344->74301439] (req 74297344->74301439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760790.063618:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5273us (5524us total) trans 4294985447 rc 0/0 00000100:00100000:3.0:1789760790.063629:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18150 00000100:00100000:3.0:1789760790.063647:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728306147603 time 728318620099 state 0x2 ref 0 00000100:00100000:0.0:1789760790.068659:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.068858:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552768 00000100:00100000:2.0:1789760790.068868:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552768 00000100:00100000:2.0:1789760790.068931:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728306147603 time 728318620099 state 0x0 ref 1 00000100:00100000:2.0:1789760790.068946:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728318880515 time 728318620099 state 0x1 ref 1 00000100:00100000:2.0:1789760790.068979:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728318880515 time 728329271292 state 0x0 ref 1 00000100:00100000:2.0:1789760790.068997:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.069045:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74301440, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x236f8 00010000:00010000:2.0:1789760790.069055:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.069070:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.069075:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.069081:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.069095:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.073474:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985448 is committed 00002000:00010000:2.0:1789760790.073690:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74301440 -> 74305536 00002000:00010000:2.0:1789760790.073695:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145144 -> 145152 00010000:00010000:2.0:1789760790.073766:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073780:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073790:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073797:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.073802:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073811:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073831:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.073844:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74301440->74305535] (req 74301440->74305535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.074118:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565552768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5119us (5474us total) trans 4294985448 rc 0/0 00000100:00100000:2.0:1789760790.074130:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18151 00000100:00100000:2.0:1789760790.074140:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728318880515 time 728329271292 state 0x2 ref 0 00000100:00100000:1.0:1789760790.080381:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760790.080793:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565552896 00000100:00100000:3.0:1789760790.080804:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565552896 00000100:00100000:3.0:1789760790.080858:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728318880515 time 728329271292 state 0x0 ref 1 00000100:00100000:3.0:1789760790.080874:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728329531708 time 728329271292 state 0x1 ref 1 00000100:00100000:3.0:1789760790.080906:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728329531708 time 728341197655 state 0x0 ref 1 00000100:00100000:3.0:1789760790.080920:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760790.080967:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74305536, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23700 00010000:00010000:3.0:1789760790.080975:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.081002:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1789760790.081006:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760790.081013:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.081026:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.090103:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985449 is committed 00002000:00010000:2.0:1789760790.107332:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74305536 -> 74309632 00002000:00010000:2.0:1789760790.107341:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145152 -> 145160 00010000:00010000:2.0:1789760790.107355:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107368:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107377:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107385:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.107389:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107399:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107424:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.107431:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674ef1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74305536->74309631] (req 74305536->74309631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.107534:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565552896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 26613us (27159us total) trans 4294985449 rc 0/0 00000100:00100000:2.0:1789760790.107547:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18152 00000100:00100000:2.0:1789760790.107556:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728329531708 time 728341197655 state 0x2 ref 0 00000100:00100000:0.0:1789760790.117566:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.117962:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553024 00000100:00100000:2.0:1789760790.117972:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553024 00000100:00100000:2.0:1789760790.118040:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728329531708 time 728341197655 state 0x0 ref 1 00000100:00100000:2.0:1789760790.118056:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728341458071 time 728341197655 state 0x1 ref 1 00000100:00100000:2.0:1789760790.118078:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728341458071 time 728378369318 state 0x0 ref 1 00000100:00100000:2.0:1789760790.118089:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.118137:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74309632, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23708 00010000:00010000:2.0:1789760790.118147:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.118164:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.118169:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.118175:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.118189:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.123215:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985450 is committed 00002000:00010000:2.0:1789760790.123324:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74309632 -> 74313728 00002000:00010000:2.0:1789760790.123329:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145160 -> 145168 00010000:00010000:2.0:1789760790.123343:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123357:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123366:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123374:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.123378:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123387:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123407:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.123421:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74309632->74313727] (req 74309632->74313727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.123674:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5581us (6112us total) trans 4294985450 rc 0/0 00000100:00100000:2.0:1789760790.123685:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18153 00000100:00100000:2.0:1789760790.123694:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728341458071 time 728378369318 state 0x2 ref 0 00000100:00100000:0.0:1789760790.135342:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.135871:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553152 00000100:00100000:2.0:1789760790.135882:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553152 00000100:00100000:0.0:1789760790.136090:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728341458071 time 728378369318 state 0x0 ref 1 00000100:00100000:0.0:1789760790.136105:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728378629734 time 728378369318 state 0x1 ref 1 00000100:00100000:0.0:1789760790.136141:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728378629734 time 728396433090 state 0x0 ref 1 00000100:00100000:0.0:1789760790.136154:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.136202:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74313728, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23710 00010000:00010000:0.0:1789760790.136211:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.136227:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.136231:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.136237:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.136252:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.142056:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985451 is committed 00002000:00010000:0.0:1789760790.142331:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74313728 -> 74317824 00002000:00010000:0.0:1789760790.142337:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145168 -> 145176 00010000:00010000:0.0:1789760790.142350:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142363:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142372:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142379:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.142384:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142393:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142413:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.142420:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74313728->74317823] (req 74313728->74317823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.142569:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6412us (7232us total) trans 4294985451 rc 0/0 00000100:00100000:0.0:1789760790.142590:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18154 00000100:00100000:0.0:1789760790.142600:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728378629734 time 728396433090 state 0x2 ref 0 00000100:00100000:1.0:1789760790.152076:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.152475:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553280 00000100:00100000:2.0:1789760790.152486:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553280 00000100:00100000:2.0:1789760790.152540:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728378629734 time 728396433090 state 0x0 ref 1 00000100:00100000:2.0:1789760790.152555:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728396693506 time 728396433090 state 0x1 ref 1 00000100:00100000:2.0:1789760790.152588:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728396693506 time 728412880180 state 0x0 ref 1 00000100:00100000:2.0:1789760790.152610:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.152676:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74317824, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23718 00010000:00010000:2.0:1789760790.152686:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.152701:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.152749:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.152757:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.152771:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.159397:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985452 is committed 00002000:00010000:2.0:1789760790.159672:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74317824 -> 74321920 00002000:00010000:2.0:1789760790.159678:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145176 -> 145184 00010000:00010000:2.0:1789760790.159692:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159736:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159746:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159753:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.159758:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159768:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159787:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.159800:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74317824->74321919] (req 74317824->74321919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.159950:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7346us (7879us total) trans 4294985452 rc 0/0 00000100:00100000:2.0:1789760790.159961:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18155 00000100:00100000:2.0:1789760790.159971:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728396693506 time 728412880180 state 0x2 ref 0 00000100:00100000:2.0:1789760790.171541:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.171656:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553408 00000100:00100000:0.0:1789760790.171666:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553408 00000100:00100000:0.0:1789760790.171755:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728396693506 time 728412880180 state 0x0 ref 1 00000100:00100000:0.0:1789760790.171771:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728413140596 time 728412880180 state 0x1 ref 1 00000100:00100000:0.0:1789760790.171792:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728413140596 time 728432084900 state 0x0 ref 1 00000100:00100000:0.0:1789760790.171805:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565553408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.171852:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74321920, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23720 00010000:00010000:0.0:1789760790.171862:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.171875:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.171880:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.171886:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.171899:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.177523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985453 is committed 00002000:00010000:2.0:1789760790.178006:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74321920 -> 74326016 00002000:00010000:2.0:1789760790.178012:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145184 -> 145192 00010000:00010000:2.0:1789760790.178027:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178040:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178050:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178058:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.178063:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178073:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178093:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.178101:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674ef37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74321920->74326015] (req 74321920->74326015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.178195:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565553408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6389us (6658us total) trans 4294985453 rc 0/0 00000100:00100000:2.0:1789760790.189090:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18156 00000100:00100000:2.0:1789760790.189118:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728413140596 time 728432084900 state 0x2 ref 0 00000100:00100000:2.0:1789760790.189893:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.189967:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553536 00000100:00100000:1.0:1789760790.189975:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553536 00000100:00100000:1.0:1789760790.190027:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728413140596 time 728432084900 state 0x0 ref 1 00000100:00100000:1.0:1789760790.190042:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728432345316 time 728432084900 state 0x1 ref 1 00000100:00100000:1.0:1789760790.190070:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728432345316 time 728450362560 state 0x0 ref 1 00000100:00100000:1.0:1789760790.190082:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565553536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.190129:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74326016, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23728 00010000:00010000:1.0:1789760790.190139:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.190154:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.190159:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.190167:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.190180:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.197888:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985454 is committed 00002000:00010000:1.0:1789760790.198110:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74326016 -> 74330112 00002000:00010000:1.0:1789760790.198116:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145192 -> 145200 00010000:00010000:1.0:1789760790.198129:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198143:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198152:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198160:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.198165:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198173:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198194:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.198202:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74326016->74330111] (req 74326016->74330111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.198430:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565553536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8343us (8535us total) trans 4294985454 rc 0/0 00000100:00100000:1.0:1789760790.198440:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18157 00000100:00100000:1.0:1789760790.198451:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728432345316 time 728450362560 state 0x2 ref 0 00000100:00100000:0.0:1789760790.208086:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.208850:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553664 00000100:00100000:2.0:1789760790.208863:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553664 00000100:00100000:2.0:1789760790.209002:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728432345316 time 728450362560 state 0x0 ref 1 00000100:00100000:2.0:1789760790.209018:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728450622976 time 728450362560 state 0x1 ref 1 00000100:00100000:2.0:1789760790.209092:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728450622976 time 728469383867 state 0x0 ref 1 00000100:00100000:2.0:1789760790.209108:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565553664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.209156:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74330112, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23730 00010000:00010000:2.0:1789760790.209165:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.209198:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.209202:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.209207:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.209221:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.217107:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985455 is committed 00002000:00010000:2.0:1789760790.217226:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74330112 -> 74334208 00002000:00010000:2.0:1789760790.217231:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145200 -> 145208 00010000:00010000:2.0:1789760790.217244:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217258:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217268:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217276:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.217281:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217289:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217314:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.217322:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74330112->74334207] (req 74330112->74334207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.217445:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565553664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8336us (9365us total) trans 4294985455 rc 0/0 00000100:00100000:2.0:1789760790.217457:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18158 00000100:00100000:2.0:1789760790.217466:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728450622976 time 728469383867 state 0x2 ref 0 00000100:00100000:3.0:1789760790.223180:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.223261:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553792 00000100:00100000:2.0:1789760790.223271:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553792 00000100:00100000:2.0:1789760790.223326:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728450622976 time 728469383867 state 0x0 ref 1 00000100:00100000:2.0:1789760790.223341:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728469644283 time 728469383867 state 0x1 ref 1 00000100:00100000:2.0:1789760790.223388:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728469644283 time 728483679251 state 0x0 ref 1 00000100:00100000:2.0:1789760790.223401:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.223451:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74334208, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23738 00010000:00010000:2.0:1789760790.223461:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.223477:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.223482:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.223488:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.223502:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.228571:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985456 is committed 00002000:00010000:0.0:1789760790.228816:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74334208 -> 74338304 00002000:00010000:0.0:1789760790.228821:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145208 -> 145216 00010000:00010000:0.0:1789760790.228834:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228847:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228856:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228863:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.228869:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228878:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228900:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.228908:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674ef4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74334208->74338303] (req 74334208->74338303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.229146:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565553792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5741us (5984us total) trans 4294985456 rc 0/0 00000100:00100000:0.0:1789760790.229157:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18159 00000100:00100000:0.0:1789760790.229166:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728469644283 time 728483679251 state 0x2 ref 0 00000100:00100000:3.0:1789760790.237202:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.237313:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565553920 00000100:00100000:1.0:1789760790.237325:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565553920 00000100:00100000:1.0:1789760790.237378:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728469644283 time 728483679251 state 0x0 ref 1 00000100:00100000:1.0:1789760790.237393:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728483939667 time 728483679251 state 0x1 ref 1 00000100:00100000:1.0:1789760790.237543:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728483939667 time 728497832537 state 0x0 ref 1 00000100:00100000:1.0:1789760790.237556:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565553920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.237614:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74338304, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23740 00010000:00010000:1.0:1789760790.237624:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.237648:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.237652:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.237658:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.237673:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.243846:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985457 is committed 00002000:00010000:0.0:1789760790.254997:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74338304 -> 74342400 00002000:00010000:0.0:1789760790.255006:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145216 -> 145224 00010000:00010000:0.0:1789760790.255019:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255032:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255041:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255049:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.255054:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255063:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255082:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.255096:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674ef53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74338304->74342399] (req 74338304->74342399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.255193:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565553920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17635us (17996us total) trans 4294985457 rc 0/0 00000100:00100000:0.0:1789760790.255203:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18160 00000100:00100000:0.0:1789760790.255212:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728483939667 time 728497832537 state 0x2 ref 0 00000100:00100000:2.0:1789760790.263526:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.263677:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554048 00000100:00100000:0.0:1789760790.263687:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554048 00000100:00100000:0.0:1789760790.263799:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728483939667 time 728497832537 state 0x0 ref 1 00000100:00100000:0.0:1789760790.263816:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728498092953 time 728497832537 state 0x1 ref 1 00000100:00100000:0.0:1789760790.263839:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728498092953 time 728524131588 state 0x0 ref 1 00000100:00100000:0.0:1789760790.263851:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565554048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.263904:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74342400, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23748 00010000:00010000:0.0:1789760790.263914:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.263932:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.263937:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.263944:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.263963:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.270218:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985458 is committed 00002000:00010000:0.0:1789760790.270478:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74342400 -> 74346496 00002000:00010000:0.0:1789760790.270484:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145224 -> 145232 00010000:00010000:0.0:1789760790.270498:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270511:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270520:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270527:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.270532:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270541:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270561:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.270568:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74342400->74346495] (req 74342400->74346495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.272866:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565554048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9004us (9335us total) trans 4294985458 rc 0/0 00000100:00100000:0.0:1789760790.272881:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18161 00000100:00100000:0.0:1789760790.272892:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728498092953 time 728524131588 state 0x2 ref 0 00000100:00100000:3.0:1789760790.280935:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.281051:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554176 00000100:00100000:0.0:1789760790.281060:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554176 00000100:00100000:0.0:1789760790.281124:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728498092953 time 728524131588 state 0x0 ref 1 00000100:00100000:0.0:1789760790.281140:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728524392004 time 728524131588 state 0x1 ref 1 00000100:00100000:0.0:1789760790.281173:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728524392004 time 728541465483 state 0x0 ref 1 00000100:00100000:0.0:1789760790.281185:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.281232:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74346496, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23750 00010000:00010000:0.0:1789760790.281242:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.281258:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.281262:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.281268:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.281281:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760790.283962:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760790.283984:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580068224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760790.284048:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760790.284191:0:13530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068224 00000100:00100000:0.0:1789760790.284199:0:13530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068224 00000100:00100000:0.0:1789760790.284266:0:13530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789760790.284277:0:13530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580068224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760790.284305:0:13530:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789760790.284386:0:13530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699580068224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760790.284394:0:13530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1789760790.284929:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760790.285019:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3456:1876699580068224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760790.285810:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000001:00080000:2.0:1789760790.287443:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985459 is committed 00002000:00010000:0.0:1789760790.289088:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74346496 -> 74350592 00002000:00010000:0.0:1789760790.289098:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145232 -> 145240 00010000:00010000:0.0:1789760790.289112:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289126:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289135:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289143:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.289147:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289157:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289183:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.289192:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74346496->74350591] (req 74346496->74350591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.289412:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8214us (8472us total) trans 4294985459 rc 0/0 00000100:00100000:2.0:1789760790.289424:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18162 00000100:00100000:2.0:1789760790.289434:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728524392004 time 728541465483 state 0x2 ref 0 00000100:00100000:1.0:1789760790.289451:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580068480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.289524:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760790.289580:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580068352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760790.289586:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068480 00000100:00100000:2.0:1789760790.289595:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068480 00000100:00100000:1.0:1789760790.289610:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760790.289665:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789760790.289667:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068352 00000100:00100000:1.0:1789760790.289672:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068352 00000100:00100000:2.0:1789760790.289677:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580068480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.289723:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789760790.289733:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580068352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760790.289769:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1876699580068480:12345-0@lo:400:kworker.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760790.289780:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789760790.289781:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3459:x1876699580068352:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760790.289790:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789760790.289846:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3459:1876699580068480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.289855:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:769fd61a-9f51-46fc-af80-467e2ca172bc:3459:1876699580068352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760790.294035:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6fef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699580068608:0@lo:400:kworker.0 00000100:00100000:0.0:1789760790.294102:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760790.294175:0:5966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068608 00000100:00100000:2.0:1789760790.294183:0:5966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068608 00000100:00080000:1.0:1789760790.294219:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760790.294244:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789760790.294254:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580068608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.294379:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580068736:0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.294415:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760790.294450:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068736 00000100:00100000:1.0:1789760790.294454:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068736 00000100:00100000:1.0:1789760790.294497:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760790.294506:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760790.294539:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699580068608:12345-0@lo:400:kworker.0 Request processed in 284us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760790.294547:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1789760790.294566:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580068736:12345-0@lo:400:kworker.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760790.294574:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1789760790.294595:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760790.294631:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580068736:0@lo:400:kworker.0 00000100:00100000:0.0:1789760790.294851:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760790.295137:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580068864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760790.300078:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6fef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699580068608:0@lo:400:kworker.0 00000100:00100000:0.0:1789760790.300361:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760790.300541:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068864 00000100:00100000:3.0:1789760790.300548:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068864 00000100:00100000:3.0:1789760790.300670:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00080000:1.0:1789760790.300683:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760790.300723:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760790.300785:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1876699580068864:12345-0@lo:400:kworker.0 Request processed in 97us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760790.300792:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789760790.300880:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982e6fef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3459:1876699580068864:0@lo:400:kworker.0 00000100:00100000:2.0:1789760790.308066:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.308169:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554304 00000100:00100000:0.0:1789760790.308179:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554304 00000100:00100000:0.0:1789760790.308236:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728524392004 time 728541465483 state 0x0 ref 1 00000100:00100000:0.0:1789760790.308252:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728541725899 time 728541465483 state 0x1 ref 1 00000100:00100000:0.0:1789760790.308285:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728541725899 time 728568577112 state 0x0 ref 1 00000100:00100000:0.0:1789760790.308298:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.308347:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74350592, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23758 00010000:00010000:0.0:1789760790.308359:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.308375:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.308379:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.308385:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.308532:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.315492:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985460 is committed 00002000:00010000:2.0:1789760790.322866:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74350592 -> 74354688 00002000:00010000:2.0:1789760790.322876:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145240 -> 145248 00010000:00010000:2.0:1789760790.322890:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322903:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322913:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322920:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.322925:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322935:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322954:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.322962:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674ef68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74350592->74354687] (req 74350592->74354687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.323065:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14764us (15004us total) trans 4294985460 rc 0/0 00000100:00100000:2.0:1789760790.323076:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18163 00000100:00100000:2.0:1789760790.323086:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728541725899 time 728568577112 state 0x2 ref 0 00000100:00100000:1.0:1789760790.331115:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.331399:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554432 00000100:00100000:0.0:1789760790.331409:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554432 00000100:00100000:0.0:1789760790.331464:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728541725899 time 728568577112 state 0x0 ref 1 00000100:00100000:0.0:1789760790.331479:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728568837528 time 728568577112 state 0x1 ref 1 00000100:00100000:0.0:1789760790.331510:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728568837528 time 728591802419 state 0x0 ref 1 00000100:00100000:0.0:1789760790.331523:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.331570:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74354688, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23760 00010000:00010000:0.0:1789760790.331589:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.331605:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.331610:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.331617:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.331631:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.335783:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985461 is committed 00002000:00010000:0.0:1789760790.335968:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74354688 -> 74358784 00002000:00010000:0.0:1789760790.335973:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145248 -> 145256 00010000:00010000:0.0:1789760790.336053:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336067:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336075:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336084:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.336088:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336098:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336119:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.336132:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74354688->74358783] (req 74354688->74358783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.336224:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4699us (5113us total) trans 4294985461 rc 0/0 00000100:00100000:0.0:1789760790.336234:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18164 00000100:00100000:0.0:1789760790.336243:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728568837528 time 728591802419 state 0x2 ref 0 00000100:00100000:0.0:1789760790.340109:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.340288:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554560 00000100:00100000:2.0:1789760790.340298:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554560 00000100:00100000:2.0:1789760790.340388:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728568837528 time 728591802419 state 0x0 ref 1 00000100:00100000:2.0:1789760790.340406:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728592062835 time 728591802419 state 0x1 ref 1 00000100:00100000:2.0:1789760790.340441:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728592062835 time 728600733310 state 0x0 ref 1 00000100:00100000:2.0:1789760790.340454:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.340500:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74358784, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23768 00010000:00010000:2.0:1789760790.340509:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.340523:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.340528:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.340534:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.340548:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.344528:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985462 is committed 00002000:00010000:2.0:1789760790.344658:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74358784 -> 74362880 00002000:00010000:2.0:1789760790.344663:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145256 -> 145264 00010000:00010000:2.0:1789760790.344675:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344687:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344695:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344767:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.344773:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344782:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344802:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.344809:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674ef76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74358784->74362879] (req 74358784->74362879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.344955:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4499us (4852us total) trans 4294985462 rc 0/0 00000100:00100000:2.0:1789760790.344967:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18165 00000100:00100000:2.0:1789760790.344976:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728592062835 time 728600733310 state 0x2 ref 0 00000100:00100000:2.0:1789760790.353699:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.353859:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554688 00000100:00100000:0.0:1789760790.353868:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554688 00000100:00100000:0.0:1789760790.353924:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728592062835 time 728600733310 state 0x0 ref 1 00000100:00100000:0.0:1789760790.353940:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728600993726 time 728600733310 state 0x1 ref 1 00000100:00100000:0.0:1789760790.354138:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728600993726 time 728614428383 state 0x0 ref 1 00000100:00100000:0.0:1789760790.354153:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.354198:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74362880, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23770 00010000:00010000:0.0:1789760790.354207:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.354223:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.354228:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.354234:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.354253:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.360847:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985463 is committed 00002000:00010000:0.0:1789760790.361029:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74362880 -> 74366976 00002000:00010000:0.0:1789760790.361035:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145264 -> 145272 00010000:00010000:0.0:1789760790.361048:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361060:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361069:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361075:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.361080:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361088:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361108:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.361120:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674ef7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74362880->74366975] (req 74362880->74366975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.361214:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565554688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7062us (7521us total) trans 4294985463 rc 0/0 00000100:00100000:0.0:1789760790.361223:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18166 00000100:00100000:0.0:1789760790.361231:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728600993726 time 728614428383 state 0x2 ref 0 00000100:00100000:1.0:1789760790.364907:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.364986:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554816 00000100:00100000:0.0:1789760790.364996:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554816 00000100:00100000:0.0:1789760790.365052:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728600993726 time 728614428383 state 0x0 ref 1 00000100:00100000:0.0:1789760790.365066:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728614688799 time 728614428383 state 0x1 ref 1 00000100:00100000:0.0:1789760790.365098:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728614688799 time 728625390381 state 0x0 ref 1 00000100:00100000:0.0:1789760790.365112:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.365157:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74366976, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23778 00010000:00010000:0.0:1789760790.365165:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.365180:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.365184:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.365190:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.365211:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.371598:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985464 is committed 00002000:00010000:0.0:1789760790.371913:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74366976 -> 74371072 00002000:00010000:0.0:1789760790.371919:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145272 -> 145280 00010000:00010000:0.0:1789760790.371934:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.371947:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.371957:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.371964:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.371969:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.371979:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.371998:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.372006:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74366976->74371071] (req 74366976->74371071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.372133:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7020us (7231us total) trans 4294985464 rc 0/0 00000100:00100000:0.0:1789760790.372144:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18167 00000100:00100000:0.0:1789760790.372154:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728614688799 time 728625390381 state 0x2 ref 0 00000100:00100000:0.0:1789760790.377245:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.377338:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565554944 00000100:00100000:2.0:1789760790.377347:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565554944 00000100:00100000:2.0:1789760790.377409:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728614688799 time 728625390381 state 0x0 ref 1 00000100:00100000:2.0:1789760790.377425:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728625650797 time 728625390381 state 0x1 ref 1 00000100:00100000:2.0:1789760790.377453:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728625650797 time 728637744808 state 0x0 ref 1 00000100:00100000:2.0:1789760790.377465:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.377509:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74371072, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23780 00010000:00010000:2.0:1789760790.377518:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.377534:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.377538:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.377544:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.377558:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.382578:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985465 is committed 00002000:00010000:2.0:1789760790.382700:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74371072 -> 74375168 00002000:00010000:2.0:1789760790.382721:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145280 -> 145288 00010000:00010000:2.0:1789760790.382734:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382746:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382755:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382762:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.382767:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382776:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382800:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.382812:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674ef8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74371072->74375167] (req 74371072->74375167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.382954:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565554944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5486us (5713us total) trans 4294985465 rc 0/0 00000100:00100000:2.0:1789760790.382965:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18168 00000100:00100000:2.0:1789760790.382974:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728625650797 time 728637744808 state 0x2 ref 0 00000100:00100000:3.0:1789760790.387107:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.387212:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555072 00000100:00100000:0.0:1789760790.387221:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555072 00000100:00100000:0.0:1789760790.387276:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728625650797 time 728637744808 state 0x0 ref 1 00000100:00100000:0.0:1789760790.387291:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728638005224 time 728637744808 state 0x1 ref 1 00000100:00100000:0.0:1789760790.387390:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728638005224 time 728647680952 state 0x0 ref 1 00000100:00100000:0.0:1789760790.387403:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565555072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.387452:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74375168, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23788 00010000:00010000:0.0:1789760790.387462:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.387477:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.387481:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.387488:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.387508:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.392970:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985466 is committed 00002000:00010000:3.0:1789760790.393448:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74375168 -> 74379264 00002000:00010000:3.0:1789760790.393454:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145288 -> 145296 00010000:00010000:3.0:1789760790.393469:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393482:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393492:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393500:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760790.393504:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393514:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393534:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760790.393541:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674ef92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74375168->74379263] (req 74375168->74379263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760790.393886:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565555072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6480us (6782us total) trans 4294985466 rc 0/0 00000100:00100000:3.0:1789760790.393897:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18169 00000100:00100000:3.0:1789760790.393908:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728638005224 time 728647680952 state 0x2 ref 0 00000100:00100000:1.0:1789760790.398338:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.398425:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555200 00000100:00100000:0.0:1789760790.398433:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555200 00000100:00100000:0.0:1789760790.398488:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728638005224 time 728647680952 state 0x0 ref 1 00000100:00100000:0.0:1789760790.398500:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728647941368 time 728647680952 state 0x1 ref 1 00000100:00100000:0.0:1789760790.398520:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728647941368 time 728658813229 state 0x0 ref 1 00000100:00100000:0.0:1789760790.398528:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565555200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.398564:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74379264, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23790 00010000:00010000:0.0:1789760790.398570:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.398586:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.398590:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.398597:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.398611:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.403365:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985467 is committed 00002000:00010000:0.0:1789760790.403571:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74379264 -> 74383360 00002000:00010000:0.0:1789760790.403576:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145296 -> 145304 00010000:00010000:0.0:1789760790.403589:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403678:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403689:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403697:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.403701:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403728:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403749:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.403757:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674ef99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74379264->74383359] (req 74379264->74383359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.403971:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565555200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5437us (5637us total) trans 4294985467 rc 0/0 00000100:00100000:0.0:1789760790.403993:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18170 00000100:00100000:0.0:1789760790.404002:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728647941368 time 728658813229 state 0x2 ref 0 00000100:00100000:0.0:1789760790.408012:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.408157:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555328 00000100:00100000:2.0:1789760790.408167:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555328 00000100:00100000:2.0:1789760790.408222:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728647941368 time 728658813229 state 0x0 ref 1 00000100:00100000:2.0:1789760790.408237:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728659073645 time 728658813229 state 0x1 ref 1 00000100:00100000:2.0:1789760790.408269:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728659073645 time 728668561511 state 0x0 ref 1 00000100:00100000:2.0:1789760790.408285:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.408337:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74383360, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23798 00010000:00010000:2.0:1789760790.408347:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.408362:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.408367:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.408373:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.408388:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.415220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985468 is committed 00002000:00010000:2.0:1789760790.416488:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74383360 -> 74387456 00002000:00010000:2.0:1789760790.416495:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145304 -> 145312 00010000:00010000:2.0:1789760790.416509:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416522:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416530:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416537:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.416541:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416771:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416792:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.416801:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74383360->74387455] (req 74383360->74387455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.417012:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8726us (9003us total) trans 4294985468 rc 0/0 00000100:00100000:2.0:1789760790.417023:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18171 00000100:00100000:2.0:1789760790.417128:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728659073645 time 728668561511 state 0x2 ref 0 00000100:00100000:3.0:1789760790.422614:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.422687:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555456 00000100:00100000:1.0:1789760790.422697:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555456 00000100:00100000:1.0:1789760790.422786:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728659073645 time 728668561511 state 0x0 ref 1 00000100:00100000:1.0:1789760790.422802:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728668821927 time 728668561511 state 0x1 ref 1 00000100:00100000:1.0:1789760790.422828:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728668821927 time 728683120777 state 0x0 ref 1 00000100:00100000:1.0:1789760790.422840:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.422886:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74387456, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237a0 00010000:00010000:1.0:1789760790.422896:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.422911:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.422916:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.422923:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.422936:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.430644:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985469 is committed 00002000:00010000:1.0:1789760790.430817:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74387456 -> 74391552 00002000:00010000:1.0:1789760790.430822:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145312 -> 145320 00010000:00010000:1.0:1789760790.430834:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430846:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430854:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430861:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.430866:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430874:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430893:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.430899:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674efa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74387456->74391551] (req 74387456->74391551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.430997:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8147us (8391us total) trans 4294985469 rc 0/0 00000100:00100000:1.0:1789760790.431006:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18172 00000100:00100000:1.0:1789760790.431016:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728668821927 time 728683120777 state 0x2 ref 0 00000100:00100000:1.0:1789760790.438409:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.438506:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555584 00000100:00100000:0.0:1789760790.438516:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555584 00000100:00100000:0.0:1789760790.438569:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728668821927 time 728683120777 state 0x0 ref 1 00000100:00100000:0.0:1789760790.438582:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728683381193 time 728683120777 state 0x1 ref 1 00000100:00100000:0.0:1789760790.438658:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728683381193 time 728698948686 state 0x0 ref 1 00000100:00100000:0.0:1789760790.438671:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.438744:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74391552, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237a8 00010000:00010000:0.0:1789760790.438753:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.438776:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.438781:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.438787:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.438801:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.442694:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985470 is committed 00002000:00010000:0.0:1789760790.442959:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74391552 -> 74395648 00002000:00010000:0.0:1789760790.442964:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145320 -> 145328 00010000:00010000:0.0:1789760790.442978:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443063:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443073:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443081:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.443086:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443095:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443115:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.443123:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674efae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74391552->74395647] (req 74391552->74395647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.443209:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4536us (4805us total) trans 4294985470 rc 0/0 00000100:00100000:0.0:1789760790.443220:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18173 00000100:00100000:0.0:1789760790.443229:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728683381193 time 728698948686 state 0x2 ref 0 00000100:00100000:0.0:1789760790.451079:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.451206:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555712 00000100:00100000:2.0:1789760790.451225:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555712 00000100:00100000:2.0:1789760790.451273:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728683381193 time 728698948686 state 0x0 ref 1 00000100:00100000:2.0:1789760790.451287:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728699209102 time 728698948686 state 0x1 ref 1 00000100:00100000:2.0:1789760790.451313:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728699209102 time 728711605903 state 0x0 ref 1 00000100:00100000:2.0:1789760790.451324:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565555712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.451375:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74395648, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237b0 00010000:00010000:2.0:1789760790.451384:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.451400:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.451404:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.451410:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.451424:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.456245:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985471 is committed 00002000:00010000:2.0:1789760790.456368:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74395648 -> 74399744 00002000:00010000:2.0:1789760790.456373:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145328 -> 145336 00010000:00010000:2.0:1789760790.456385:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456398:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456408:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456414:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.456419:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456428:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456446:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.456455:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74395648->74399743] (req 74395648->74399743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.456547:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565555712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5219us (5473us total) trans 4294985471 rc 0/0 00000100:00100000:2.0:1789760790.456557:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18174 00000100:00100000:2.0:1789760790.456566:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728699209102 time 728711605903 state 0x2 ref 0 00000100:00100000:0.0:1789760790.468084:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.468275:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555840 00000100:00100000:1.0:1789760790.468284:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555840 00000100:00100000:1.0:1789760790.468333:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728699209102 time 728711605903 state 0x0 ref 1 00000100:00100000:1.0:1789760790.468349:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728711866319 time 728711605903 state 0x1 ref 1 00000100:00100000:1.0:1789760790.468376:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728711866319 time 728728669641 state 0x0 ref 1 00000100:00100000:1.0:1789760790.468385:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565555840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.468432:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74399744, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237b8 00010000:00010000:1.0:1789760790.468440:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.468451:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.468454:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.468459:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.468469:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.478058:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985472 is committed 00002000:00010000:1.0:1789760790.478278:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74399744 -> 74403840 00002000:00010000:1.0:1789760790.478283:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145336 -> 145344 00010000:00010000:1.0:1789760790.478296:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478309:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478318:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478330:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.478335:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478343:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478361:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.478369:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674efbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74399744->74403839] (req 74399744->74403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.478467:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565555840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10078us (10387us total) trans 4294985472 rc 0/0 00000100:00100000:1.0:1789760790.478478:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18175 00000100:00100000:1.0:1789760790.478488:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728711866319 time 728728669641 state 0x2 ref 0 00000100:00100000:1.0:1789760790.484448:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.484500:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565555968 00000100:00100000:0.0:1789760790.484510:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565555968 00000100:00100000:0.0:1789760790.484566:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728711866319 time 728728669641 state 0x0 ref 1 00000100:00100000:0.0:1789760790.484585:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728728930057 time 728728669641 state 0x1 ref 1 00000100:00100000:0.0:1789760790.484616:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728728930057 time 728744909079 state 0x0 ref 1 00000100:00100000:0.0:1789760790.484629:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.484691:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74403840, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237c0 00010000:00010000:0.0:1789760790.484727:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.484743:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.484747:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.484753:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.484766:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.491426:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985473 is committed 00002000:00010000:0.0:1789760790.491769:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74403840 -> 74407936 00002000:00010000:0.0:1789760790.491774:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145344 -> 145352 00010000:00010000:0.0:1789760790.491787:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492531:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492543:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492550:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.492554:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492563:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492722:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.492732:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674efc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74403840->74407935] (req 74403840->74407935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.492949:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565555968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8317us (8505us total) trans 4294985473 rc 0/0 00000100:00100000:0.0:1789760790.492961:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18176 00000100:00100000:0.0:1789760790.492969:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728728930057 time 728744909079 state 0x2 ref 0 00000100:00100000:0.0:1789760790.499387:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.499500:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556096 00000100:00100000:2.0:1789760790.499510:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556096 00000100:00100000:2.0:1789760790.499565:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728728930057 time 728744909079 state 0x0 ref 1 00000100:00100000:2.0:1789760790.499580:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728745169495 time 728744909079 state 0x1 ref 1 00000100:00100000:2.0:1789760790.499613:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728745169495 time 728759905254 state 0x0 ref 1 00000100:00100000:2.0:1789760790.499626:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.499682:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74407936, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237c8 00010000:00010000:2.0:1789760790.499692:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.499737:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.499742:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.499748:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.499764:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.505794:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985474 is committed 00002000:00010000:2.0:1789760790.506005:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74407936 -> 74412032 00002000:00010000:2.0:1789760790.506009:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145352 -> 145360 00010000:00010000:2.0:1789760790.506019:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506028:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506038:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506043:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.506047:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506052:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506067:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.506075:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74407936->74412031] (req 74407936->74412031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.506166:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6538us (6786us total) trans 4294985474 rc 0/0 00000100:00100000:2.0:1789760790.506177:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18177 00000100:00100000:2.0:1789760790.506186:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728745169495 time 728759905254 state 0x2 ref 0 00000100:00100000:3.0:1789760790.509953:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.510118:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556224 00000100:00100000:1.0:1789760790.510127:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556224 00000100:00100000:1.0:1789760790.510175:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728745169495 time 728759905254 state 0x0 ref 1 00000100:00100000:1.0:1789760790.510189:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728760165670 time 728759905254 state 0x1 ref 1 00000100:00100000:1.0:1789760790.510291:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728760165670 time 728770581960 state 0x0 ref 1 00000100:00100000:1.0:1789760790.510304:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565556224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.510345:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74412032, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237d0 00010000:00010000:1.0:1789760790.510354:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.510369:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.510373:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.510379:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.510392:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.515849:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985475 is committed 00002000:00010000:1.0:1789760790.516026:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74412032 -> 74416128 00002000:00010000:1.0:1789760790.516031:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145360 -> 145368 00010000:00010000:1.0:1789760790.516044:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516057:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516066:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516073:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.516079:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516088:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516121:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.516129:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674efd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74412032->74416127] (req 74412032->74416127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.516368:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565556224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5907us (6265us total) trans 4294985475 rc 0/0 00000100:00100000:1.0:1789760790.516379:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18178 00000100:00100000:1.0:1789760790.516389:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728760165670 time 728770581960 state 0x2 ref 0 00000100:00100000:1.0:1789760790.519821:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.520120:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556352 00000100:00100000:0.0:1789760790.520130:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556352 00000100:00100000:0.0:1789760790.520188:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728760165670 time 728770581960 state 0x0 ref 1 00000100:00100000:0.0:1789760790.520203:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728770842376 time 728770581960 state 0x1 ref 1 00000100:00100000:0.0:1789760790.520382:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728770842376 time 728780672344 state 0x0 ref 1 00000100:00100000:0.0:1789760790.520404:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.520450:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74416128, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237d8 00010000:00010000:0.0:1789760790.520459:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.520473:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.520477:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.520482:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.520495:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.527088:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985476 is committed 00002000:00010000:0.0:1789760790.527617:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74416128 -> 74420224 00002000:00010000:0.0:1789760790.527622:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145368 -> 145376 00010000:00010000:0.0:1789760790.527914:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527932:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527940:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527947:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.527952:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527961:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527990:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.527998:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674efd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74416128->74420223] (req 74416128->74420223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.528128:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7731us (8309us total) trans 4294985476 rc 0/0 00000100:00100000:0.0:1789760790.528138:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18179 00000100:00100000:0.0:1789760790.528146:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728770842376 time 728780672344 state 0x2 ref 0 00000100:00100000:0.0:1789760790.535116:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.535244:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556480 00000100:00100000:2.0:1789760790.535253:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556480 00000100:00100000:2.0:1789760790.535304:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728770842376 time 728780672344 state 0x0 ref 1 00000100:00100000:2.0:1789760790.535319:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728780932760 time 728780672344 state 0x1 ref 1 00000100:00100000:2.0:1789760790.535349:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728780932760 time 728795641026 state 0x0 ref 1 00000100:00100000:2.0:1789760790.535361:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.535973:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74420224, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237e0 00010000:00010000:2.0:1789760790.536050:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.536068:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.536073:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.536079:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.536092:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.543591:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985477 is committed 00002000:00010000:0.0:1789760790.543780:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74420224 -> 74424320 00002000:00010000:0.0:1789760790.543783:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145376 -> 145384 00010000:00010000:0.0:1789760790.543795:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543894:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543906:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543913:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.543918:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543927:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543947:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.543955:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674efdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74420224->74424319] (req 74420224->74424319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.544102:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8738us (8990us total) trans 4294985477 rc 0/0 00000100:00100000:0.0:1789760790.544114:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18180 00000100:00100000:0.0:1789760790.544124:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728780932760 time 728795641026 state 0x2 ref 0 00000100:00100000:3.0:1789760790.552496:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.552893:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556608 00000100:00100000:1.0:1789760790.552902:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556608 00000100:00100000:1.0:1789760790.552954:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728780932760 time 728795641026 state 0x0 ref 1 00000100:00100000:1.0:1789760790.552970:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728795901442 time 728795641026 state 0x1 ref 1 00000100:00100000:1.0:1789760790.553012:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728795901442 time 728813304201 state 0x0 ref 1 00000100:00100000:1.0:1789760790.553023:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565556608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.553071:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74424320, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237e8 00010000:00010000:1.0:1789760790.553082:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.553097:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.553101:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.553107:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.553120:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.559017:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985478 is committed 00002000:00010000:1.0:1789760790.559139:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74424320 -> 74428416 00002000:00010000:1.0:1789760790.559145:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145384 -> 145392 00010000:00010000:1.0:1789760790.559156:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559168:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559176:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559183:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.559188:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559201:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559219:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.559227:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674efe6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74424320->74428415] (req 74424320->74428415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.559322:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565556608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6296us (6832us total) trans 4294985478 rc 0/0 00000100:00100000:1.0:1789760790.559333:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18181 00000100:00100000:1.0:1789760790.559342:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728795901442 time 728813304201 state 0x2 ref 0 00000100:00100000:1.0:1789760790.566615:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.566775:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556736 00000100:00100000:0.0:1789760790.566784:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556736 00000100:00100000:0.0:1789760790.566838:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728795901442 time 728813304201 state 0x0 ref 1 00000100:00100000:0.0:1789760790.566863:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728813564617 time 728813304201 state 0x1 ref 1 00000100:00100000:0.0:1789760790.566891:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728813564617 time 728827183552 state 0x0 ref 1 00000100:00100000:0.0:1789760790.566904:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565556736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.566949:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74428416, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237f0 00010000:00010000:0.0:1789760790.566959:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.566976:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.566990:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.566997:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.567012:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.571682:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985479 is committed 00002000:00010000:0.0:1789760790.572146:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74428416 -> 74432512 00002000:00010000:0.0:1789760790.572152:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145392 -> 145400 00010000:00010000:0.0:1789760790.572166:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572184:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572193:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572200:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.572205:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572214:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572232:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.572240:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674efed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74428416->74432511] (req 74428416->74432511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.572335:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565556736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5429us (5725us total) trans 4294985479 rc 0/0 00000100:00100000:0.0:1789760790.572346:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18182 00000100:00100000:0.0:1789760790.572357:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728813564617 time 728827183552 state 0x2 ref 0 00000100:00100000:0.0:1789760790.583129:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.583477:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556864 00000100:00100000:2.0:1789760790.583488:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556864 00000100:00100000:2.0:1789760790.583544:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728813564617 time 728827183552 state 0x0 ref 1 00000100:00100000:2.0:1789760790.583557:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728827443968 time 728827183552 state 0x1 ref 1 00000100:00100000:2.0:1789760790.583588:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728827443968 time 728843880618 state 0x0 ref 1 00000100:00100000:2.0:1789760790.583600:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.583661:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74432512, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x237f8 00010000:00010000:2.0:1789760790.583671:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.583686:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.583691:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.583698:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.583750:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.589028:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985480 is committed 00002000:00010000:2.0:1789760790.589439:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74432512 -> 74436608 00002000:00010000:2.0:1789760790.589445:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145400 -> 145408 00010000:00010000:2.0:1789760790.589459:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589471:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589479:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589486:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.589491:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589504:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589523:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.589530:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674eff4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74432512->74436607] (req 74432512->74436607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.592208:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8598us (9078us total) trans 4294985480 rc 0/0 00000100:00100000:2.0:1789760790.592223:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18183 00000100:00100000:2.0:1789760790.592234:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728827443968 time 728843880618 state 0x2 ref 0 00000100:00100000:3.0:1789760790.601207:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.601317:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565556992 00000100:00100000:1.0:1789760790.601326:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565556992 00000100:00100000:1.0:1789760790.601378:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728827443968 time 728843880618 state 0x0 ref 1 00000100:00100000:1.0:1789760790.601393:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728844141034 time 728843880618 state 0x1 ref 1 00000100:00100000:1.0:1789760790.601419:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728844141034 time 728861711016 state 0x0 ref 1 00000100:00100000:1.0:1789760790.601431:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.601478:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74436608, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23800 00010000:00010000:1.0:1789760790.601488:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.601505:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.601510:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.601516:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.601531:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.611200:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985481 is committed 00002000:00010000:1.0:1789760790.611416:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74436608 -> 74440704 00002000:00010000:1.0:1789760790.611421:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145408 -> 145416 00010000:00010000:1.0:1789760790.611433:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611445:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611454:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611461:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.611466:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611475:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611496:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.611504:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674effb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74436608->74440703] (req 74436608->74440703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.611590:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565556992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10156us (10388us total) trans 4294985481 rc 0/0 00000100:00100000:1.0:1789760790.611600:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18184 00000100:00100000:1.0:1789760790.611610:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728844141034 time 728861711016 state 0x2 ref 0 00000100:00100000:3.0:1789760790.620220:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.620681:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557120 00000100:00100000:0.0:1789760790.620691:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557120 00000100:00100000:0.0:1789760790.620774:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728844141034 time 728861711016 state 0x0 ref 1 00000100:00100000:0.0:1789760790.620790:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728861971432 time 728861711016 state 0x1 ref 1 00000100:00100000:0.0:1789760790.620830:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728861971432 time 728881121546 state 0x0 ref 1 00000100:00100000:0.0:1789760790.620843:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.620894:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74440704, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23808 00010000:00010000:0.0:1789760790.620905:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.620921:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.620926:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.620933:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.620946:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.628491:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985482 is committed 00002000:00010000:0.0:1789760790.628849:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74440704 -> 74444800 00002000:00010000:0.0:1789760790.628854:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145416 -> 145424 00010000:00010000:0.0:1789760790.628869:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628882:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628892:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628899:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.628904:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628913:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628932:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.628941:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f002 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74440704->74444799] (req 74440704->74444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.629134:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8289us (8918us total) trans 4294985482 rc 0/0 00000100:00100000:0.0:1789760790.629144:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18185 00000100:00100000:0.0:1789760790.629153:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728861971432 time 728881121546 state 0x2 ref 0 00000100:00100000:0.0:1789760790.635887:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.636001:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557248 00000100:00100000:2.0:1789760790.636010:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557248 00000100:00100000:2.0:1789760790.636070:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728861971432 time 728881121546 state 0x0 ref 1 00000100:00100000:2.0:1789760790.636086:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728881381962 time 728881121546 state 0x1 ref 1 00000100:00100000:2.0:1789760790.636116:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728881381962 time 728896408063 state 0x0 ref 1 00000100:00100000:2.0:1789760790.636133:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565557248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.636181:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74444800, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23810 00010000:00010000:2.0:1789760790.636190:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.636205:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.636210:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.636216:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.636231:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.644166:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985483 is committed 00002000:00010000:2.0:1789760790.644327:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74444800 -> 74448896 00002000:00010000:2.0:1789760790.644332:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145424 -> 145432 00010000:00010000:2.0:1789760790.644345:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644357:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644378:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644386:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.644391:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644400:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644420:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.644582:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f009 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74444800->74448895] (req 74444800->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.644855:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565557248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8718us (8971us total) trans 4294985483 rc 0/0 00000100:00100000:2.0:1789760790.644866:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18186 00000100:00100000:2.0:1789760790.644875:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728881381962 time 728896408063 state 0x2 ref 0 00000100:00100000:3.0:1789760790.654319:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.654940:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557376 00000100:00100000:1.0:1789760790.654950:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557376 00000100:00100000:1.0:1789760790.655020:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728881381962 time 728896408063 state 0x0 ref 1 00000100:00100000:1.0:1789760790.655035:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728896668479 time 728896408063 state 0x1 ref 1 00000100:00100000:1.0:1789760790.655072:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728896668479 time 728915364721 state 0x0 ref 1 00000100:00100000:1.0:1789760790.655084:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.655133:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74448896, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23818 00010000:00010000:1.0:1789760790.655142:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.655158:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.655163:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.655169:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.655182:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.663377:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985484 is committed 00002000:00010000:1.0:1789760790.663668:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74448896 -> 74452992 00002000:00010000:1.0:1789760790.663673:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145432 -> 145440 00010000:00010000:1.0:1789760790.663686:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663699:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663919:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663927:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.663932:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663943:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663962:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.663975:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f010 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->74452991] (req 74448896->74452991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.664068:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8981us (9754us total) trans 4294985484 rc 0/0 00000100:00100000:1.0:1789760790.664077:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18187 00000100:00100000:1.0:1789760790.664086:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728896668479 time 728915364721 state 0x2 ref 0 00000100:00100000:3.0:1789760790.668138:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.668278:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557504 00000100:00100000:0.0:1789760790.668286:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557504 00000100:00100000:0.0:1789760790.668341:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728896668479 time 728915364721 state 0x0 ref 1 00000100:00100000:0.0:1789760790.668356:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728915625137 time 728915364721 state 0x1 ref 1 00000100:00100000:0.0:1789760790.668385:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728915625137 time 728928677539 state 0x0 ref 1 00000100:00100000:0.0:1789760790.668397:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565557504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.668549:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74452992, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23820 00010000:00010000:0.0:1789760790.668559:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.668651:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.668657:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.668665:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.668679:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.675108:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985485 is committed 00002000:00010000:0.0:1789760790.675281:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74452992 -> 74457088 00002000:00010000:0.0:1789760790.675287:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145440 -> 145448 00010000:00010000:0.0:1789760790.675300:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675313:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675327:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675334:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.675338:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675347:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675469:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.675478:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f017 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74452992->74457087] (req 74452992->74457087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.675665:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565557504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7265us (7531us total) trans 4294985485 rc 0/0 00000100:00100000:0.0:1789760790.675676:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18188 00000100:00100000:0.0:1789760790.675685:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728915625137 time 728928677539 state 0x2 ref 0 00000100:00100000:0.0:1789760790.681259:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.681516:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557632 00000100:00100000:2.0:1789760790.681527:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557632 00000100:00100000:2.0:1789760790.681581:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728915625137 time 728928677539 state 0x0 ref 1 00000100:00100000:2.0:1789760790.681595:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728928937955 time 728928677539 state 0x1 ref 1 00000100:00100000:2.0:1789760790.681669:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728928937955 time 728941960202 state 0x0 ref 1 00000100:00100000:2.0:1789760790.681683:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.681764:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74457088, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23828 00010000:00010000:2.0:1789760790.681774:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.681793:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1789760790.681798:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.681803:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.681817:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.687179:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985486 is committed 00002000:00010000:0.0:1789760790.687320:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74457088 -> 74461184 00002000:00010000:0.0:1789760790.687327:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145448 -> 145456 00010000:00010000:0.0:1789760790.687340:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687354:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687373:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687382:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.687387:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687395:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687413:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.687420:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f01e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74457088->74461183] (req 74457088->74461183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.689912:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8219us (8649us total) trans 4294985486 rc 0/0 00000100:00100000:0.0:1789760790.689926:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18189 00000100:00100000:0.0:1789760790.689936:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728928937955 time 728941960202 state 0x2 ref 0 00000100:00100000:3.0:1789760790.695741:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.695829:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557760 00000100:00100000:1.0:1789760790.695839:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557760 00000100:00100000:1.0:1789760790.695893:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728928937955 time 728941960202 state 0x0 ref 1 00000100:00100000:1.0:1789760790.695909:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728942220618 time 728941960202 state 0x1 ref 1 00000100:00100000:1.0:1789760790.695942:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728942220618 time 728956233351 state 0x0 ref 1 00000100:00100000:1.0:1789760790.695956:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565557760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.696006:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74461184, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23830 00010000:00010000:1.0:1789760790.696016:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.696033:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.696038:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.696046:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.696136:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.709502:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985487 is committed 00002000:00010000:1.0:1789760790.712246:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74461184 -> 74465280 00002000:00010000:1.0:1789760790.712256:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145456 -> 145464 00010000:00010000:1.0:1789760790.712270:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712284:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712294:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712302:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.712306:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712315:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712334:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.712342:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f025 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74461184->74465279] (req 74461184->74465279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.712561:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565557760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16602us (16853us total) trans 4294985487 rc 0/0 00000100:00100000:1.0:1789760790.712573:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18190 00000100:00100000:1.0:1789760790.712582:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728942220618 time 728956233351 state 0x2 ref 0 00000100:00100000:1.0:1789760790.718549:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.718779:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565557888 00000100:00100000:0.0:1789760790.718790:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565557888 00000100:00100000:0.0:1789760790.718844:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728942220618 time 728956233351 state 0x0 ref 1 00000100:00100000:0.0:1789760790.718859:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728956493767 time 728956233351 state 0x1 ref 1 00000100:00100000:0.0:1789760790.718923:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728956493767 time 728979214485 state 0x0 ref 1 00000100:00100000:0.0:1789760790.718937:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.718981:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74465280, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23838 00010000:00010000:0.0:1789760790.718990:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.719137:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1789760790.719141:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.719148:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.719162:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.725644:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985488 is committed 00002000:00010000:0.0:1789760790.725806:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74465280 -> 74469376 00002000:00010000:0.0:1789760790.725811:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145464 -> 145472 00010000:00010000:0.0:1789760790.725825:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725837:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725853:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725860:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.725865:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725874:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725893:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.725902:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f02c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74465280->74469375] (req 74465280->74469375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.726041:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565557888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7102us (7497us total) trans 4294985488 rc 0/0 00000100:00100000:0.0:1789760790.726052:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18191 00000100:00100000:0.0:1789760790.726060:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728956493767 time 728979214485 state 0x2 ref 0 00000100:00100000:0.0:1789760790.730589:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.730681:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558016 00000100:00100000:1.0:1789760790.730691:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558016 00000100:00100000:1.0:1789760790.730770:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728956493767 time 728979214485 state 0x0 ref 1 00000100:00100000:1.0:1789760790.730784:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728979474901 time 728979214485 state 0x1 ref 1 00000100:00100000:1.0:1789760790.730813:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728979474901 time 728991105432 state 0x0 ref 1 00000100:00100000:1.0:1789760790.730825:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c95ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.730874:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74469376, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23840 00010000:00010000:1.0:1789760790.730884:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.730900:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1789760790.730904:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.730911:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.730925:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.731915:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760790.737551:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985489 is committed 00002000:00010000:1.0:1789760790.737822:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74469376 -> 74473472 00002000:00010000:1.0:1789760790.737827:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145472 -> 145480 00010000:00010000:1.0:1789760790.737839:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737853:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737863:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737871:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.737876:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737885:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737903:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.737910:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74469376->74473471] (req 74469376->74473471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.738010:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7182us (7434us total) trans 4294985489 rc 0/0 00000100:00100000:1.0:1789760790.738021:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18192 00000100:00100000:1.0:1789760790.738029:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728979474901 time 728991105432 state 0x2 ref 0 00000100:00100000:0.0:1789760790.750045:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.750626:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558144 00000100:00100000:1.0:1789760790.750645:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558144 00000100:00100000:1.0:1789760790.750698:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728979474901 time 728991105432 state 0x0 ref 1 00000100:00100000:1.0:1789760790.750749:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728991365848 time 728991105432 state 0x1 ref 1 00000100:00100000:1.0:1789760790.750773:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728991365848 time 729011064594 state 0x0 ref 1 00000100:00100000:1.0:1789760790.750784:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.750831:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74473472, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23848 00010000:00010000:1.0:1789760790.750841:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.750857:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.750872:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.750879:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.750897:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.758284:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985490 is committed 00002000:00010000:1.0:1789760790.758525:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74473472 -> 74477568 00002000:00010000:1.0:1789760790.758532:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145480 -> 145488 00010000:00010000:1.0:1789760790.758547:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758559:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758567:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758584:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.758588:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758598:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758618:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.758626:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f03a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74473472->74477567] (req 74473472->74477567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.759350:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8560us (9307us total) trans 4294985490 rc 0/0 00000100:00100000:1.0:1789760790.759362:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18193 00000100:00100000:1.0:1789760790.759383:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728991365848 time 729011064594 state 0x2 ref 0 00000100:00100000:1.0:1789760790.768002:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760790.768241:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558272 00000100:00100000:0.0:1789760790.768251:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558272 00000100:00100000:0.0:1789760790.768305:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 728991365848 time 729011064594 state 0x0 ref 1 00000100:00100000:0.0:1789760790.768321:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729011325010 time 729011064594 state 0x1 ref 1 00000100:00100000:0.0:1789760790.768352:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729011325010 time 729028644593 state 0x0 ref 1 00000100:00100000:0.0:1789760790.768375:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.768424:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74477568, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23850 00010000:00010000:0.0:1789760790.768434:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.768450:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760790.768454:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.768461:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.768475:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.774143:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985491 is committed 00002000:00010000:2.0:1789760790.774247:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74477568 -> 74481664 00002000:00010000:2.0:1789760790.774251:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145488 -> 145496 00010000:00010000:2.0:1789760790.774262:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774270:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774276:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774281:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.774284:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774290:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774304:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.774309:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674f041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74477568->74481663] (req 74477568->74481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.774390:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6025us (6406us total) trans 4294985491 rc 0/0 00000100:00100000:2.0:1789760790.774402:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18194 00000100:00100000:2.0:1789760790.774409:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729011325010 time 729028644593 state 0x2 ref 0 00000100:00100000:0.0:1789760790.783234:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.783333:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558400 00000100:00100000:1.0:1789760790.783342:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558400 00000100:00100000:1.0:1789760790.783409:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729011325010 time 729028644593 state 0x0 ref 1 00000100:00100000:1.0:1789760790.783424:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729028905009 time 729028644593 state 0x1 ref 1 00000100:00100000:1.0:1789760790.783451:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729028905009 time 729043742714 state 0x0 ref 1 00000100:00100000:1.0:1789760790.783464:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565558400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.783509:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74481664, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23858 00010000:00010000:1.0:1789760790.783519:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.783535:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.783540:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.783546:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.783560:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.790095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985492 is committed 00002000:00010000:1.0:1789760790.790283:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74481664 -> 74485760 00002000:00010000:1.0:1789760790.790288:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145496 -> 145504 00010000:00010000:1.0:1789760790.790301:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790319:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790328:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790335:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.790339:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790348:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790367:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.790374:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74481664->74485759] (req 74481664->74485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.790866:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565558400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7390us (7626us total) trans 4294985492 rc 0/0 00000100:00100000:1.0:1789760790.790878:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18195 00000100:00100000:1.0:1789760790.790886:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729028905009 time 729043742714 state 0x2 ref 0 00000100:00100000:0.0:1789760790.795321:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.795408:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558528 00000100:00100000:1.0:1789760790.795417:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558528 00000100:00100000:1.0:1789760790.795470:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729028905009 time 729043742714 state 0x0 ref 1 00000100:00100000:1.0:1789760790.795486:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729044003130 time 729043742714 state 0x1 ref 1 00000100:00100000:1.0:1789760790.795518:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729044003130 time 729055809076 state 0x0 ref 1 00000100:00100000:1.0:1789760790.795530:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.795588:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74485760, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23860 00010000:00010000:1.0:1789760790.795598:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.795613:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.795618:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.795639:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.795654:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.800569:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985493 is committed 00002000:00010000:1.0:1789760790.803815:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74485760 -> 74489856 00002000:00010000:1.0:1789760790.803823:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145504 -> 145512 00010000:00010000:1.0:1789760790.803836:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804018:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804033:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804040:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.804044:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804053:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804072:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.804080:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f04f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74485760->74489855] (req 74485760->74489855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.804321:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8638us (8854us total) trans 4294985493 rc 0/0 00000100:00100000:1.0:1789760790.804332:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18196 00000100:00100000:1.0:1789760790.804342:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729044003130 time 729055809076 state 0x2 ref 0 00000100:00100000:1.0:1789760790.811928:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.812057:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558656 00000100:00100000:2.0:1789760790.812067:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558656 00000100:00100000:2.0:1789760790.812118:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729044003130 time 729055809076 state 0x0 ref 1 00000100:00100000:2.0:1789760790.812133:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729056069492 time 729055809076 state 0x1 ref 1 00000100:00100000:2.0:1789760790.812163:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729056069492 time 729072454746 state 0x0 ref 1 00000100:00100000:2.0:1789760790.812175:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.812221:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74489856, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23868 00010000:00010000:2.0:1789760790.812230:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.812247:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760790.812252:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.812258:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.812271:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.818826:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985494 is committed 00002000:00010000:2.0:1789760790.819247:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74489856 -> 74493952 00002000:00010000:2.0:1789760790.819253:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145512 -> 145520 00010000:00010000:2.0:1789760790.819266:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819278:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819287:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819294:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.819299:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819308:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819326:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.819340:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74489856->74493951] (req 74489856->74493951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.821270:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9087us (9349us total) trans 4294985494 rc 0/0 00000100:00100000:2.0:1789760790.821286:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18197 00000100:00100000:2.0:1789760790.821295:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729056069492 time 729072454746 state 0x2 ref 0 00000100:00100000:0.0:1789760790.827029:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.827169:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558784 00000100:00100000:1.0:1789760790.827178:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558784 00000100:00100000:1.0:1789760790.827233:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729056069492 time 729072454746 state 0x0 ref 1 00000100:00100000:1.0:1789760790.827254:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729072715162 time 729072454746 state 0x1 ref 1 00000100:00100000:1.0:1789760790.827285:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729072715162 time 729087577262 state 0x0 ref 1 00000100:00100000:1.0:1789760790.827298:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.827345:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74493952, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23870 00010000:00010000:1.0:1789760790.827355:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.827370:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.827374:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.827381:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.827396:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.832454:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985495 is committed 00002000:00010000:0.0:1789760790.832605:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74493952 -> 74498048 00002000:00010000:0.0:1789760790.832611:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145520 -> 145528 00010000:00010000:0.0:1789760790.832622:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832692:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832724:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832733:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.832738:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832747:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832767:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.832775:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f05d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74493952->74498047] (req 74493952->74498047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.833142:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565558784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5841us (6117us total) trans 4294985495 rc 0/0 00000100:00100000:0.0:1789760790.833153:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18198 00000100:00100000:0.0:1789760790.833163:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729072715162 time 729087577262 state 0x2 ref 0 00000100:00100000:0.0:1789760790.842749:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.842953:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565558912 00000100:00100000:1.0:1789760790.842964:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565558912 00000100:00100000:1.0:1789760790.843019:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729072715162 time 729087577262 state 0x0 ref 1 00000100:00100000:1.0:1789760790.844063:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729087837678 time 729087577262 state 0x1 ref 1 00000100:00100000:1.0:1789760790.844111:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729087837678 time 729104402779 state 0x0 ref 1 00000100:00100000:1.0:1789760790.844133:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.844182:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74498048, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23878 00010000:00010000:1.0:1789760790.844191:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.844213:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.844217:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.844224:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.844237:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.850129:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985496 is committed 00002000:00010000:1.0:1789760790.850262:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74498048 -> 74502144 00002000:00010000:1.0:1789760790.850267:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145528 -> 145536 00010000:00010000:1.0:1789760790.850279:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850292:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850302:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850310:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.850315:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850324:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850342:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.850348:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f064 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74498048->74502143] (req 74498048->74502143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.850440:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565558912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6309us (7731us total) trans 4294985496 rc 0/0 00000100:00100000:1.0:1789760790.852165:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18199 00000100:00100000:1.0:1789760790.852175:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729087837678 time 729104402779 state 0x2 ref 0 00000100:00100000:1.0:1789760790.857504:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.857735:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559040 00000100:00100000:2.0:1789760790.857745:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559040 00000100:00100000:2.0:1789760790.857809:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729087837678 time 729104402779 state 0x0 ref 1 00000100:00100000:2.0:1789760790.857825:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729104663195 time 729104402779 state 0x1 ref 1 00000100:00100000:2.0:1789760790.857856:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729104663195 time 729118147963 state 0x0 ref 1 00000100:00100000:2.0:1789760790.857868:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565559040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.857915:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74502144, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23880 00010000:00010000:2.0:1789760790.857924:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.857940:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760790.857945:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.857951:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.857970:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.870768:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985497 is committed 00002000:00010000:2.0:1789760790.871193:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74502144 -> 74506240 00002000:00010000:2.0:1789760790.871199:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145536 -> 145544 00010000:00010000:2.0:1789760790.871212:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871224:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871232:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871238:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.871243:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871251:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871272:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.871279:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f06b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74502144->74506239] (req 74502144->74506239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.871370:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565559040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13500us (13870us total) trans 4294985497 rc 0/0 00000100:00100000:2.0:1789760790.871381:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18200 00000100:00100000:2.0:1789760790.871389:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729104663195 time 729118147963 state 0x2 ref 0 00000100:00100000:0.0:1789760790.877070:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.877145:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559168 00000100:00100000:1.0:1789760790.877155:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559168 00000100:00100000:1.0:1789760790.877212:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729104663195 time 729118147963 state 0x0 ref 1 00000100:00100000:1.0:1789760790.877226:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729118408379 time 729118147963 state 0x1 ref 1 00000100:00100000:1.0:1789760790.877255:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729118408379 time 729137547791 state 0x0 ref 1 00000100:00100000:1.0:1789760790.877268:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.877318:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74506240, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23888 00010000:00010000:1.0:1789760790.877328:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.877343:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.877348:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.877354:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.877367:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.882591:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985498 is committed 00002000:00010000:0.0:1789760790.882801:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74506240 -> 74510336 00002000:00010000:0.0:1789760790.882807:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145544 -> 145552 00010000:00010000:0.0:1789760790.882821:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882834:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882844:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882852:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.882856:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882865:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882885:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.882893:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f072 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74506240->74510335] (req 74506240->74510335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.883049:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5778us (5984us total) trans 4294985498 rc 0/0 00000100:00100000:0.0:1789760790.883060:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18201 00000100:00100000:0.0:1789760790.883069:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729118408379 time 729137547791 state 0x2 ref 0 00000100:00100000:0.0:1789760790.887381:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.887464:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559296 00000100:00100000:1.0:1789760790.887474:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559296 00000100:00100000:1.0:1789760790.887526:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729118408379 time 729137547791 state 0x0 ref 1 00000100:00100000:1.0:1789760790.887541:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729137808207 time 729137547791 state 0x1 ref 1 00000100:00100000:1.0:1789760790.887570:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729137808207 time 729147862373 state 0x0 ref 1 00000100:00100000:1.0:1789760790.887591:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.887951:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74510336, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23890 00010000:00010000:1.0:1789760790.887961:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.888064:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.888070:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.888077:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.888092:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.904921:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985499 is committed 00002000:00010000:1.0:1789760790.905196:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74510336 -> 74514432 00002000:00010000:1.0:1789760790.905202:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145552 -> 145560 00010000:00010000:1.0:1789760790.905215:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905228:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905237:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905245:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.905249:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905258:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905278:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.905291:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f079 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74510336->74514431] (req 74510336->74514431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.905426:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17832us (18049us total) trans 4294985499 rc 0/0 00000100:00100000:1.0:1789760790.905437:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18202 00000100:00100000:1.0:1789760790.905447:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729137808207 time 729147862373 state 0x2 ref 0 00000100:00100000:1.0:1789760790.909966:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.910213:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559424 00000100:00100000:2.0:1789760790.910222:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559424 00000100:00100000:0.0:1789760790.910353:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729137808207 time 729147862373 state 0x0 ref 1 00000100:00100000:0.0:1789760790.910369:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729148122789 time 729147862373 state 0x1 ref 1 00000100:00100000:0.0:1789760790.910434:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729148122789 time 729170726373 state 0x0 ref 1 00000100:00100000:0.0:1789760790.910449:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565559424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760790.910497:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74514432, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x23898 00010000:00010000:0.0:1789760790.910506:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.910523:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760790.910528:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.910534:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.910548:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760790.919453:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985500 is committed 00002000:00010000:2.0:1789760790.919661:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74514432 -> 74518528 00002000:00010000:2.0:1789760790.919666:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145560 -> 145568 00010000:00010000:2.0:1789760790.919680:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919786:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919798:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919805:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.919810:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919819:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919843:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.919850:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f080 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74514432->74518527] (req 74514432->74518527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.919933:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565559424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9483us (9973us total) trans 4294985500 rc 0/0 00000100:00100000:2.0:1789760790.919944:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18203 00000100:00100000:2.0:1789760790.919954:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729148122789 time 729170726373 state 0x2 ref 0 00000100:00100000:0.0:1789760790.923913:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.924056:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559552 00000100:00100000:2.0:1789760790.924065:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559552 00000100:00100000:2.0:1789760790.924117:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729148122789 time 729170726373 state 0x0 ref 1 00000100:00100000:2.0:1789760790.924132:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729170986789 time 729170726373 state 0x1 ref 1 00000100:00100000:2.0:1789760790.924256:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729170986789 time 729184547291 state 0x0 ref 1 00000100:00100000:2.0:1789760790.924270:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565559552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.924318:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74518528, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x238a0 00010000:00010000:2.0:1789760790.924327:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.924342:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760790.924347:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.924354:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.924368:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760790.930459:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985501 is committed 00002000:00010000:2.0:1789760790.930573:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74518528 -> 74522624 00002000:00010000:2.0:1789760790.930578:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145568 -> 145576 00010000:00010000:2.0:1789760790.930592:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930606:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930615:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930624:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.930629:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930789:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930809:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.930822:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f087 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74518528->74522623] (req 74518528->74522623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.930976:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565559552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6703us (7067us total) trans 4294985501 rc 0/0 00000100:00100000:0.0:1789760790.932100:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18204 00000100:00100000:0.0:1789760790.932110:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729170986789 time 729184547291 state 0x2 ref 0 00000100:00100000:0.0:1789760790.942481:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.947108:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559680 00000100:00100000:1.0:1789760790.947123:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559680 00000100:00100000:1.0:1789760790.947191:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729170986789 time 729184547291 state 0x0 ref 1 00000100:00100000:1.0:1789760790.947206:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729184807707 time 729184547291 state 0x1 ref 1 00000100:00100000:1.0:1789760790.947241:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729184807707 time 729207533110 state 0x0 ref 1 00000100:00100000:1.0:1789760790.947255:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565559680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.947301:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74522624, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0x238a8 00010000:00010000:1.0:1789760790.947310:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.947325:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.947328:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.947335:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.947347:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.956813:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985502 is committed 00002000:00010000:1.0:1789760790.957058:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74522624 -> 74526720 00002000:00010000:1.0:1789760790.957062:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760790 -> 1789760791 00002000:00010000:1.0:1789760790.957065:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760790 -> 1789760791 00002000:00010000:1.0:1789760790.957068:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145576 -> 145584 00010000:00010000:1.0:1789760790.957081:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957094:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957103:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957110:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760790.957115:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957123:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957142:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.957152:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f08e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74522624->74526719] (req 74522624->74526719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.957285:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565559680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10028us (14808us total) trans 4294985502 rc 0/0 00000100:00100000:1.0:1789760790.957297:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18205 00000100:00100000:1.0:1789760790.957305:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729184807707 time 729207533110 state 0x2 ref 0 00000100:00100000:1.0:1789760790.962786:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.963242:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559808 00000100:00100000:2.0:1789760790.963253:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559808 00000100:00100000:2.0:1789760790.963314:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729184807707 time 729207533110 state 0x0 ref 1 00000100:00100000:2.0:1789760790.963331:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729207793526 time 729207533110 state 0x1 ref 1 00000100:00100000:2.0:1789760790.963363:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729207793526 time 729223654655 state 0x0 ref 1 00000100:00100000:2.0:1789760790.963374:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.963434:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74526720, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238b0 00010000:00010000:2.0:1789760790.963444:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.963458:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760790.963463:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.963469:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.963483:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760790.969618:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985503 is committed 00002000:00010000:2.0:1789760790.970436:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74526720 -> 74530816 00002000:00010000:2.0:1789760790.970443:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145584 -> 145592 00010000:00010000:2.0:1789760790.970456:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970469:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970478:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970485:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760790.970489:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970497:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970517:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.970524:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f095 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74526720->74530815] (req 74526720->74530815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.970685:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565559808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7306us (7903us total) trans 4294985503 rc 0/0 00000100:00100000:2.0:1789760790.970696:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18206 00000100:00100000:2.0:1789760790.970759:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729207793526 time 729223654655 state 0x2 ref 0 00000100:00100000:0.0:1789760790.981563:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760790.981687:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565559936 00000100:00100000:2.0:1789760790.981697:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565559936 00000100:00100000:2.0:1789760790.981787:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729207793526 time 729223654655 state 0x0 ref 1 00000100:00100000:2.0:1789760790.981805:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729223915071 time 729223654655 state 0x1 ref 1 00000100:00100000:2.0:1789760790.981830:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729223915071 time 729242122650 state 0x0 ref 1 00000100:00100000:2.0:1789760790.981842:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565559936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760790.981891:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74530816, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238b8 00010000:00010000:2.0:1789760790.981901:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.981917:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760790.981922:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.981930:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.981944:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760790.987529:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985504 is committed 00002000:00010000:0.0:1789760790.987931:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74530816 -> 74534912 00002000:00010000:0.0:1789760790.987936:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145592 -> 145600 00010000:00010000:0.0:1789760790.988040:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988055:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988064:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988071:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760790.988075:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988084:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988104:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.988112:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f09c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74530816->74534911] (req 74530816->74534911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.988445:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565559936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6600us (6886us total) trans 4294985504 rc 0/0 00000100:00100000:0.0:1789760790.988456:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18207 00000100:00100000:0.0:1789760790.988464:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729223915071 time 729242122650 state 0x2 ref 0 00000100:00100000:0.0:1789760790.992562:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760790.993099:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560064 00000100:00100000:1.0:1789760790.993109:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560064 00000100:00100000:1.0:1789760790.993162:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729223915071 time 729242122650 state 0x0 ref 1 00000100:00100000:1.0:1789760790.993177:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729242383066 time 729242122650 state 0x1 ref 1 00000100:00100000:1.0:1789760790.993320:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729242383066 time 729253610724 state 0x0 ref 1 00000100:00100000:1.0:1789760790.993334:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760790.993384:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74534912, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238c0 00010000:00010000:1.0:1789760790.993393:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.993411:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760790.993415:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.993421:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.993435:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.000922:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985505 is committed 00002000:00010000:1.0:1789760791.001148:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74534912 -> 74539008 00002000:00010000:1.0:1789760791.001154:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145600 -> 145608 00010000:00010000:1.0:1789760791.001166:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001180:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001201:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001208:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.001213:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001231:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001251:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.001260:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f0a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74534912->74539007] (req 74534912->74539007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.001359:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8022us (8801us total) trans 4294985505 rc 0/0 00000100:00100000:1.0:1789760791.001371:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18208 00000100:00100000:1.0:1789760791.001381:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729242383066 time 729253610724 state 0x2 ref 0 00000100:00100000:1.0:1789760791.005258:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.005447:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560192 00000100:00100000:2.0:1789760791.005457:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560192 00000100:00100000:2.0:1789760791.005513:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729242383066 time 729253610724 state 0x0 ref 1 00000100:00100000:2.0:1789760791.005534:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729253871140 time 729253610724 state 0x1 ref 1 00000100:00100000:2.0:1789760791.005567:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729253871140 time 729265859224 state 0x0 ref 1 00000100:00100000:2.0:1789760791.005580:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.005643:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74539008, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238c8 00010000:00010000:2.0:1789760791.005653:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.005668:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.005673:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.005679:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.005692:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.011615:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985506 is committed 00002000:00010000:2.0:1789760791.012219:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74539008 -> 74543104 00002000:00010000:2.0:1789760791.012225:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145608 -> 145616 00010000:00010000:2.0:1789760791.012238:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012252:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012261:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012269:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.012274:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012284:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012305:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.012313:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74539008->74543103] (req 74539008->74543103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.012405:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6823us (7153us total) trans 4294985506 rc 0/0 00000100:00100000:2.0:1789760791.012415:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18209 00000100:00100000:2.0:1789760791.012425:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729253871140 time 729265859224 state 0x2 ref 0 00000100:00100000:0.0:1789760791.020967:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.021166:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560320 00000100:00100000:2.0:1789760791.021176:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560320 00000100:00100000:2.0:1789760791.021289:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729253871140 time 729265859224 state 0x0 ref 1 00000100:00100000:2.0:1789760791.021305:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729266119640 time 729265859224 state 0x1 ref 1 00000100:00100000:3.0:1789760791.021369:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729266119640 time 729281658241 state 0x0 ref 1 00000100:00100000:3.0:1789760791.021385:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760791.021428:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74543104, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238d0 00010000:00010000:3.0:1789760791.021435:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.021448:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789760791.021452:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760791.021456:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.021465:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.027262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985507 is committed 00002000:00010000:3.0:1789760791.027692:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74543104 -> 74547200 00002000:00010000:3.0:1789760791.027697:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145616 -> 145624 00010000:00010000:3.0:1789760791.027749:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027762:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027770:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027778:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760791.027783:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027791:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027814:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.027823:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74543104->74547199] (req 74543104->74547199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.027933:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6548us (6982us total) trans 4294985507 rc 0/0 00000100:00100000:3.0:1789760791.027944:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18210 00000100:00100000:3.0:1789760791.027954:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729266119640 time 729281658241 state 0x2 ref 0 00000100:00100000:0.0:1789760791.032611:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.032901:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560448 00000100:00100000:1.0:1789760791.032911:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560448 00000100:00100000:1.0:1789760791.032964:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729266119640 time 729281658241 state 0x0 ref 1 00000100:00100000:1.0:1789760791.032980:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729281918657 time 729281658241 state 0x1 ref 1 00000100:00100000:1.0:1789760791.033010:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729281918657 time 729293301511 state 0x0 ref 1 00000100:00100000:1.0:1789760791.033023:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565560448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.033069:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74547200, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238d8 00010000:00010000:1.0:1789760791.033079:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.033094:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.033098:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.033104:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.033116:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.037224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985508 is committed 00002000:00010000:1.0:1789760791.037362:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74547200 -> 74551296 00002000:00010000:1.0:1789760791.037368:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145624 -> 145632 00010000:00010000:1.0:1789760791.037380:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037449:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037457:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037463:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.037469:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037477:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037496:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.037503:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674f0b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74547200->74551295] (req 74547200->74551295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.037741:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565560448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4684us (5104us total) trans 4294985508 rc 0/0 00000100:00100000:1.0:1789760791.037753:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18211 00000100:00100000:1.0:1789760791.037763:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729281918657 time 729293301511 state 0x2 ref 0 00000100:00100000:1.0:1789760791.049020:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.049145:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560576 00000100:00100000:2.0:1789760791.049154:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560576 00000100:00100000:2.0:1789760791.049323:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729281918657 time 729293301511 state 0x0 ref 1 00000100:00100000:2.0:1789760791.049338:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729293561927 time 729293301511 state 0x1 ref 1 00000100:00100000:2.0:1789760791.049424:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729293561927 time 729309715176 state 0x0 ref 1 00000100:00100000:2.0:1789760791.049437:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565560576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.049483:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74551296, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238e0 00010000:00010000:2.0:1789760791.049491:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.049507:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.049511:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.049517:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.049531:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.054206:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985509 is committed 00002000:00010000:2.0:1789760791.054412:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74551296 -> 74555392 00002000:00010000:2.0:1789760791.054417:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145632 -> 145640 00010000:00010000:2.0:1789760791.054430:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054441:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054449:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054458:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.054463:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054472:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054492:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.054498:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74551296->74555391] (req 74551296->74555391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.054756:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565560576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5316us (5740us total) trans 4294985509 rc 0/0 00000100:00100000:2.0:1789760791.054767:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18212 00000100:00100000:2.0:1789760791.054776:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729293561927 time 729309715176 state 0x2 ref 0 00000100:00100000:0.0:1789760791.059086:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760791.059187:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560704 00000100:00100000:3.0:1789760791.059197:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560704 00000100:00100000:3.0:1789760791.059255:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729293561927 time 729309715176 state 0x0 ref 1 00000100:00100000:3.0:1789760791.059271:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729309975592 time 729309715176 state 0x1 ref 1 00000100:00100000:3.0:1789760791.059363:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729309975592 time 729319654265 state 0x0 ref 1 00000100:00100000:3.0:1789760791.059377:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760791.059423:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74555392, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238e8 00010000:00010000:3.0:1789760791.059433:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.059449:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789760791.059453:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760791.059459:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.059473:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.067366:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985510 is committed 00002000:00010000:1.0:1789760791.067696:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74555392 -> 74559488 00002000:00010000:1.0:1789760791.067701:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145640 -> 145648 00010000:00010000:1.0:1789760791.067745:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067758:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067767:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067775:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.067780:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067788:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067807:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.067814:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f0c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74555392->74559487] (req 74555392->74559487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.068001:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8620us (8919us total) trans 4294985510 rc 0/0 00000100:00100000:1.0:1789760791.068013:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18213 00000100:00100000:1.0:1789760791.068023:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729309975592 time 729319654265 state 0x2 ref 0 00000100:00100000:0.0:1789760791.071785:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.071902:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560832 00000100:00100000:1.0:1789760791.071913:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560832 00000100:00100000:1.0:1789760791.071967:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729309975592 time 729319654265 state 0x0 ref 1 00000100:00100000:1.0:1789760791.071994:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729319914681 time 729319654265 state 0x1 ref 1 00000100:00100000:1.0:1789760791.072061:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729319914681 time 729332352445 state 0x0 ref 1 00000100:00100000:1.0:1789760791.072073:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565560832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.072120:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74559488, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238f0 00010000:00010000:1.0:1789760791.072129:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.072145:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.072150:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.072157:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.072171:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.076910:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985511 is committed 00002000:00010000:1.0:1789760791.078213:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74559488 -> 74563584 00002000:00010000:1.0:1789760791.078222:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145648 -> 145656 00010000:00010000:1.0:1789760791.078237:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078249:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078257:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078264:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.078269:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078278:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078298:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.078306:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74559488->74563583] (req 74559488->74563583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.078391:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565560832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6316us (6617us total) trans 4294985511 rc 0/0 00000100:00100000:1.0:1789760791.078403:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18214 00000100:00100000:1.0:1789760791.078413:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729319914681 time 729332352445 state 0x2 ref 0 00000100:00100000:1.0:1789760791.085325:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.085412:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565560960 00000100:00100000:2.0:1789760791.085423:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565560960 00000100:00100000:2.0:1789760791.085478:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729319914681 time 729332352445 state 0x0 ref 1 00000100:00100000:2.0:1789760791.085494:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729332612861 time 729332352445 state 0x1 ref 1 00000100:00100000:2.0:1789760791.085528:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729332612861 time 729345819733 state 0x0 ref 1 00000100:00100000:2.0:1789760791.085540:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.085586:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74563584, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x238f8 00010000:00010000:2.0:1789760791.085596:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.085612:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.085616:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.085861:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.085878:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.092746:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985512 is committed 00002000:00010000:2.0:1789760791.092986:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74563584 -> 74567680 00002000:00010000:2.0:1789760791.092991:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145656 -> 145664 00010000:00010000:2.0:1789760791.093005:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093018:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093027:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093040:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.093044:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093053:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093072:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.093080:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74563584->74567679] (req 74563584->74567679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.093170:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565560960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7628us (7851us total) trans 4294985512 rc 0/0 00000100:00100000:2.0:1789760791.093180:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18215 00000100:00100000:2.0:1789760791.093338:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729332612861 time 729345819733 state 0x2 ref 0 00000100:00100000:0.0:1789760791.100029:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.101046:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561088 00000100:00100000:1.0:1789760791.101058:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561088 00000100:00100000:1.0:1789760791.101115:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729332612861 time 729345819733 state 0x0 ref 1 00000100:00100000:1.0:1789760791.101130:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729346080149 time 729345819733 state 0x1 ref 1 00000100:00100000:1.0:1789760791.101224:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729346080149 time 729361514427 state 0x0 ref 1 00000100:00100000:1.0:1789760791.101238:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565561088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.101286:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74567680, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23900 00010000:00010000:1.0:1789760791.101294:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.101308:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.101312:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.101318:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.101331:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.108648:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985513 is committed 00002000:00010000:1.0:1789760791.110114:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74567680 -> 74571776 00002000:00010000:1.0:1789760791.110122:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145664 -> 145672 00010000:00010000:1.0:1789760791.110136:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110151:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110161:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110169:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.110174:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110183:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110224:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.110233:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74567680->74571775] (req 74567680->74571775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.110866:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565561088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9616us (10831us total) trans 4294985513 rc 0/0 00000100:00100000:1.0:1789760791.110881:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18216 00000100:00100000:1.0:1789760791.110893:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729346080149 time 729361514427 state 0x2 ref 0 00000100:00100000:0.0:1789760791.119442:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.119682:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561216 00000100:00100000:1.0:1789760791.119692:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561216 00000100:00100000:1.0:1789760791.119773:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729346080149 time 729361514427 state 0x0 ref 1 00000100:00100000:1.0:1789760791.119789:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729361774843 time 729361514427 state 0x1 ref 1 00000100:00100000:1.0:1789760791.119809:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729361774843 time 729380101797 state 0x0 ref 1 00000100:00100000:1.0:1789760791.119820:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565561216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.120048:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74571776, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23908 00010000:00010000:1.0:1789760791.120058:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.120074:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.120079:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.120085:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.120099:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.126669:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985514 is committed 00002000:00010000:1.0:1789760791.126816:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74571776 -> 74575872 00002000:00010000:1.0:1789760791.126822:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145672 -> 145680 00010000:00010000:1.0:1789760791.126836:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126864:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126873:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126880:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.126885:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126895:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126914:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.126921:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74571776->74575871] (req 74571776->74575871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.126997:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565561216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7175us (7560us total) trans 4294985514 rc 0/0 00000100:00100000:1.0:1789760791.127007:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18217 00000100:00100000:1.0:1789760791.127015:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729361774843 time 729380101797 state 0x2 ref 0 00000100:00100000:3.0:1789760791.138014:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.138181:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561344 00000100:00100000:2.0:1789760791.138193:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561344 00000100:00100000:2.0:1789760791.138252:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729361774843 time 729380101797 state 0x0 ref 1 00000100:00100000:2.0:1789760791.138267:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729380362213 time 729380101797 state 0x1 ref 1 00000100:00100000:2.0:1789760791.138293:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729380362213 time 729398585515 state 0x0 ref 1 00000100:00100000:2.0:1789760791.138305:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565561344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.138350:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74575872, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23910 00010000:00010000:2.0:1789760791.138360:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.138375:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.138379:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.138386:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.138400:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.146903:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985515 is committed 00002000:00010000:2.0:1789760791.147079:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74575872 -> 74579968 00002000:00010000:2.0:1789760791.147085:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145680 -> 145688 00010000:00010000:2.0:1789760791.147099:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147112:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147122:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147134:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.147138:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147148:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147168:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.147175:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74575872->74579967] (req 74575872->74579967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.147269:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565561344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8961us (9260us total) trans 4294985515 rc 0/0 00000100:00100000:2.0:1789760791.147279:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18218 00000100:00100000:2.0:1789760791.147291:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729380362213 time 729398585515 state 0x2 ref 0 00000100:00100000:0.0:1789760791.158023:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.158196:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561472 00000100:00100000:1.0:1789760791.158206:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561472 00000100:00100000:1.0:1789760791.158260:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729380362213 time 729398585515 state 0x0 ref 1 00000100:00100000:1.0:1789760791.158277:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729398845931 time 729398585515 state 0x1 ref 1 00000100:00100000:1.0:1789760791.158307:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729398845931 time 729418599328 state 0x0 ref 1 00000100:00100000:1.0:1789760791.158320:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.158370:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74579968, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23918 00010000:00010000:1.0:1789760791.158379:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.158406:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.158411:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.158418:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.158432:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.163591:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985516 is committed 00002000:00010000:1.0:1789760791.163763:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74579968 -> 74584064 00002000:00010000:1.0:1789760791.163768:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145688 -> 145696 00010000:00010000:1.0:1789760791.163782:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163795:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163810:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163818:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.163823:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163833:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163852:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.163861:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f0f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74579968->74584063] (req 74579968->74584063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.163959:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5635us (5941us total) trans 4294985516 rc 0/0 00000100:00100000:1.0:1789760791.163970:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18219 00000100:00100000:1.0:1789760791.163980:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729398845931 time 729418599328 state 0x2 ref 0 00000100:00100000:0.0:1789760791.175518:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760791.175693:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561600 00000100:00100000:3.0:1789760791.175720:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561600 00000100:00100000:3.0:1789760791.175781:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729398845931 time 729418599328 state 0x0 ref 1 00000100:00100000:3.0:1789760791.175798:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729418859744 time 729418599328 state 0x1 ref 1 00000100:00100000:3.0:1789760791.175836:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729418859744 time 729436127646 state 0x0 ref 1 00000100:00100000:3.0:1789760791.175851:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760791.175908:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74584064, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23920 00010000:00010000:3.0:1789760791.175917:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.175933:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789760791.175938:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760791.175945:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.175959:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.182640:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985517 is committed 00002000:00010000:3.0:1789760791.182834:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74584064 -> 74588160 00002000:00010000:3.0:1789760791.182839:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145696 -> 145704 00010000:00010000:3.0:1789760791.182852:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182870:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182880:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182888:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760791.182893:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182902:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182926:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.182934:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f0f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74584064->74588159] (req 74584064->74588159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.183050:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7196us (7534us total) trans 4294985517 rc 0/0 00000100:00100000:3.0:1789760791.183062:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18220 00000100:00100000:3.0:1789760791.183073:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729418859744 time 729436127646 state 0x2 ref 0 00000100:00100000:3.0:1789760791.191858:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.192150:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561728 00000100:00100000:2.0:1789760791.192159:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561728 00000100:00100000:2.0:1789760791.192210:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729418859744 time 729436127646 state 0x0 ref 1 00000100:00100000:2.0:1789760791.192226:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729436388062 time 729436127646 state 0x1 ref 1 00000100:00100000:2.0:1789760791.192259:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729436388062 time 729452551120 state 0x0 ref 1 00000100:00100000:2.0:1789760791.192272:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.192320:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74588160, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23928 00010000:00010000:2.0:1789760791.192331:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.192347:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.192352:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.192358:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.192372:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.199563:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985518 is committed 00002000:00010000:2.0:1789760791.199692:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74588160 -> 74592256 00002000:00010000:2.0:1789760791.199697:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145704 -> 145712 00010000:00010000:2.0:1789760791.199744:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199756:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199765:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199772:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.199777:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199786:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199804:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.199812:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f0fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74588160->74592255] (req 74588160->74592255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.199912:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7637us (8062us total) trans 4294985518 rc 0/0 00000100:00100000:2.0:1789760791.199923:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18221 00000100:00100000:2.0:1789760791.199933:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729436388062 time 729452551120 state 0x2 ref 0 00000100:00100000:0.0:1789760791.205748:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.205789:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561856 00000100:00100000:1.0:1789760791.205800:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561856 00000100:00100000:1.0:1789760791.205852:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729436388062 time 729452551120 state 0x0 ref 1 00000100:00100000:1.0:1789760791.205867:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729452811536 time 729452551120 state 0x1 ref 1 00000100:00100000:1.0:1789760791.205946:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729452811536 time 729466237098 state 0x0 ref 1 00000100:00100000:1.0:1789760791.205961:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.206013:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74592256, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23930 00010000:00010000:1.0:1789760791.206022:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.206037:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.206041:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.206048:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.206062:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.210492:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985519 is committed 00002000:00010000:1.0:1789760791.211264:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74592256 -> 74596352 00002000:00010000:1.0:1789760791.211271:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145712 -> 145720 00010000:00010000:1.0:1789760791.211284:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211297:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211306:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211319:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.211325:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211334:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211354:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.211361:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f105 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74592256->74596351] (req 74592256->74596351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.211599:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5635us (5895us total) trans 4294985519 rc 0/0 00000100:00100000:1.0:1789760791.211609:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18222 00000100:00100000:1.0:1789760791.211619:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729452811536 time 729466237098 state 0x2 ref 0 00000100:00100000:0.0:1789760791.219414:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760791.219783:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565561984 00000100:00100000:3.0:1789760791.219794:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565561984 00000100:00100000:3.0:1789760791.219861:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729452811536 time 729466237098 state 0x0 ref 1 00000100:00100000:3.0:1789760791.219878:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729466497514 time 729466237098 state 0x1 ref 1 00000100:00100000:3.0:1789760791.219905:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729466497514 time 729480196859 state 0x0 ref 1 00000100:00100000:3.0:1789760791.219920:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760791.219967:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74596352, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23938 00010000:00010000:3.0:1789760791.220277:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.220295:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:3.0:1789760791.220299:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760791.220305:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.220320:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.224953:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985520 is committed 00002000:00010000:3.0:1789760791.229994:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74596352 -> 74600448 00002000:00010000:3.0:1789760791.230004:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145720 -> 145728 00010000:00010000:3.0:1789760791.231811:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231836:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231846:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231853:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760791.231858:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231868:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231888:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.231897:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f10c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74596352->74600447] (req 74596352->74600447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.232140:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565561984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12220us (12732us total) trans 4294985520 rc 0/0 00000100:00100000:2.0:1789760791.232153:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18223 00000100:00100000:2.0:1789760791.232162:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729466497514 time 729480196859 state 0x2 ref 0 00000100:00100000:3.0:1789760791.239528:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.240242:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562112 00000100:00100000:2.0:1789760791.240253:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562112 00000100:00100000:2.0:1789760791.240308:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729466497514 time 729480196859 state 0x0 ref 1 00000100:00100000:2.0:1789760791.240325:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729480457275 time 729480196859 state 0x1 ref 1 00000100:00100000:2.0:1789760791.240368:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729480457275 time 729500660143 state 0x0 ref 1 00000100:00100000:2.0:1789760791.240381:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565562112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.240427:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74600448, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23940 00010000:00010000:2.0:1789760791.240436:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.240457:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.240461:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.240467:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.240482:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.246439:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985521 is committed 00002000:00010000:2.0:1789760791.246567:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74600448 -> 74604544 00002000:00010000:2.0:1789760791.246573:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145728 -> 145736 00010000:00010000:2.0:1789760791.246587:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246599:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246608:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246621:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.246626:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246643:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246663:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.246672:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f113 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74600448->74604543] (req 74600448->74604543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.247004:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565562112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6620us (7481us total) trans 4294985521 rc 0/0 00000100:00100000:2.0:1789760791.247031:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18224 00000100:00100000:2.0:1789760791.247042:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729480457275 time 729500660143 state 0x2 ref 0 00000100:00100000:0.0:1789760791.255431:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.264245:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562240 00000100:00100000:1.0:1789760791.264262:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562240 00000100:00100000:1.0:1789760791.264328:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729480457275 time 729500660143 state 0x0 ref 1 00000100:00100000:1.0:1789760791.264357:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729500920559 time 729500660143 state 0x1 ref 1 00000100:00100000:1.0:1789760791.264390:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729500920559 time 729524681522 state 0x0 ref 1 00000100:00100000:1.0:1789760791.264407:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.264455:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74604544, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23948 00010000:00010000:1.0:1789760791.264464:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.264480:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.264484:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.264491:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.264504:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.269586:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985522 is committed 00002000:00010000:1.0:1789760791.269870:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74604544 -> 74608640 00002000:00010000:1.0:1789760791.269876:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145736 -> 145744 00010000:00010000:1.0:1789760791.269890:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269901:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269909:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269917:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.269922:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269931:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269950:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.269958:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f11a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74604544->74608639] (req 74604544->74608639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.270586:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6176us (15604us total) trans 4294985522 rc 0/0 00000100:00100000:1.0:1789760791.270597:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18225 00000100:00100000:1.0:1789760791.270607:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729500920559 time 729524681522 state 0x2 ref 0 00000100:00100000:0.0:1789760791.279401:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.279549:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562368 00000100:00100000:2.0:1789760791.279559:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562368 00000100:00100000:2.0:1789760791.279612:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729500920559 time 729524681522 state 0x0 ref 1 00000100:00100000:2.0:1789760791.279628:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729524941938 time 729524681522 state 0x1 ref 1 00000100:00100000:2.0:1789760791.279669:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729524941938 time 729539960331 state 0x0 ref 1 00000100:00100000:2.0:1789760791.279683:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565562368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.279788:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74608640, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23950 00010000:00010000:2.0:1789760791.279797:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.279812:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.279816:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.279823:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.279837:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.291194:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985523 is committed 00002000:00010000:1.0:1789760791.291518:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74608640 -> 74612736 00002000:00010000:1.0:1789760791.291525:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145744 -> 145752 00010000:00010000:1.0:1789760791.291539:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291552:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291561:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291572:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.291577:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291586:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291605:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.291612:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f121 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74608640->74612735] (req 74608640->74612735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.291854:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565562368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12167us (12457us total) trans 4294985523 rc 0/0 00000100:00100000:1.0:1789760791.291865:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18226 00000100:00100000:1.0:1789760791.291874:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729524941938 time 729539960331 state 0x2 ref 0 00000100:00100000:3.0:1789760791.304489:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.304864:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562496 00000100:00100000:2.0:1789760791.304875:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562496 00000100:00100000:2.0:1789760791.304930:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729524941938 time 729539960331 state 0x0 ref 1 00000100:00100000:2.0:1789760791.304946:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729540220747 time 729539960331 state 0x1 ref 1 00000100:00100000:2.0:1789760791.304987:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729540220747 time 729565279267 state 0x0 ref 1 00000100:00100000:2.0:1789760791.305001:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.305048:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74612736, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23958 00010000:00010000:2.0:1789760791.305057:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.305074:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.305078:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.305090:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.305103:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.311228:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985524 is committed 00002000:00010000:2.0:1789760791.311348:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74612736 -> 74616832 00002000:00010000:2.0:1789760791.311354:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145752 -> 145760 00010000:00010000:2.0:1789760791.311373:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311385:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311393:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311401:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.311406:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311415:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311437:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.311445:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f128 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74612736->74616831] (req 74612736->74616831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.311583:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6580us (7099us total) trans 4294985524 rc 0/0 00000100:00100000:2.0:1789760791.311593:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18227 00000100:00100000:2.0:1789760791.311602:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729540220747 time 729565279267 state 0x2 ref 0 00000100:00100000:0.0:1789760791.317024:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.317148:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562624 00000100:00100000:1.0:1789760791.317158:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562624 00000100:00100000:1.0:1789760791.317212:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729540220747 time 729565279267 state 0x0 ref 1 00000100:00100000:1.0:1789760791.317228:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729565539683 time 729565279267 state 0x1 ref 1 00000100:00100000:1.0:1789760791.317257:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729565539683 time 729577549384 state 0x0 ref 1 00000100:00100000:1.0:1789760791.317273:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565562624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.317321:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74616832, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23960 00010000:00010000:1.0:1789760791.317331:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.317348:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.317352:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.317358:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.317372:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.322901:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985525 is committed 00002000:00010000:1.0:1789760791.323208:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74616832 -> 74620928 00002000:00010000:1.0:1789760791.323214:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145760 -> 145768 00010000:00010000:1.0:1789760791.323227:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323239:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323249:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323257:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.323262:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323271:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323289:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.323297:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f12f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74616832->74620927] (req 74616832->74620927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.323427:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565562624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6151us (6408us total) trans 4294985525 rc 0/0 00000100:00100000:1.0:1789760791.323438:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18228 00000100:00100000:1.0:1789760791.323447:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729565539683 time 729577549384 state 0x2 ref 0 00000100:00100000:0.0:1789760791.331605:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.333618:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562752 00000100:00100000:1.0:1789760791.334915:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562752 00000100:00100000:1.0:1789760791.335096:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729565539683 time 729577549384 state 0x0 ref 1 00000100:00100000:1.0:1789760791.335670:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729577809800 time 729577549384 state 0x1 ref 1 00000100:00100000:0.0:1789760791.335860:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729577809800 time 729596149992 state 0x0 ref 1 00000100:00100000:0.0:1789760791.335882:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.335931:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74620928, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23968 00010000:00010000:0.0:1789760791.335942:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.336064:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760791.336069:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.336075:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.336090:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.341504:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985526 is committed 00002000:00010000:0.0:1789760791.341619:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74620928 -> 74625024 00002000:00010000:0.0:1789760791.341623:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145768 -> 145776 00010000:00010000:0.0:1789760791.341645:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341659:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341668:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341676:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.341681:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341690:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341743:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.341752:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f136 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74620928->74625023] (req 74620928->74625023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.341873:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5996us (10272us total) trans 4294985526 rc 0/0 00000100:00100000:0.0:1789760791.341885:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18229 00000100:00100000:0.0:1789760791.341894:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729577809800 time 729596149992 state 0x2 ref 0 00000100:00100000:3.0:1789760791.346902:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.347087:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565562880 00000100:00100000:2.0:1789760791.347097:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565562880 00000100:00100000:2.0:1789760791.347152:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729577809800 time 729596149992 state 0x0 ref 1 00000100:00100000:2.0:1789760791.347167:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729596410408 time 729596149992 state 0x1 ref 1 00000100:00100000:2.0:1789760791.347527:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729596410408 time 729607816397 state 0x0 ref 1 00000100:00100000:2.0:1789760791.347542:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.347589:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74625024, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23970 00010000:00010000:2.0:1789760791.347599:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.347620:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.347624:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.347641:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.347657:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.356293:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985527 is committed 00002000:00010000:2.0:1789760791.356834:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74625024 -> 74629120 00002000:00010000:2.0:1789760791.356841:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145776 -> 145784 00010000:00010000:2.0:1789760791.356854:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356867:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356876:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356883:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.356888:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356897:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356923:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.356931:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f13d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74625024->74629119] (req 74625024->74629119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.357516:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565562880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9969us (10615us total) trans 4294985527 rc 0/0 00000100:00100000:2.0:1789760791.357529:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18230 00000100:00100000:2.0:1789760791.357539:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729596410408 time 729607816397 state 0x2 ref 0 00000100:00100000:2.0:1789760791.365294:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.365768:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563008 00000100:00100000:1.0:1789760791.365778:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563008 00000100:00100000:1.0:1789760791.365834:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729596410408 time 729607816397 state 0x0 ref 1 00000100:00100000:1.0:1789760791.365850:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729608076813 time 729607816397 state 0x1 ref 1 00000100:00100000:1.0:1789760791.365886:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729608076813 time 729626178162 state 0x0 ref 1 00000100:00100000:1.0:1789760791.365897:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565563008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.365944:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74629120, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23978 00010000:00010000:1.0:1789760791.365955:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.365972:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.365977:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.365983:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.365998:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.373246:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985528 is committed 00002000:00010000:1.0:1789760791.373376:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74629120 -> 74633216 00002000:00010000:1.0:1789760791.373381:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145784 -> 145792 00010000:00010000:1.0:1789760791.373394:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373408:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373418:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373432:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.373437:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373447:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373480:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.373489:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f144 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74629120->74633215] (req 74629120->74633215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.373586:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565563008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7685us (8297us total) trans 4294985528 rc 0/0 00000100:00100000:1.0:1789760791.373596:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18231 00000100:00100000:1.0:1789760791.373605:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729608076813 time 729626178162 state 0x2 ref 0 00000100:00100000:0.0:1789760791.378366:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.378804:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563136 00000100:00100000:2.0:1789760791.378813:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563136 00000100:00100000:2.0:1789760791.378868:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729608076813 time 729626178162 state 0x0 ref 1 00000100:00100000:2.0:1789760791.378885:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729626438578 time 729626178162 state 0x1 ref 1 00000100:00100000:2.0:1789760791.378913:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729626438578 time 729639205722 state 0x0 ref 1 00000100:00100000:2.0:1789760791.378925:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.378971:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74633216, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23980 00010000:00010000:2.0:1789760791.378989:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.379011:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.379015:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.379022:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.379037:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.384323:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985529 is committed 00002000:00010000:2.0:1789760791.384538:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74633216 -> 74637312 00002000:00010000:2.0:1789760791.384543:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145792 -> 145800 00010000:00010000:2.0:1789760791.384557:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384570:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384579:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384587:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.384592:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384601:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384624:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.384640:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f14b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74633216->74637311] (req 74633216->74637311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.384790:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5863us (6430us total) trans 4294985529 rc 0/0 00000100:00100000:2.0:1789760791.384801:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18232 00000100:00100000:2.0:1789760791.384811:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729626438578 time 729639205722 state 0x2 ref 0 00000100:00100000:3.0:1789760791.393563:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.393690:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563264 00000100:00100000:2.0:1789760791.393700:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563264 00000100:00100000:2.0:1789760791.393804:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729626438578 time 729639205722 state 0x0 ref 1 00000100:00100000:2.0:1789760791.393818:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729639466138 time 729639205722 state 0x1 ref 1 00000100:00100000:2.0:1789760791.393851:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729639466138 time 729654143141 state 0x0 ref 1 00000100:00100000:2.0:1789760791.393864:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565563264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.393914:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74637312, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23988 00010000:00010000:2.0:1789760791.393924:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.393940:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.393958:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.393964:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.393982:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.400216:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985530 is committed 00002000:00010000:2.0:1789760791.404435:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74637312 -> 74641408 00002000:00010000:2.0:1789760791.404444:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145800 -> 145808 00010000:00010000:2.0:1789760791.404458:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404471:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404480:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404487:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.404492:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404500:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404520:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.404532:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f152 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74637312->74641407] (req 74637312->74641407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.405566:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565563264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11694us (12017us total) trans 4294985530 rc 0/0 00000100:00100000:2.0:1789760791.405580:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18233 00000100:00100000:2.0:1789760791.405589:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729639466138 time 729654143141 state 0x2 ref 0 00000100:00100000:0.0:1789760791.413350:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.413458:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563392 00000100:00100000:1.0:1789760791.413468:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563392 00000100:00100000:1.0:1789760791.413523:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729639466138 time 729654143141 state 0x0 ref 1 00000100:00100000:1.0:1789760791.413538:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729654403557 time 729654143141 state 0x1 ref 1 00000100:00100000:1.0:1789760791.413568:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729654403557 time 729673860066 state 0x0 ref 1 00000100:00100000:1.0:1789760791.413584:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.413644:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74641408, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23990 00010000:00010000:1.0:1789760791.414470:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.414490:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.414495:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.414501:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.414515:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.423224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985531 is committed 00002000:00010000:1.0:1789760791.423341:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74641408 -> 74645504 00002000:00010000:1.0:1789760791.423347:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145808 -> 145816 00010000:00010000:1.0:1789760791.423465:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423477:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423485:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423493:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.423498:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423506:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423525:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.423532:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f159 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74641408->74645503] (req 74641408->74645503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.423665:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10078us (10318us total) trans 4294985531 rc 0/0 00000100:00100000:1.0:1789760791.423676:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18234 00000100:00100000:1.0:1789760791.423685:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729654403557 time 729673860066 state 0x2 ref 0 00000100:00100000:0.0:1789760791.428040:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.428237:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563520 00000100:00100000:2.0:1789760791.428247:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563520 00000100:00100000:2.0:1789760791.428299:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729654403557 time 729673860066 state 0x0 ref 1 00000100:00100000:2.0:1789760791.428314:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729674120482 time 729673860066 state 0x1 ref 1 00000100:00100000:2.0:1789760791.428340:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729674120482 time 729688632256 state 0x0 ref 1 00000100:00100000:2.0:1789760791.428352:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.428398:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74645504, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23998 00010000:00010000:2.0:1789760791.428407:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.428422:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.428427:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.428434:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.428452:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.434178:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985532 is committed 00002000:00010000:0.0:1789760791.434327:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74645504 -> 74649600 00002000:00010000:0.0:1789760791.434332:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145816 -> 145824 00010000:00010000:0.0:1789760791.434345:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434359:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434374:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434383:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.434388:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434398:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434417:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.434426:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f160 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74645504->74649599] (req 74645504->74649599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.434549:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6193us (6512us total) trans 4294985532 rc 0/0 00000100:00100000:0.0:1789760791.434559:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18235 00000100:00100000:0.0:1789760791.434582:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729674120482 time 729688632256 state 0x2 ref 0 00000100:00100000:3.0:1789760791.438563:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.438663:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563648 00000100:00100000:2.0:1789760791.438672:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563648 00000100:00100000:2.0:1789760791.438757:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729674120482 time 729688632256 state 0x0 ref 1 00000100:00100000:2.0:1789760791.438771:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729688892672 time 729688632256 state 0x1 ref 1 00000100:00100000:2.0:1789760791.438792:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729688892672 time 729699085169 state 0x0 ref 1 00000100:00100000:2.0:1789760791.438803:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565563648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.438850:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74649600, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239a0 00010000:00010000:2.0:1789760791.438859:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.438876:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.438881:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.438887:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.438901:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.444463:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985533 is committed 00002000:00010000:2.0:1789760791.444577:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74649600 -> 74653696 00002000:00010000:2.0:1789760791.444582:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145824 -> 145832 00010000:00010000:2.0:1789760791.444596:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444616:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444625:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444648:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.444653:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444662:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444681:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.444689:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f167 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74649600->74653695] (req 74649600->74653695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.444817:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565563648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6009us (6255us total) trans 4294985533 rc 0/0 00000100:00100000:2.0:1789760791.444830:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18236 00000100:00100000:2.0:1789760791.444840:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729688892672 time 729699085169 state 0x2 ref 0 00000100:00100000:2.0:1789760791.454997:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.455095:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563776 00000100:00100000:1.0:1789760791.455105:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563776 00000100:00100000:1.0:1789760791.455160:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729688892672 time 729699085169 state 0x0 ref 1 00000100:00100000:1.0:1789760791.455175:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729699345585 time 729699085169 state 0x1 ref 1 00000100:00100000:1.0:1789760791.455213:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729699345585 time 729715504544 state 0x0 ref 1 00000100:00100000:1.0:1789760791.455225:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565563776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.455271:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74653696, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239a8 00010000:00010000:1.0:1789760791.455281:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.455296:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.455300:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.455306:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.455320:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.459878:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985534 is committed 00002000:00010000:1.0:1789760791.460196:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74653696 -> 74657792 00002000:00010000:1.0:1789760791.460201:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145832 -> 145840 00010000:00010000:1.0:1789760791.460215:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460228:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460237:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460245:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.460250:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460258:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460275:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.460280:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f16e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74653696->74657791] (req 74653696->74657791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.460358:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565563776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5131us (5367us total) trans 4294985534 rc 0/0 00000100:00100000:1.0:1789760791.460368:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18237 00000100:00100000:1.0:1789760791.460376:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729699345585 time 729715504544 state 0x2 ref 0 00000100:00100000:0.0:1789760791.466024:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.466179:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565563904 00000100:00100000:2.0:1789760791.466785:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565563904 00000100:00100000:2.0:1789760791.466839:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729699345585 time 729715504544 state 0x0 ref 1 00000100:00100000:2.0:1789760791.466852:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729715764960 time 729715504544 state 0x1 ref 1 00000100:00100000:2.0:1789760791.466871:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729715764960 time 729727164356 state 0x0 ref 1 00000100:00100000:2.0:1789760791.466879:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.466916:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74657792, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239b0 00010000:00010000:2.0:1789760791.466923:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.466936:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.466939:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.466944:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.467100:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.475688:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985535 is committed 00002000:00010000:2.0:1789760791.475857:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74657792 -> 74661888 00002000:00010000:2.0:1789760791.475862:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145840 -> 145848 00010000:00010000:2.0:1789760791.475875:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475888:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475898:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475906:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.475911:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475920:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475940:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.475948:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f175 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74657792->74661887] (req 74657792->74661887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.476249:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565563904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9365us (10230us total) trans 4294985535 rc 0/0 00000100:00100000:2.0:1789760791.476262:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18238 00000100:00100000:2.0:1789760791.476272:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729715764960 time 729727164356 state 0x2 ref 0 00000100:00100000:3.0:1789760791.479446:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.480315:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564032 00000100:00100000:2.0:1789760791.480328:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564032 00000100:00100000:2.0:1789760791.480385:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729715764960 time 729727164356 state 0x0 ref 1 00000100:00100000:2.0:1789760791.480506:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729727424772 time 729727164356 state 0x1 ref 1 00000100:00100000:2.0:1789760791.480536:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729727424772 time 729740828524 state 0x0 ref 1 00000100:00100000:2.0:1789760791.480612:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.480895:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74661888, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239b8 00010000:00010000:2.0:1789760791.480904:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.480920:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.480924:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.480930:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.480944:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.495163:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985536 is committed 00002000:00010000:2.0:1789760791.495354:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74661888 -> 74665984 00002000:00010000:2.0:1789760791.495360:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145848 -> 145856 00010000:00010000:2.0:1789760791.495373:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495385:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495393:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495401:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.495405:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495413:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495431:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.495439:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f17c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74661888->74665983] (req 74661888->74665983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.495530:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14917us (16088us total) trans 4294985536 rc 0/0 00000100:00100000:2.0:1789760791.495541:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18239 00000100:00100000:2.0:1789760791.495550:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729727424772 time 729740828524 state 0x2 ref 0 00000100:00100000:0.0:1789760791.501417:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.501500:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564160 00000100:00100000:1.0:1789760791.501510:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564160 00000100:00100000:1.0:1789760791.501567:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729727424772 time 729740828524 state 0x0 ref 1 00000100:00100000:1.0:1789760791.501583:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729741088940 time 729740828524 state 0x1 ref 1 00000100:00100000:1.0:1789760791.501655:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729741088940 time 729761945674 state 0x0 ref 1 00000100:00100000:1.0:1789760791.501668:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565564160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.501734:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74665984, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239c0 00010000:00010000:1.0:1789760791.501743:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.501759:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.501764:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.501771:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.501785:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.514433:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985537 is committed 00002000:00010000:1.0:1789760791.517313:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74665984 -> 74670080 00002000:00010000:1.0:1789760791.517321:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145856 -> 145864 00010000:00010000:1.0:1789760791.517334:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517346:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517355:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517362:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.517367:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517377:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517395:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.517408:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f183 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74665984->74670079] (req 74665984->74670079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.517623:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565564160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15952us (16209us total) trans 4294985537 rc 0/0 00000100:00100000:1.0:1789760791.517643:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18240 00000100:00100000:1.0:1789760791.517652:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729741088940 time 729761945674 state 0x2 ref 0 00000100:00100000:1.0:1789760791.535363:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.535486:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564288 00000100:00100000:2.0:1789760791.535496:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564288 00000100:00100000:2.0:1789760791.535557:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729741088940 time 729761945674 state 0x0 ref 1 00000100:00100000:2.0:1789760791.535571:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729762206090 time 729761945674 state 0x1 ref 1 00000100:00100000:2.0:1789760791.535604:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729762206090 time 729795895561 state 0x0 ref 1 00000100:00100000:2.0:1789760791.535615:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565564288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.535671:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74670080, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239c8 00010000:00010000:2.0:1789760791.535681:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.535695:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.535700:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.535747:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.535761:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.546367:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985538 is committed 00002000:00010000:0.0:1789760791.546491:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74670080 -> 74674176 00002000:00010000:0.0:1789760791.546496:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145864 -> 145872 00010000:00010000:0.0:1789760791.546509:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546520:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546529:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546536:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.546541:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546550:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546568:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.546575:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f18a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74670080->74674175] (req 74670080->74674175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.546675:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565564288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11057us (11316us total) trans 4294985538 rc 0/0 00000100:00100000:0.0:1789760791.546688:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18241 00000100:00100000:0.0:1789760791.546698:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729762206090 time 729795895561 state 0x2 ref 0 00000100:00100000:3.0:1789760791.556433:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.556729:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564416 00000100:00100000:2.0:1789760791.556739:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564416 00000100:00100000:2.0:1789760791.556793:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729762206090 time 729795895561 state 0x0 ref 1 00000100:00100000:2.0:1789760791.556809:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729796155977 time 729795895561 state 0x1 ref 1 00000100:00100000:2.0:1789760791.556840:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729796155977 time 729817131916 state 0x0 ref 1 00000100:00100000:2.0:1789760791.556851:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.556897:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74674176, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239d0 00010000:00010000:2.0:1789760791.556906:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.556921:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.556925:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.556932:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.556946:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.563935:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985539 is committed 00002000:00010000:2.0:1789760791.564092:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74674176 -> 74678272 00002000:00010000:2.0:1789760791.564097:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145872 -> 145880 00010000:00010000:2.0:1789760791.564110:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564122:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564130:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564142:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.564147:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564156:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564176:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.564184:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74674176->74678271] (req 74674176->74678271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.564329:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7474us (7900us total) trans 4294985539 rc 0/0 00000100:00100000:2.0:1789760791.564340:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18242 00000100:00100000:2.0:1789760791.564350:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729796155977 time 729817131916 state 0x2 ref 0 00000100:00100000:2.0:1789760791.572547:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.572655:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564544 00000100:00100000:1.0:1789760791.572664:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564544 00000100:00100000:1.0:1789760791.572754:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729796155977 time 729817131916 state 0x0 ref 1 00000100:00100000:1.0:1789760791.572769:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729817392332 time 729817131916 state 0x1 ref 1 00000100:00100000:1.0:1789760791.572796:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729817392332 time 729833088379 state 0x0 ref 1 00000100:00100000:1.0:1789760791.572808:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.572853:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74678272, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239d8 00010000:00010000:1.0:1789760791.572863:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.572878:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.572883:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.572889:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.572904:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.583684:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985540 is committed 00002000:00010000:1.0:1789760791.583843:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74678272 -> 74682368 00002000:00010000:1.0:1789760791.583848:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145880 -> 145888 00010000:00010000:1.0:1789760791.583862:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583876:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583884:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583891:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.583895:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583905:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583924:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.583932:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f198 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74678272->74682367] (req 74678272->74682367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.584032:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11221us (11489us total) trans 4294985540 rc 0/0 00000100:00100000:1.0:1789760791.584043:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18243 00000100:00100000:1.0:1789760791.584053:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729817392332 time 729833088379 state 0x2 ref 0 00000100:00100000:1.0:1789760791.589427:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.589775:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564672 00000100:00100000:0.0:1789760791.589785:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564672 00000100:00100000:0.0:1789760791.589837:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729817392332 time 729833088379 state 0x0 ref 1 00000100:00100000:0.0:1789760791.589852:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729833348795 time 729833088379 state 0x1 ref 1 00000100:00100000:0.0:1789760791.589884:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729833348795 time 729850176801 state 0x0 ref 1 00000100:00100000:0.0:1789760791.589897:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.589943:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74682368, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239e0 00010000:00010000:0.0:1789760791.589953:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.589968:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760791.589972:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.589978:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.589991:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.595827:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985541 is committed 00002000:00010000:0.0:1789760791.595948:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74682368 -> 74686464 00002000:00010000:0.0:1789760791.595953:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145888 -> 145896 00010000:00010000:0.0:1789760791.595967:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.595987:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.595995:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.596003:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.596007:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.596016:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.596036:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.596043:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f19f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74682368->74686463] (req 74682368->74686463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.596131:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6232us (6708us total) trans 4294985541 rc 0/0 00000100:00100000:0.0:1789760791.596143:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18244 00000100:00100000:0.0:1789760791.596152:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729833348795 time 729850176801 state 0x2 ref 0 00000100:00100000:3.0:1789760791.601383:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.601499:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564800 00000100:00100000:2.0:1789760791.601509:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564800 00000100:00100000:2.0:1789760791.601562:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729833348795 time 729850176801 state 0x0 ref 1 00000100:00100000:2.0:1789760791.601577:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729850437217 time 729850176801 state 0x1 ref 1 00000100:00100000:2.0:1789760791.601619:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729850437217 time 729861910813 state 0x0 ref 1 00000100:00100000:2.0:1789760791.601647:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.601697:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74686464, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239e8 00010000:00010000:2.0:1789760791.601739:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.601756:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.601760:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.601767:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.601781:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.607319:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985542 is committed 00002000:00010000:0.0:1789760791.607577:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74686464 -> 74690560 00002000:00010000:0.0:1789760791.607582:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145896 -> 145904 00010000:00010000:0.0:1789760791.607594:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607605:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607614:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607622:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.607636:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607646:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607666:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.607674:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f1a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74686464->74690559] (req 74686464->74690559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.607909:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6259us (6530us total) trans 4294985542 rc 0/0 00000100:00100000:0.0:1789760791.607920:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18245 00000100:00100000:0.0:1789760791.607929:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729850437217 time 729861910813 state 0x2 ref 0 00000100:00100000:2.0:1789760791.612034:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.612231:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565564928 00000100:00100000:1.0:1789760791.612241:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565564928 00000100:00100000:1.0:1789760791.612363:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729850437217 time 729861910813 state 0x0 ref 1 00000100:00100000:1.0:1789760791.612379:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729862171229 time 729861910813 state 0x1 ref 1 00000100:00100000:1.0:1789760791.612441:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729862171229 time 729872732309 state 0x0 ref 1 00000100:00100000:1.0:1789760791.612454:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.612509:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74690560, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239f0 00010000:00010000:1.0:1789760791.612518:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.612535:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.612540:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.612546:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.612568:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.617570:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985543 is committed 00002000:00010000:1.0:1789760791.617799:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74690560 -> 74694656 00002000:00010000:1.0:1789760791.617805:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145904 -> 145912 00010000:00010000:1.0:1789760791.617817:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617830:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617840:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617908:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.617913:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617923:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617942:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.617950:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74690560->74694655] (req 74690560->74694655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.618131:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565564928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5675us (6101us total) trans 4294985543 rc 0/0 00000100:00100000:1.0:1789760791.618142:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18246 00000100:00100000:1.0:1789760791.618152:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729862171229 time 729872732309 state 0x2 ref 0 00000100:00100000:1.0:1789760791.622148:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.622235:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565056 00000100:00100000:0.0:1789760791.622245:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565056 00000100:00100000:0.0:1789760791.622298:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729862171229 time 729872732309 state 0x0 ref 1 00000100:00100000:0.0:1789760791.622314:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729872992725 time 729872732309 state 0x1 ref 1 00000100:00100000:0.0:1789760791.622388:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729872992725 time 729882679162 state 0x0 ref 1 00000100:00100000:0.0:1789760791.622401:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.622460:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74694656, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x239f8 00010000:00010000:0.0:1789760791.622470:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.622486:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760791.622491:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.622497:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.622511:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.630546:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985544 is committed 00002000:00010000:0.0:1789760791.632616:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74694656 -> 74698752 00002000:00010000:0.0:1789760791.632635:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145912 -> 145920 00010000:00010000:0.0:1789760791.632651:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632664:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632675:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632683:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.632688:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632698:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632757:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.632766:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74694656->74698751] (req 74694656->74698751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.632866:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10463us (10723us total) trans 4294985544 rc 0/0 00000100:00100000:0.0:1789760791.632878:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18247 00000100:00100000:0.0:1789760791.632893:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729872992725 time 729882679162 state 0x2 ref 0 00000100:00100000:3.0:1789760791.644465:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.644602:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565184 00000100:00100000:0.0:1789760791.644612:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565184 00000100:00100000:0.0:1789760791.644672:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729872992725 time 729882679162 state 0x0 ref 1 00000100:00100000:0.0:1789760791.644687:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729882939578 time 729882679162 state 0x1 ref 1 00000100:00100000:0.0:1789760791.644739:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729882939578 time 729905030883 state 0x0 ref 1 00000100:00100000:0.0:1789760791.644751:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.644798:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74698752, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a00 00010000:00010000:0.0:1789760791.644807:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.644823:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760791.644828:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.644834:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.644847:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.651612:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985545 is committed 00002000:00010000:1.0:1789760791.652140:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74698752 -> 74702848 00002000:00010000:1.0:1789760791.652146:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145920 -> 145928 00010000:00010000:1.0:1789760791.652160:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652173:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652181:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652189:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.652194:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652203:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652221:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.652230:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f1bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74698752->74702847] (req 74698752->74702847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.652368:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7614us (7919us total) trans 4294985545 rc 0/0 00000100:00100000:1.0:1789760791.652381:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18248 00000100:00100000:1.0:1789760791.652391:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729882939578 time 729905030883 state 0x2 ref 0 00000100:00100000:2.0:1789760791.658142:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.658259:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565312 00000100:00100000:1.0:1789760791.658269:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565312 00000100:00100000:1.0:1789760791.658326:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729882939578 time 729905030883 state 0x0 ref 1 00000100:00100000:1.0:1789760791.658342:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729905291299 time 729905030883 state 0x1 ref 1 00000100:00100000:1.0:1789760791.658412:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729905291299 time 729918703367 state 0x0 ref 1 00000100:00100000:1.0:1789760791.658426:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7c95b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.658472:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74702848, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a08 00010000:00010000:1.0:1789760791.658482:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.658498:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.658503:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.658510:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.658525:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.663307:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985546 is committed 00002000:00010000:1.0:1789760791.663422:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74702848 -> 74706944 00002000:00010000:1.0:1789760791.663427:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145928 -> 145936 00010000:00010000:1.0:1789760791.663440:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663610:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663620:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663636:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.663641:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663651:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663672:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.663679:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74702848->74706943] (req 74702848->74706943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.663854:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7c95b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565565312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5426us (5717us total) trans 4294985546 rc 0/0 00000100:00100000:1.0:1789760791.663865:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18249 00000100:00100000:1.0:1789760791.663874:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729905291299 time 729918703367 state 0x2 ref 0 00000100:00100000:3.0:1789760791.677436:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.677576:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565440 00000100:00100000:0.0:1789760791.677586:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565440 00000100:00100000:0.0:1789760791.677647:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729905291299 time 729918703367 state 0x0 ref 1 00000100:00100000:0.0:1789760791.677663:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729918963783 time 729918703367 state 0x1 ref 1 00000100:00100000:0.0:1789760791.677696:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729918963783 time 729937988277 state 0x0 ref 1 00000100:00100000:0.0:1789760791.677745:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.677792:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74706944, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a10 00010000:00010000:0.0:1789760791.677801:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.677818:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:0.0:1789760791.677823:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.677830:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.677844:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.682018:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985547 is committed 00002000:00010000:2.0:1789760791.685920:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74706944 -> 74711040 00002000:00010000:2.0:1789760791.685931:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145936 -> 145944 00010000:00010000:2.0:1789760791.685945:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.685962:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.685970:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.685977:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.685982:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.685990:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.686009:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.686016:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f1c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74706944->74711039] (req 74706944->74711039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.686262:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8515us (8830us total) trans 4294985547 rc 0/0 00000100:00100000:2.0:1789760791.686273:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18250 00000100:00100000:2.0:1789760791.686282:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729918963783 time 729937988277 state 0x2 ref 0 00000100:00100000:3.0:1789760791.690411:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.690753:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565568 00000100:00100000:1.0:1789760791.690763:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565568 00000100:00100000:1.0:1789760791.690817:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729918963783 time 729937988277 state 0x0 ref 1 00000100:00100000:1.0:1789760791.690831:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729938248693 time 729937988277 state 0x1 ref 1 00000100:00100000:1.0:1789760791.690857:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729938248693 time 729951149140 state 0x0 ref 1 00000100:00100000:1.0:1789760791.690868:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.690913:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74711040, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a18 00010000:00010000:1.0:1789760791.690922:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.690938:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.690942:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.690948:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.690962:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760791.695101:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985548 is committed 00002000:00010000:1.0:1789760791.695237:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74711040 -> 74715136 00002000:00010000:1.0:1789760791.695242:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145944 -> 145952 00010000:00010000:1.0:1789760791.695260:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695272:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695281:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695288:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.695294:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695303:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695326:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.695335:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74711040->74715135] (req 74711040->74715135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.695479:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4607us (5072us total) trans 4294985548 rc 0/0 00000100:00100000:1.0:1789760791.695489:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18251 00000100:00100000:1.0:1789760791.695498:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729938248693 time 729951149140 state 0x2 ref 0 00000100:00100000:0.0:1789760791.700024:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.700101:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565696 00000100:00100000:1.0:1789760791.700111:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565696 00000100:00100000:1.0:1789760791.700163:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729938248693 time 729951149140 state 0x0 ref 1 00000100:00100000:1.0:1789760791.700177:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729951409556 time 729951149140 state 0x1 ref 1 00000100:00100000:1.0:1789760791.700208:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729951409556 time 729960500463 state 0x0 ref 1 00000100:00100000:1.0:1789760791.700221:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565565696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.700266:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74715136, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a20 00010000:00010000:1.0:1789760791.700275:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.700291:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.700296:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.700302:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.700317:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.709523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985549 is committed 00002000:00010000:1.0:1789760791.709736:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74715136 -> 74719232 00002000:00010000:1.0:1789760791.709741:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145952 -> 145960 00010000:00010000:1.0:1789760791.709754:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709782:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709792:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709799:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.709804:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709813:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709834:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.709842:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74715136->74719231] (req 74715136->74719231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.709929:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565565696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9705us (9910us total) trans 4294985549 rc 0/0 00000100:00100000:1.0:1789760791.709940:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18252 00000100:00100000:1.0:1789760791.709949:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729951409556 time 729960500463 state 0x2 ref 0 00000100:00100000:3.0:1789760791.714180:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.714532:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565824 00000100:00100000:2.0:1789760791.714543:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565824 00000100:00100000:2.0:1789760791.714607:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729951409556 time 729960500463 state 0x0 ref 1 00000100:00100000:2.0:1789760791.714623:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729960760879 time 729960500463 state 0x1 ref 1 00000100:00100000:2.0:1789760791.714661:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729960760879 time 729974952779 state 0x0 ref 1 00000100:00100000:2.0:1789760791.714673:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.714747:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74719232, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a28 00010000:00010000:2.0:1789760791.714757:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.714782:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:2.0:1789760791.714786:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.714793:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.714807:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.719306:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985550 is committed 00002000:00010000:2.0:1789760791.719413:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74719232 -> 74723328 00002000:00010000:2.0:1789760791.719418:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145960 -> 145968 00010000:00010000:2.0:1789760791.719430:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719443:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719458:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719465:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.719471:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719479:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719499:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.719507:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74719232->74723327] (req 74719232->74723327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.719608:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4932us (5430us total) trans 4294985550 rc 0/0 00000100:00100000:2.0:1789760791.719618:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18253 00000100:00100000:2.0:1789760791.719637:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729960760879 time 729974952779 state 0x2 ref 0 00000100:00100000:3.0:1789760791.723935:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.724046:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565565952 00000100:00100000:1.0:1789760791.724055:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565565952 00000100:00100000:1.0:1789760791.724105:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729960760879 time 729974952779 state 0x0 ref 1 00000100:00100000:1.0:1789760791.724119:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729975213195 time 729974952779 state 0x1 ref 1 00000100:00100000:1.0:1789760791.724145:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729975213195 time 729984437554 state 0x0 ref 1 00000100:00100000:1.0:1789760791.724158:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.724202:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74723328, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a30 00010000:00010000:1.0:1789760791.724212:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.724228:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.724233:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.724239:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.724252:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.727945:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985551 is committed 00002000:00010000:1.0:1789760791.728149:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74723328 -> 74727424 00002000:00010000:1.0:1789760791.728155:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145968 -> 145976 00010000:00010000:1.0:1789760791.728168:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728180:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728193:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728199:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.728203:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728211:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728230:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.728237:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74723328->74727423] (req 74723328->74727423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.728352:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565565952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4193us (4422us total) trans 4294985551 rc 0/0 00000100:00100000:1.0:1789760791.728362:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18254 00000100:00100000:1.0:1789760791.728372:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729975213195 time 729984437554 state 0x2 ref 0 00000100:00100000:0.0:1789760791.733426:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.733856:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566080 00000100:00100000:1.0:1789760791.733866:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566080 00000100:00100000:1.0:1789760791.733920:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729975213195 time 729984437554 state 0x0 ref 1 00000100:00100000:1.0:1789760791.733937:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729984697970 time 729984437554 state 0x1 ref 1 00000100:00100000:1.0:1789760791.733969:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729984697970 time 729994261992 state 0x0 ref 1 00000100:00100000:1.0:1789760791.733992:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565566080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.734038:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74727424, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a38 00010000:00010000:1.0:1789760791.734048:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.734063:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=729s v=(0 0) 00010000:00010000:1.0:1789760791.734068:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.734074:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.734092:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.739698:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985552 is committed 00002000:00010000:1.0:1789760791.739850:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74727424 -> 74731520 00002000:00010000:1.0:1789760791.739855:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145976 -> 145984 00010000:00010000:1.0:1789760791.739869:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739881:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739890:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739903:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.739908:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739916:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739934:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.739941:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74727424->74731519] (req 74727424->74731519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.740038:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565566080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6044us (6617us total) trans 4294985552 rc 0/0 00000100:00100000:1.0:1789760791.740049:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18255 00000100:00100000:1.0:1789760791.740058:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729984697970 time 729994261992 state 0x2 ref 0 00000100:00100000:3.0:1789760791.743642:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.743836:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566208 00000100:00100000:2.0:1789760791.743845:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566208 00000100:00100000:2.0:1789760791.743892:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729984697970 time 729994261992 state 0x0 ref 1 00000100:00100000:2.0:1789760791.743907:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729994522408 time 729994261992 state 0x1 ref 1 00000100:00100000:2.0:1789760791.743939:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729994522408 time 730004231730 state 0x0 ref 1 00000100:00100000:2.0:1789760791.743950:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.744000:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74731520, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a40 00010000:00010000:2.0:1789760791.744009:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.744025:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760791.744029:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.744035:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.744049:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.747657:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985553 is committed 00002000:00010000:2.0:1789760791.747815:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74731520 -> 74735616 00002000:00010000:2.0:1789760791.747821:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145984 -> 145992 00010000:00010000:2.0:1789760791.747834:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747847:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747856:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747868:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.747873:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747882:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747901:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.747909:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674f1f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74731520->74735615] (req 74731520->74735615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.748002:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4047us (4373us total) trans 4294985553 rc 0/0 00000100:00100000:2.0:1789760791.748012:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18256 00000100:00100000:2.0:1789760791.748022:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729994522408 time 730004231730 state 0x2 ref 0 00000100:00100000:3.0:1789760791.752577:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.752683:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566336 00000100:00100000:1.0:1789760791.752693:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566336 00000100:00100000:1.0:1789760791.752785:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 729994522408 time 730004231730 state 0x0 ref 1 00000100:00100000:1.0:1789760791.752800:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730004492146 time 730004231730 state 0x1 ref 1 00000100:00100000:1.0:1789760791.752825:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730004492146 time 730013117681 state 0x0 ref 1 00000100:00100000:1.0:1789760791.752841:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565566336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.752889:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74735616, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a48 00010000:00010000:1.0:1789760791.752899:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.752916:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.752920:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.752928:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.752942:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.756344:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760791.759530:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985554 is committed 00002000:00010000:1.0:1789760791.759775:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74735616 -> 74739712 00002000:00010000:1.0:1789760791.759781:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145992 -> 146000 00010000:00010000:1.0:1789760791.759795:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759807:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759816:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759823:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.759828:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759837:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759855:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.759863:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f1fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74735616->74739711] (req 74735616->74739711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.760096:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565566336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7252us (7533us total) trans 4294985554 rc 0/0 00000100:00100000:1.0:1789760791.760107:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18257 00000100:00100000:1.0:1789760791.760116:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730004492146 time 730013117681 state 0x2 ref 0 00000100:00100000:0.0:1789760791.771698:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.774423:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566464 00000100:00100000:1.0:1789760791.774437:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566464 00000100:00100000:1.0:1789760791.774751:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730004492146 time 730013117681 state 0x0 ref 1 00000100:00100000:1.0:1789760791.774769:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730013378097 time 730013117681 state 0x1 ref 1 00000100:00100000:1.0:1789760791.774805:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730013378097 time 730035097264 state 0x0 ref 1 00000100:00100000:1.0:1789760791.774820:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.774873:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74739712, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a50 00010000:00010000:1.0:1789760791.774883:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.774900:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.774904:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.774911:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.774925:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.782027:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985555 is committed 00002000:00010000:1.0:1789760791.782418:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74739712 -> 74743808 00002000:00010000:1.0:1789760791.782423:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146000 -> 146008 00010000:00010000:1.0:1789760791.782437:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782660:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782671:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782679:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.782684:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782694:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782808:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.782818:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74739712->74743807] (req 74739712->74743807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.782962:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8141us (11268us total) trans 4294985555 rc 0/0 00000100:00100000:1.0:1789760791.784309:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18258 00000100:00100000:1.0:1789760791.784324:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730013378097 time 730035097264 state 0x2 ref 0 00000100:00100000:3.0:1789760791.786283:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.795495:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566592 00000100:00100000:0.0:1789760791.795510:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566592 00000100:00100000:0.0:1789760791.795755:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730013378097 time 730035097264 state 0x0 ref 1 00000100:00100000:0.0:1789760791.795777:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730035357680 time 730035097264 state 0x1 ref 1 00000100:00100000:0.0:1789760791.795814:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730035357680 time 730056106191 state 0x0 ref 1 00000100:00100000:0.0:1789760791.795828:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.795877:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74743808, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a58 00010000:00010000:0.0:1789760791.795886:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.795902:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760791.795907:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.795913:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.795927:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.800204:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985556 is committed 00002000:00010000:0.0:1789760791.800416:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74743808 -> 74747904 00002000:00010000:0.0:1789760791.800422:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146008 -> 146016 00010000:00010000:0.0:1789760791.800435:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800551:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800561:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800654:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.800659:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800670:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800689:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.800696:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f208 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74743808->74747903] (req 74743808->74747903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.800917:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5088us (14639us total) trans 4294985556 rc 0/0 00000100:00100000:2.0:1789760791.800928:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18259 00000100:00100000:2.0:1789760791.800938:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730035357680 time 730056106191 state 0x2 ref 0 00000100:00100000:3.0:1789760791.805145:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.805247:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566720 00000100:00100000:1.0:1789760791.805256:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566720 00000100:00100000:1.0:1789760791.805310:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730035357680 time 730056106191 state 0x0 ref 1 00000100:00100000:1.0:1789760791.805326:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730056366607 time 730056106191 state 0x1 ref 1 00000100:00100000:1.0:1789760791.805358:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730056366607 time 730065649523 state 0x0 ref 1 00000100:00100000:1.0:1789760791.805370:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.805416:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74747904, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a60 00010000:00010000:1.0:1789760791.805425:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.805441:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.805446:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.805453:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.805466:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760791.813699:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985557 is committed 00002000:00010000:2.0:1789760791.814192:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74747904 -> 74752000 00002000:00010000:2.0:1789760791.814198:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146016 -> 146024 00010000:00010000:2.0:1789760791.814212:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814225:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814234:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814241:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.814246:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814255:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814277:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.814285:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f20f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74747904->74751999] (req 74747904->74751999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.814417:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565566720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9044us (9277us total) trans 4294985557 rc 0/0 00000100:00100000:2.0:1789760791.814427:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18260 00000100:00100000:2.0:1789760791.814436:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730056366607 time 730065649523 state 0x2 ref 0 00000100:00100000:0.0:1789760791.821149:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.821245:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566848 00000100:00100000:1.0:1789760791.821254:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566848 00000100:00100000:1.0:1789760791.821310:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730056366607 time 730065649523 state 0x0 ref 1 00000100:00100000:1.0:1789760791.821325:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730065909939 time 730065649523 state 0x1 ref 1 00000100:00100000:1.0:1789760791.821346:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730065909939 time 730081638355 state 0x0 ref 1 00000100:00100000:1.0:1789760791.821359:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.821405:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74752000, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a68 00010000:00010000:1.0:1789760791.821413:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.821428:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.821433:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.821454:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.821468:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.827441:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985558 is committed 00002000:00010000:1.0:1789760791.827636:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74752000 -> 74756096 00002000:00010000:1.0:1789760791.827642:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146024 -> 146032 00010000:00010000:1.0:1789760791.827655:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827668:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827677:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827683:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.827688:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827696:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827741:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.827749:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f216 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74752000->74756095] (req 74752000->74756095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.828082:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6720us (6937us total) trans 4294985558 rc 0/0 00000100:00100000:1.0:1789760791.828092:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18261 00000100:00100000:1.0:1789760791.828101:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730065909939 time 730081638355 state 0x2 ref 0 00000100:00100000:1.0:1789760791.842730:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.843114:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565566976 00000100:00100000:2.0:1789760791.843124:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565566976 00000100:00100000:2.0:1789760791.843295:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730065909939 time 730081638355 state 0x0 ref 1 00000100:00100000:2.0:1789760791.843313:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730081898771 time 730081638355 state 0x1 ref 1 00000100:00100000:2.0:1789760791.843395:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730081898771 time 730103686229 state 0x0 ref 1 00000100:00100000:2.0:1789760791.843408:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.843467:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74756096, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a70 00010000:00010000:2.0:1789760791.843477:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.843493:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760791.843497:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.843504:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.843518:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.848516:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985559 is committed 00002000:00010000:0.0:1789760791.848789:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74756096 -> 74760192 00002000:00010000:0.0:1789760791.848794:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146032 -> 146040 00010000:00010000:0.0:1789760791.848808:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848822:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848831:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848906:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.848912:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848921:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848942:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.848950:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f21d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74756096->74760191] (req 74756096->74760191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.849137:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565566976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5726us (6427us total) trans 4294985559 rc 0/0 00000100:00100000:0.0:1789760791.849148:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18262 00000100:00100000:0.0:1789760791.849158:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730081898771 time 730103686229 state 0x2 ref 0 00000100:00100000:3.0:1789760791.854175:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.856478:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567104 00000100:00100000:2.0:1789760791.856493:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567104 00000100:00100000:2.0:1789760791.856984:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730081898771 time 730103686229 state 0x0 ref 1 00000100:00100000:2.0:1789760791.857005:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730103946645 time 730103686229 state 0x1 ref 1 00000100:00100000:2.0:1789760791.857096:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730103946645 time 730117388034 state 0x0 ref 1 00000100:00100000:2.0:1789760791.857111:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.857157:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74760192, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a78 00010000:00010000:2.0:1789760791.857167:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.857191:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760791.857196:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.857204:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.857219:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760791.865337:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985560 is committed 00002000:00010000:2.0:1789760791.865595:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74760192 -> 74764288 00002000:00010000:2.0:1789760791.865600:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146040 -> 146048 00010000:00010000:2.0:1789760791.865695:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865727:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865735:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865743:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.865747:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865755:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865774:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.865780:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f224 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74760192->74764287] (req 74760192->74764287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.865915:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8803us (11745us total) trans 4294985560 rc 0/0 00000100:00100000:2.0:1789760791.865925:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18263 00000100:00100000:2.0:1789760791.865935:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730103946645 time 730117388034 state 0x2 ref 0 00000100:00100000:2.0:1789760791.872886:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.876349:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567232 00000100:00100000:1.0:1789760791.876363:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567232 00000100:00100000:1.0:1789760791.876429:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730103946645 time 730117388034 state 0x0 ref 1 00000100:00100000:1.0:1789760791.876445:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730117648450 time 730117388034 state 0x1 ref 1 00000100:00100000:1.0:1789760791.876484:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730117648450 time 730136776248 state 0x0 ref 1 00000100:00100000:1.0:1789760791.876498:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.876547:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74764288, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a80 00010000:00010000:1.0:1789760791.876556:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.876571:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.876575:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.876582:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.876594:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.886223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985561 is committed 00002000:00010000:1.0:1789760791.886539:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74764288 -> 74768384 00002000:00010000:1.0:1789760791.886544:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146048 -> 146056 00010000:00010000:1.0:1789760791.886556:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.886570:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.886579:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.886587:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.886591:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.886601:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.887000:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.887010:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f22b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74764288->74768383] (req 74764288->74768383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.887168:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10667us (14285us total) trans 4294985561 rc 0/0 00000100:00100000:1.0:1789760791.887180:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18264 00000100:00100000:1.0:1789760791.887189:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730117648450 time 730136776248 state 0x2 ref 0 00000100:00100000:1.0:1789760791.894546:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.894667:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567360 00000100:00100000:0.0:1789760791.894678:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567360 00000100:00100000:0.0:1789760791.894759:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730117648450 time 730136776248 state 0x0 ref 1 00000100:00100000:0.0:1789760791.894773:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730137036664 time 730136776248 state 0x1 ref 1 00000100:00100000:0.0:1789760791.894799:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730137036664 time 730155091187 state 0x0 ref 1 00000100:00100000:0.0:1789760791.894814:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565567360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.894861:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74768384, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a88 00010000:00010000:0.0:1789760791.894870:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.894887:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760791.894891:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.894897:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.894910:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.901743:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985562 is committed 00002000:00010000:0.0:1789760791.901864:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74768384 -> 74772480 00002000:00010000:0.0:1789760791.901869:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146056 -> 146064 00010000:00010000:0.0:1789760791.901883:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901894:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901902:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901909:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760791.901914:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901923:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901942:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.901949:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f232 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74768384->74772479] (req 74768384->74772479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.902167:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565567360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7350us (7625us total) trans 4294985562 rc 0/0 00000100:00100000:0.0:1789760791.902178:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18265 00000100:00100000:0.0:1789760791.902187:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730137036664 time 730155091187 state 0x2 ref 0 00000100:00100000:3.0:1789760791.907273:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.907332:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567488 00000100:00100000:2.0:1789760791.907341:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567488 00000100:00100000:2.0:1789760791.907395:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730137036664 time 730155091187 state 0x0 ref 1 00000100:00100000:2.0:1789760791.907409:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730155351603 time 730155091187 state 0x1 ref 1 00000100:00100000:2.0:1789760791.907441:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730155351603 time 730167733210 state 0x0 ref 1 00000100:00100000:2.0:1789760791.907461:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565567488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.907510:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74772480, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a90 00010000:00010000:2.0:1789760791.907520:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.907534:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760791.907539:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.907545:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.907559:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760791.912160:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985563 is committed 00002000:00010000:2.0:1789760791.912440:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74772480 -> 74776576 00002000:00010000:2.0:1789760791.912446:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146064 -> 146072 00010000:00010000:2.0:1789760791.912459:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912471:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912479:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912491:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.912495:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912504:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912524:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.912532:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f239 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74772480->74776575] (req 74772480->74776575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.912670:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565567488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5205us (5401us total) trans 4294985563 rc 0/0 00000100:00100000:2.0:1789760791.912682:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18266 00000100:00100000:2.0:1789760791.912691:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730155351603 time 730167733210 state 0x2 ref 0 00000100:00100000:2.0:1789760791.923533:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.923812:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567616 00000100:00100000:1.0:1789760791.923822:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567616 00000100:00100000:1.0:1789760791.923875:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730155351603 time 730167733210 state 0x0 ref 1 00000100:00100000:1.0:1789760791.923890:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730167993626 time 730167733210 state 0x1 ref 1 00000100:00100000:1.0:1789760791.923923:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730167993626 time 730184215272 state 0x0 ref 1 00000100:00100000:1.0:1789760791.923935:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565567616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.923994:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74776576, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23a98 00010000:00010000:1.0:1789760791.924004:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.924021:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.924026:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.924032:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.924045:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.928908:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985564 is committed 00002000:00010000:1.0:1789760791.929043:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74776576 -> 74780672 00002000:00010000:1.0:1789760791.929062:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146072 -> 146080 00010000:00010000:1.0:1789760791.929076:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929088:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929097:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929104:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.929109:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929117:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929137:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.929145:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74776576->74780671] (req 74776576->74780671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.929290:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565567616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5352us (5762us total) trans 4294985564 rc 0/0 00000100:00100000:1.0:1789760791.929301:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18267 00000100:00100000:1.0:1789760791.929311:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730167993626 time 730184215272 state 0x2 ref 0 00000100:00100000:1.0:1789760791.934671:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.935188:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567744 00000100:00100000:0.0:1789760791.935199:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567744 00000100:00100000:0.0:1789760791.935255:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730167993626 time 730184215272 state 0x0 ref 1 00000100:00100000:0.0:1789760791.935270:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730184475688 time 730184215272 state 0x1 ref 1 00000100:00100000:0.0:1789760791.935294:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730184475688 time 730195585925 state 0x0 ref 1 00000100:00100000:0.0:1789760791.935306:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.935350:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74780672, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x23aa0 00010000:00010000:0.0:1789760791.935360:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.935374:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760791.935378:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.935385:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.935399:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.940498:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985565 is committed 00002000:00010000:1.0:1789760791.940731:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74780672 -> 74784768 00002000:00010000:1.0:1789760791.940736:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760791 -> 1789760792 00002000:00010000:1.0:1789760791.940739:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760791 -> 1789760792 00002000:00010000:1.0:1789760791.940741:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146080 -> 146088 00010000:00010000:1.0:1789760791.940756:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940769:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940779:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940791:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.940796:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940806:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940826:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.940839:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674f247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74780672->74784767] (req 74780672->74784767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.940934:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565567744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5624us (6267us total) trans 4294985565 rc 0/0 00000100:00100000:1.0:1789760791.940943:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18268 00000100:00100000:1.0:1789760791.940953:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730184475688 time 730195585925 state 0x2 ref 0 00000100:00100000:3.0:1789760791.947894:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760791.948466:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565567872 00000100:00100000:2.0:1789760791.948477:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565567872 00000100:00100000:2.0:1789760791.948533:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730184475688 time 730195585925 state 0x0 ref 1 00000100:00100000:2.0:1789760791.948548:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730195846341 time 730195585925 state 0x1 ref 1 00000100:00100000:2.0:1789760791.948583:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730195846341 time 730208874839 state 0x0 ref 1 00000100:00100000:2.0:1789760791.948596:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565567872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760791.948653:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74784768, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23aa8 00010000:00010000:2.0:1789760791.948664:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.948680:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760791.948685:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.948691:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.948726:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.954921:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.954982:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.955020:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.955048:0:5966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568128 00000100:00100000:1.0:1789760791.955057:0:5966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568128 00000100:00100000:2.0:1789760791.955109:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568256 00000100:00100000:2.0:1789760791.955115:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568256 00000100:00100000:1.0:1789760791.955123:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 477 00000100:00100000:1.0:1789760791.955136:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565568128:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760791.955160:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 478 00000100:00100000:2.0:1789760791.955170:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565568256:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760791.955227:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2358:x1876699565568128:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.955236:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 477 00000100:00080000:1.0:1789760791.955261:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760791.955262:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568000 00000100:00100000:3.0:1789760791.955268:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568000 00000100:00100000:3.0:1789760791.955301:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 402 00000100:00100000:3.0:1789760791.955309:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af634c28-3647-4f73-bb24-40d7878858fb+13:2358:x1876699565568000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760791.956317:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2358:x1876699565568256:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1143us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.956328:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 478 00000100:00100000:3.0:1789760791.958121:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af634c28-3647-4f73-bb24-40d7878858fb+13:2358:x1876699565568000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 2803us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.958142:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 402 00000001:00080000:0.0:1789760791.959380:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985566 is committed 00002000:00010000:2.0:1789760791.959531:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74784768 -> 74788864 00002000:00010000:2.0:1789760791.959537:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146088 -> 146096 00010000:00010000:2.0:1789760791.959549:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959560:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959569:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959576:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760791.959580:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959589:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959610:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.959617:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f24e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74784768->74788863] (req 74784768->74788863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.959891:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565567872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11294us (12002us total) trans 4294985566 rc 0/0 00000100:00100000:2.0:1789760791.959901:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18269 00000100:00100000:2.0:1789760791.959910:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730195846341 time 730208874839 state 0x2 ref 0 00000100:00100000:3.0:1789760791.969297:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760791.969409:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568384 00000100:00100000:1.0:1789760791.969418:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568384 00000100:00100000:1.0:1789760791.969472:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730195846341 time 730208874839 state 0x0 ref 1 00000100:00100000:1.0:1789760791.969489:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730209135255 time 730208874839 state 0x1 ref 1 00000100:00100000:1.0:1789760791.969598:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730209135255 time 730229888556 state 0x0 ref 1 00000100:00100000:1.0:1789760791.969613:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565568384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760791.969676:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74788864, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ab0 00010000:00010000:1.0:1789760791.969684:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.969698:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760791.969745:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.969756:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.969771:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760791.981291:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985567 is committed 00002000:00010000:1.0:1789760791.981426:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74788864 -> 74792960 00002000:00010000:1.0:1789760791.981431:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146096 -> 146104 00010000:00010000:1.0:1789760791.981444:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981456:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981464:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981470:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760791.981474:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981482:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981500:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.981506:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74788864->74792959] (req 74788864->74792959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.981673:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565568384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12057us (12380us total) trans 4294985567 rc 0/0 00000100:00100000:1.0:1789760791.981684:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18270 00000100:00100000:1.0:1789760791.981693:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730209135255 time 730229888556 state 0x2 ref 0 00000100:00100000:1.0:1789760791.995758:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760791.995866:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568512 00000100:00100000:0.0:1789760791.995876:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568512 00000100:00100000:0.0:1789760791.996008:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730209135255 time 730229888556 state 0x0 ref 1 00000100:00100000:0.0:1789760791.996086:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730230148972 time 730229888556 state 0x1 ref 1 00000100:00100000:0.0:1789760791.996116:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730230148972 time 730256408125 state 0x0 ref 1 00000100:00100000:0.0:1789760791.996129:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565568512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760791.996280:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74792960, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ab8 00010000:00010000:0.0:1789760791.996290:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.996304:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760791.996308:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.996315:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.996328:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.007364:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985568 is committed 00002000:00010000:0.0:1789760792.007527:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74792960 -> 74797056 00002000:00010000:0.0:1789760792.007533:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146104 -> 146112 00010000:00010000:0.0:1789760792.007547:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007559:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007648:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007656:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.007661:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007671:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007690:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.007722:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f25c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74792960->74797055] (req 74792960->74797055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.007855:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565568512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11724us (12100us total) trans 4294985568 rc 0/0 00000100:00100000:0.0:1789760792.007865:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18271 00000100:00100000:0.0:1789760792.007874:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730230148972 time 730256408125 state 0x2 ref 0 00000100:00100000:2.0:1789760792.015468:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.015574:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568640 00000100:00100000:0.0:1789760792.015584:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568640 00000100:00100000:0.0:1789760792.015670:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730230148972 time 730256408125 state 0x0 ref 1 00000100:00100000:0.0:1789760792.015684:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730256668541 time 730256408125 state 0x1 ref 1 00000100:00100000:0.0:1789760792.015779:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730256668541 time 730276070165 state 0x0 ref 1 00000100:00100000:0.0:1789760792.015794:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565568640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.015843:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74797056, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ac0 00010000:00010000:0.0:1789760792.015853:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.015869:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.015873:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.015880:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.015900:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760792.016321:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789760792.021937:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985569 is committed 00002000:00010000:0.0:1789760792.022786:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74797056 -> 74801152 00002000:00010000:0.0:1789760792.022793:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146112 -> 146120 00010000:00010000:0.0:1789760792.022808:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022820:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022828:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022835:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.022840:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022849:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022868:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.022876:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74797056->74801151] (req 74797056->74801151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.023069:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565568640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7272us (7603us total) trans 4294985569 rc 0/0 00000100:00100000:0.0:1789760792.023080:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18272 00000100:00100000:0.0:1789760792.023089:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730256668541 time 730276070165 state 0x2 ref 0 00000100:00100000:0.0:1789760792.026824:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760792.027002:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568768 00000100:00100000:1.0:1789760792.027011:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568768 00000100:00100000:1.0:1789760792.027080:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730256668541 time 730276070165 state 0x0 ref 1 00000100:00100000:1.0:1789760792.027096:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730276330581 time 730276070165 state 0x1 ref 1 00000100:00100000:1.0:1789760792.027122:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730276330581 time 730287414185 state 0x0 ref 1 00000100:00100000:1.0:1789760792.027134:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565568768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760792.027181:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74801152, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ac8 00010000:00010000:1.0:1789760792.027191:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.027207:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1789760792.027211:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.027219:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.027245:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.033102:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985570 is committed 00002000:00010000:1.0:1789760792.033259:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74801152 -> 74805248 00002000:00010000:1.0:1789760792.033265:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146120 -> 146128 00010000:00010000:1.0:1789760792.033279:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033291:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033301:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033309:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.033314:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033327:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033346:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.033353:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74801152->74805247] (req 74801152->74805247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.033480:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565568768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6343us (6660us total) trans 4294985570 rc 0/0 00000100:00100000:1.0:1789760792.033490:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18273 00000100:00100000:1.0:1789760792.033498:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730276330581 time 730287414185 state 0x2 ref 0 00000100:00100000:1.0:1789760792.041141:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.041255:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565568896 00000100:00100000:0.0:1789760792.041266:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565568896 00000100:00100000:0.0:1789760792.041322:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730276330581 time 730287414185 state 0x0 ref 1 00000100:00100000:0.0:1789760792.041337:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730287674601 time 730287414185 state 0x1 ref 1 00000100:00100000:0.0:1789760792.041484:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730287674601 time 730301775235 state 0x0 ref 1 00000100:00100000:0.0:1789760792.041499:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565568896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.041549:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74805248, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ad0 00010000:00010000:0.0:1789760792.041559:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.041694:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.041699:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.041733:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.041748:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760792.047573:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985571 is committed 00002000:00010000:0.0:1789760792.047872:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74805248 -> 74809344 00002000:00010000:0.0:1789760792.047877:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146128 -> 146136 00010000:00010000:0.0:1789760792.047889:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047900:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047908:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047915:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.047919:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047928:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047948:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.047956:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74805248->74809343] (req 74805248->74809343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.048121:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565568896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6618us (6983us total) trans 4294985571 rc 0/0 00000100:00100000:0.0:1789760792.048132:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18274 00000100:00100000:0.0:1789760792.048141:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730287674601 time 730301775235 state 0x2 ref 0 00000100:00100000:2.0:1789760792.054888:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.055222:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569024 00000100:00100000:0.0:1789760792.055232:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569024 00000100:00100000:0.0:1789760792.055291:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730287674601 time 730301775235 state 0x0 ref 1 00000100:00100000:0.0:1789760792.055305:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730302035651 time 730301775235 state 0x1 ref 1 00000100:00100000:0.0:1789760792.055335:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730302035651 time 730315627374 state 0x0 ref 1 00000100:00100000:0.0:1789760792.055348:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565569024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.055392:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74809344, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ad8 00010000:00010000:0.0:1789760792.055400:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.055416:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.055420:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.055427:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.055441:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760792.067176:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985572 is committed 00002000:00010000:0.0:1789760792.067387:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74809344 -> 74813440 00002000:00010000:0.0:1789760792.067392:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146136 -> 146144 00010000:00010000:0.0:1789760792.067404:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067416:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067424:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067432:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.067437:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067444:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067473:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.067480:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74809344->74813439] (req 74809344->74813439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.069664:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565569024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14306us (14772us total) trans 4294985572 rc 0/0 00000100:00100000:0.0:1789760792.069678:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18275 00000100:00100000:0.0:1789760792.069688:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730302035651 time 730315627374 state 0x2 ref 0 00000100:00100000:1.0:1789760792.080792:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.081189:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569152 00000100:00100000:3.0:1789760792.081199:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569152 00000100:00100000:2.0:1789760792.081382:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730302035651 time 730315627374 state 0x0 ref 1 00000100:00100000:2.0:1789760792.081398:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730315887790 time 730315627374 state 0x1 ref 1 00000100:00100000:2.0:1789760792.081468:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730315887790 time 730341759165 state 0x0 ref 1 00000100:00100000:2.0:1789760792.081483:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.081529:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74813440, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ae0 00010000:00010000:2.0:1789760792.081538:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.081552:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.081556:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.081636:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.081652:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.090533:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985573 is committed 00002000:00010000:2.0:1789760792.090734:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74813440 -> 74817536 00002000:00010000:2.0:1789760792.090739:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146144 -> 146152 00010000:00010000:2.0:1789760792.090757:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090769:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090777:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090784:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.090788:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090797:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090816:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.090823:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f27f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74813440->74817535] (req 74813440->74817535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.090922:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9435us (10133us total) trans 4294985573 rc 0/0 00000100:00100000:2.0:1789760792.090932:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18276 00000100:00100000:2.0:1789760792.090942:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730315887790 time 730341759165 state 0x2 ref 0 00000100:00100000:1.0:1789760792.102231:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.102943:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569280 00000100:00100000:0.0:1789760792.102957:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569280 00000100:00100000:1.0:1789760792.103204:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730315887790 time 730341759165 state 0x0 ref 1 00000100:00100000:1.0:1789760792.103219:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730342019581 time 730341759165 state 0x1 ref 1 00000100:00100000:3.0:1789760792.103290:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730342019581 time 730363580274 state 0x0 ref 1 00000100:00100000:3.0:1789760792.103306:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.103351:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74817536, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ae8 00010000:00010000:3.0:1789760792.103360:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.103376:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.103380:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.103386:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.103406:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.109315:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985574 is committed 00002000:00010000:3.0:1789760792.111486:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74817536 -> 74821632 00002000:00010000:3.0:1789760792.111495:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146152 -> 146160 00010000:00010000:3.0:1789760792.111509:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111522:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111532:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111539:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.111544:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111554:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111642:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.111650:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74817536->74821631] (req 74817536->74821631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.111879:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8571us (9652us total) trans 4294985574 rc 0/0 00000100:00100000:3.0:1789760792.111890:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18277 00000100:00100000:3.0:1789760792.111899:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730342019581 time 730363580274 state 0x2 ref 0 00000100:00100000:1.0:1789760792.117314:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.117542:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569408 00000100:00100000:0.0:1789760792.117551:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569408 00000100:00100000:0.0:1789760792.117607:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730342019581 time 730363580274 state 0x0 ref 1 00000100:00100000:0.0:1789760792.117622:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730363840690 time 730363580274 state 0x1 ref 1 00000100:00100000:0.0:1789760792.117749:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730363840690 time 730378039318 state 0x0 ref 1 00000100:00100000:0.0:1789760792.117763:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.117808:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74821632, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23af0 00010000:00010000:0.0:1789760792.117818:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.117834:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.117838:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.117845:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.117859:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.123329:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985575 is committed 00002000:00010000:2.0:1789760792.123597:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74821632 -> 74825728 00002000:00010000:2.0:1789760792.123603:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146160 -> 146168 00010000:00010000:2.0:1789760792.123617:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123647:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123656:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123663:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.123667:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123676:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123696:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.123728:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674f28d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74821632->74825727] (req 74821632->74825727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.123871:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6106us (6561us total) trans 4294985575 rc 0/0 00000100:00100000:2.0:1789760792.123881:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18278 00000100:00100000:2.0:1789760792.123890:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730363840690 time 730378039318 state 0x2 ref 0 00000100:00100000:1.0:1789760792.132164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.132668:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569536 00000100:00100000:2.0:1789760792.132678:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569536 00000100:00100000:2.0:1789760792.132849:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730363840690 time 730378039318 state 0x0 ref 1 00000100:00100000:2.0:1789760792.132865:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730378299734 time 730378039318 state 0x1 ref 1 00000100:00100000:2.0:1789760792.132965:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730378299734 time 730393189634 state 0x0 ref 1 00000100:00100000:2.0:1789760792.132980:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.133084:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74825728, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23af8 00010000:00010000:2.0:1789760792.133094:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.133110:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.133115:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.133121:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.133135:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.140069:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985576 is committed 00002000:00010000:2.0:1789760792.140193:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74825728 -> 74829824 00002000:00010000:2.0:1789760792.140199:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146168 -> 146176 00010000:00010000:2.0:1789760792.140212:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140230:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140238:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140245:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.140249:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140257:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140277:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.140283:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74825728->74829823] (req 74825728->74829823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.140365:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7383us (8205us total) trans 4294985576 rc 0/0 00000100:00100000:2.0:1789760792.140375:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18279 00000100:00100000:2.0:1789760792.140384:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730378299734 time 730393189634 state 0x2 ref 0 00000100:00100000:1.0:1789760792.144359:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.144436:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569664 00000100:00100000:3.0:1789760792.144445:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569664 00000100:00100000:3.0:1789760792.144495:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730378299734 time 730393189634 state 0x0 ref 1 00000100:00100000:3.0:1789760792.144509:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730393450050 time 730393189634 state 0x1 ref 1 00000100:00100000:3.0:1789760792.144574:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730393450050 time 730404865578 state 0x0 ref 1 00000100:00100000:3.0:1789760792.144586:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.144643:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74829824, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b00 00010000:00010000:3.0:1789760792.144653:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.144668:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.144672:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.144678:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.144691:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.148945:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985577 is committed 00002000:00010000:3.0:1789760792.149226:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74829824 -> 74833920 00002000:00010000:3.0:1789760792.149232:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146176 -> 146184 00010000:00010000:3.0:1789760792.149244:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149257:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149267:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149274:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.149279:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149288:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149304:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.149312:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f29b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74829824->74833919] (req 74829824->74833919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.149426:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4838us (5070us total) trans 4294985577 rc 0/0 00000100:00100000:3.0:1789760792.149437:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18280 00000100:00100000:3.0:1789760792.149446:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730393450050 time 730404865578 state 0x2 ref 0 00000100:00100000:1.0:1789760792.156257:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.156445:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569792 00000100:00100000:2.0:1789760792.156456:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569792 00000100:00100000:2.0:1789760792.156509:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730393450050 time 730404865578 state 0x0 ref 1 00000100:00100000:2.0:1789760792.156524:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730405125994 time 730404865578 state 0x1 ref 1 00000100:00100000:2.0:1789760792.156555:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730405125994 time 730416847359 state 0x0 ref 1 00000100:00100000:2.0:1789760792.156572:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.156616:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74833920, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b08 00010000:00010000:2.0:1789760792.156641:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.156656:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.156661:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.156669:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.156683:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.162475:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985578 is committed 00002000:00010000:3.0:1789760792.167335:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74833920 -> 74838016 00002000:00010000:3.0:1789760792.167345:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146184 -> 146192 00010000:00010000:3.0:1789760792.167358:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167371:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167442:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167451:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.167456:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167465:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167487:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.167495:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74833920->74838015] (req 74833920->74838015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.168070:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565569792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11494us (11818us total) trans 4294985578 rc 0/0 00000100:00100000:3.0:1789760792.168082:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18281 00000100:00100000:3.0:1789760792.168092:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730405125994 time 730416847359 state 0x2 ref 0 00000100:00100000:1.0:1789760792.175905:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.176154:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565569920 00000100:00100000:2.0:1789760792.176164:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565569920 00000100:00100000:2.0:1789760792.176240:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730405125994 time 730416847359 state 0x0 ref 1 00000100:00100000:2.0:1789760792.176256:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730417107775 time 730416847359 state 0x1 ref 1 00000100:00100000:2.0:1789760792.176296:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730417107775 time 730436587772 state 0x0 ref 1 00000100:00100000:2.0:1789760792.176311:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565569920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.176358:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74838016, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b10 00010000:00010000:2.0:1789760792.176367:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.176382:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.176386:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.176392:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.176661:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.184673:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985579 is committed 00002000:00010000:3.0:1789760792.188674:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74838016 -> 74842112 00002000:00010000:3.0:1789760792.188802:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146192 -> 146200 00010000:00010000:3.0:1789760792.188817:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188828:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188837:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188845:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.188850:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188858:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188878:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.188891:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f2a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74838016->74842111] (req 74838016->74842111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.189234:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565569920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12919us (13336us total) trans 4294985579 rc 0/0 00000100:00100000:3.0:1789760792.189245:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18282 00000100:00100000:3.0:1789760792.189255:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730417107775 time 730436587772 state 0x2 ref 0 00000100:00100000:1.0:1789760792.194805:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.194922:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570048 00000100:00100000:3.0:1789760792.194933:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570048 00000100:00100000:3.0:1789760792.195865:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730417107775 time 730436587772 state 0x0 ref 1 00000100:00100000:3.0:1789760792.195885:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730436848188 time 730436587772 state 0x1 ref 1 00000100:00100000:3.0:1789760792.195930:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730436848188 time 730456221558 state 0x0 ref 1 00000100:00100000:3.0:1789760792.195948:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565570048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.196008:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74842112, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b18 00010000:00010000:3.0:1789760792.196018:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.196034:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.196039:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.196045:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.196066:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.204644:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985580 is committed 00002000:00010000:3.0:1789760792.205333:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74842112 -> 74846208 00002000:00010000:3.0:1789760792.205340:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146200 -> 146208 00010000:00010000:3.0:1789760792.205354:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205367:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205376:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205395:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.205400:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205411:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205431:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.205439:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74842112->74846207] (req 74842112->74846207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.205546:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565570048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9600us (10744us total) trans 4294985580 rc 0/0 00000100:00100000:3.0:1789760792.205556:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18283 00000100:00100000:3.0:1789760792.205567:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730436848188 time 730456221558 state 0x2 ref 0 00000100:00100000:1.0:1789760792.213847:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.213935:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570176 00000100:00100000:3.0:1789760792.213944:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570176 00000100:00100000:3.0:1789760792.214014:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730436848188 time 730456221558 state 0x0 ref 1 00000100:00100000:3.0:1789760792.214029:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730456481974 time 730456221558 state 0x1 ref 1 00000100:00100000:3.0:1789760792.214063:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730456481974 time 730474354936 state 0x0 ref 1 00000100:00100000:3.0:1789760792.214076:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.214121:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74846208, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b20 00010000:00010000:3.0:1789760792.214131:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.214146:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.214150:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.214156:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.214280:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.225501:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985581 is committed 00002000:00010000:3.0:1789760792.225916:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74846208 -> 74850304 00002000:00010000:3.0:1789760792.225933:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146208 -> 146216 00010000:00010000:3.0:1789760792.225947:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.225961:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.225978:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.225986:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.225992:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.226104:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.226127:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.226135:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f2b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74846208->74850303] (req 74846208->74850303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.226305:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12226us (12463us total) trans 4294985581 rc 0/0 00000100:00100000:3.0:1789760792.226317:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18284 00000100:00100000:3.0:1789760792.226327:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730456481974 time 730474354936 state 0x2 ref 0 00000100:00100000:1.0:1789760792.233023:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.233156:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570304 00000100:00100000:3.0:1789760792.233165:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570304 00000100:00100000:3.0:1789760792.233222:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730456481974 time 730474354936 state 0x0 ref 1 00000100:00100000:3.0:1789760792.233237:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730474615352 time 730474354936 state 0x1 ref 1 00000100:00100000:3.0:1789760792.233268:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730474615352 time 730493559565 state 0x0 ref 1 00000100:00100000:3.0:1789760792.233280:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565570304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.233324:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74850304, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b28 00010000:00010000:3.0:1789760792.233333:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.233348:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.233352:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.233358:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.233370:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.239632:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985582 is committed 00002000:00010000:3.0:1789760792.239798:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74850304 -> 74854400 00002000:00010000:3.0:1789760792.239803:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146216 -> 146224 00010000:00010000:3.0:1789760792.239817:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239830:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239840:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239847:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.239852:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239862:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239882:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.239891:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74850304->74854399] (req 74850304->74854399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.241778:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565570304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8489us (8753us total) trans 4294985582 rc 0/0 00000100:00100000:2.0:1789760792.241793:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18285 00000100:00100000:2.0:1789760792.241803:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730474615352 time 730493559565 state 0x2 ref 0 00000100:00100000:1.0:1789760792.250150:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.250336:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570432 00000100:00100000:3.0:1789760792.250346:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570432 00000100:00100000:3.0:1789760792.250410:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730474615352 time 730493559565 state 0x0 ref 1 00000100:00100000:3.0:1789760792.250425:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730493819981 time 730493559565 state 0x1 ref 1 00000100:00100000:3.0:1789760792.250510:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730493819981 time 730510801336 state 0x0 ref 1 00000100:00100000:3.0:1789760792.250524:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.250568:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74854400, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b30 00010000:00010000:3.0:1789760792.250578:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.250593:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.250598:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.250604:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.250618:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760792.259241:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985583 is committed 00002000:00010000:3.0:1789760792.259587:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74854400 -> 74858496 00002000:00010000:3.0:1789760792.259592:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146224 -> 146232 00010000:00010000:3.0:1789760792.259605:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259618:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259638:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259650:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.259655:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259664:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259683:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.259691:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74854400->74858495] (req 74854400->74858495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.262185:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11652us (12034us total) trans 4294985583 rc 0/0 00000100:00100000:2.0:1789760792.262200:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18286 00000100:00100000:2.0:1789760792.262209:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730493819981 time 730510801336 state 0x2 ref 0 00000100:00100000:1.0:1789760792.272041:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.273118:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570560 00000100:00100000:3.0:1789760792.276042:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570560 00000100:00100000:3.0:1789760792.276120:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730493819981 time 730510801336 state 0x0 ref 1 00000100:00100000:3.0:1789760792.276135:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730511061752 time 730510801336 state 0x1 ref 1 00000100:00100000:3.0:1789760792.276178:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730511061752 time 730536469768 state 0x0 ref 1 00000100:00100000:3.0:1789760792.276192:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565570560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.276242:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74858496, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b38 00010000:00010000:3.0:1789760792.276251:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.276273:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.276277:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.276283:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.276296:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.289654:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985584 is committed 00002000:00010000:3.0:1789760792.289829:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74858496 -> 74862592 00002000:00010000:3.0:1789760792.289834:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146232 -> 146240 00010000:00010000:3.0:1789760792.289848:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289860:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289869:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289878:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.289883:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289892:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289917:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.289925:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f2cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74858496->74862591] (req 74858496->74862591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.290038:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565570560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13845us (18007us total) trans 4294985584 rc 0/0 00000100:00100000:3.0:1789760792.290048:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18287 00000100:00100000:3.0:1789760792.290057:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730511061752 time 730536469768 state 0x2 ref 0 00000100:00100000:1.0:1789760792.294217:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.294365:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570688 00000100:00100000:2.0:1789760792.294376:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570688 00000100:00100000:2.0:1789760792.294446:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730511061752 time 730536469768 state 0x0 ref 1 00000100:00100000:2.0:1789760792.294460:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730536730184 time 730536469768 state 0x1 ref 1 00000100:00100000:2.0:1789760792.294492:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730536730184 time 730554783889 state 0x0 ref 1 00000100:00100000:2.0:1789760792.294505:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.294559:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74862592, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b40 00010000:00010000:2.0:1789760792.294568:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.294583:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.294588:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.294593:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.294606:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.304193:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985585 is committed 00002000:00010000:2.0:1789760792.304336:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74862592 -> 74866688 00002000:00010000:2.0:1789760792.304341:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146240 -> 146248 00010000:00010000:2.0:1789760792.304356:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304370:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304384:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304391:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.304396:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304405:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304426:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.304434:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74862592->74866687] (req 74862592->74866687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.304526:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d413cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10018us (10311us total) trans 4294985585 rc 0/0 00000100:00100000:2.0:1789760792.304535:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18288 00000100:00100000:2.0:1789760792.304544:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730536730184 time 730554783889 state 0x2 ref 0 00000100:00100000:1.0:1789760792.313840:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.314300:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570816 00000100:00100000:2.0:1789760792.314309:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570816 00000100:00100000:2.0:1789760792.314358:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730536730184 time 730554783889 state 0x0 ref 1 00000100:00100000:2.0:1789760792.314373:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730555044305 time 730554783889 state 0x1 ref 1 00000100:00100000:2.0:1789760792.314402:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730555044305 time 730574693862 state 0x0 ref 1 00000100:00100000:2.0:1789760792.314413:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565570816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.314463:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74866688, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b48 00010000:00010000:2.0:1789760792.314473:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.314490:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.314494:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.314501:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.314514:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.321823:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985586 is committed 00002000:00010000:2.0:1789760792.321941:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74866688 -> 74870784 00002000:00010000:2.0:1789760792.321956:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146248 -> 146256 00010000:00010000:2.0:1789760792.321975:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.321988:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.321997:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.322012:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.322017:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.322026:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.322044:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.322053:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74866688->74870783] (req 74866688->74870783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.322140:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565570816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7724us (8305us total) trans 4294985586 rc 0/0 00000100:00100000:2.0:1789760792.322151:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18289 00000100:00100000:2.0:1789760792.322160:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730555044305 time 730574693862 state 0x2 ref 0 00000100:00100000:1.0:1789760792.328528:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.330536:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565570944 00000100:00100000:3.0:1789760792.330550:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565570944 00000100:00100000:0.0:1789760792.330990:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730555044305 time 730574693862 state 0x0 ref 1 00000100:00100000:0.0:1789760792.331005:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730574954278 time 730574693862 state 0x1 ref 1 00000100:00100000:0.0:1789760792.331167:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730574954278 time 730591456371 state 0x0 ref 1 00000100:00100000:0.0:1789760792.331183:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.331232:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74870784, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b50 00010000:00010000:0.0:1789760792.331242:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.331279:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.331284:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.331291:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.331305:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.341520:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985587 is committed 00002000:00010000:0.0:1789760792.341899:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74870784 -> 74874880 00002000:00010000:0.0:1789760792.341905:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146256 -> 146264 00010000:00010000:0.0:1789760792.341919:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.341937:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.341946:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.341952:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.341957:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.341966:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.341997:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.342005:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74870784->74874879] (req 74870784->74874879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.342099:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565570944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10915us (13575us total) trans 4294985587 rc 0/0 00000100:00100000:0.0:1789760792.342110:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18290 00000100:00100000:0.0:1789760792.342120:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730574954278 time 730591456371 state 0x2 ref 0 00000100:00100000:1.0:1789760792.352816:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.352934:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571072 00000100:00100000:2.0:1789760792.352945:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571072 00000100:00100000:2.0:1789760792.353067:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730574954278 time 730591456371 state 0x0 ref 1 00000100:00100000:2.0:1789760792.353084:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730591716787 time 730591456371 state 0x1 ref 1 00000100:00100000:2.0:1789760792.353115:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730591716787 time 730613406671 state 0x0 ref 1 00000100:00100000:2.0:1789760792.353131:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565571072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.353183:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74874880, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b58 00010000:00010000:2.0:1789760792.353192:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.353208:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.353212:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.353218:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.353232:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.359663:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985588 is committed 00002000:00010000:2.0:1789760792.359835:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74874880 -> 74878976 00002000:00010000:2.0:1789760792.359841:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146264 -> 146272 00010000:00010000:2.0:1789760792.359854:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359868:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359877:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359884:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.359889:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359898:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359918:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.359925:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74874880->74878975] (req 74874880->74878975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.360147:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565571072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7012us (7335us total) trans 4294985588 rc 0/0 00000100:00100000:2.0:1789760792.360157:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18291 00000100:00100000:2.0:1789760792.360166:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730591716787 time 730613406671 state 0x2 ref 0 00000100:00100000:1.0:1789760792.363984:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.364105:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571200 00000100:00100000:2.0:1789760792.364115:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571200 00000100:00100000:2.0:1789760792.364167:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730591716787 time 730613406671 state 0x0 ref 1 00000100:00100000:2.0:1789760792.364182:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730613667087 time 730613406671 state 0x1 ref 1 00000100:00100000:2.0:1789760792.364216:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730613667087 time 730624507845 state 0x0 ref 1 00000100:00100000:2.0:1789760792.364228:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565571200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.364277:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74878976, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b60 00010000:00010000:2.0:1789760792.364287:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.364304:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.364308:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.364314:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.364328:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.372220:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985589 is committed 00002000:00010000:2.0:1789760792.372360:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74878976 -> 74883072 00002000:00010000:2.0:1789760792.372365:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146272 -> 146280 00010000:00010000:2.0:1789760792.372378:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372391:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372401:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372409:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.372414:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372423:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372444:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.372452:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74878976->74883071] (req 74878976->74883071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.372591:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565571200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8361us (8621us total) trans 4294985589 rc 0/0 00000100:00100000:2.0:1789760792.372601:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18292 00000100:00100000:2.0:1789760792.372611:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730613667087 time 730624507845 state 0x2 ref 0 00000100:00100000:1.0:1789760792.386680:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.386879:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571328 00000100:00100000:0.0:1789760792.386888:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571328 00000100:00100000:0.0:1789760792.386941:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730613667087 time 730624507845 state 0x0 ref 1 00000100:00100000:0.0:1789760792.386956:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730624768261 time 730624507845 state 0x1 ref 1 00000100:00100000:0.0:1789760792.387114:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730624768261 time 730647405214 state 0x0 ref 1 00000100:00100000:0.0:1789760792.387128:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565571328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.387177:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74883072, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b68 00010000:00010000:0.0:1789760792.387186:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.387202:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.387206:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.387213:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.387225:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.396280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985590 is committed 00002000:00010000:0.0:1789760792.396503:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74883072 -> 74887168 00002000:00010000:0.0:1789760792.396508:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146280 -> 146288 00010000:00010000:0.0:1789760792.396521:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396538:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396547:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396554:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.396558:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396566:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396584:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.396591:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f2f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74883072->74887167] (req 74883072->74887167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.396926:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565571328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9794us (10249us total) trans 4294985590 rc 0/0 00000100:00100000:0.0:1789760792.396937:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18293 00000100:00100000:0.0:1789760792.396945:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730624768261 time 730647405214 state 0x2 ref 0 00000100:00100000:1.0:1789760792.401946:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.402093:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571456 00000100:00100000:2.0:1789760792.402102:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571456 00000100:00100000:2.0:1789760792.402157:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730624768261 time 730647405214 state 0x0 ref 1 00000100:00100000:2.0:1789760792.402173:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730647665630 time 730647405214 state 0x1 ref 1 00000100:00100000:2.0:1789760792.402204:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730647665630 time 730662495984 state 0x0 ref 1 00000100:00100000:2.0:1789760792.402217:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.402263:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74887168, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b70 00010000:00010000:2.0:1789760792.402273:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.402287:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.402292:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.402298:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.402311:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.412504:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985591 is committed 00002000:00010000:2.0:1789760792.418815:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74887168 -> 74891264 00002000:00010000:2.0:1789760792.418825:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146288 -> 146296 00010000:00010000:2.0:1789760792.418838:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418852:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418861:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418868:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.418873:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418882:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418902:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.418915:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f2fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74887168->74891263] (req 74887168->74891263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.419012:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16792us (17072us total) trans 4294985591 rc 0/0 00000100:00100000:2.0:1789760792.419023:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18294 00000100:00100000:2.0:1789760792.419032:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730647665630 time 730662495984 state 0x2 ref 0 00000100:00100000:1.0:1789760792.425581:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.426479:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571584 00000100:00100000:2.0:1789760792.426490:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571584 00000100:00100000:2.0:1789760792.426543:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730647665630 time 730662495984 state 0x0 ref 1 00000100:00100000:2.0:1789760792.426558:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730662756400 time 730662495984 state 0x1 ref 1 00000100:00100000:2.0:1789760792.426590:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730662756400 time 730686882726 state 0x0 ref 1 00000100:00100000:2.0:1789760792.426602:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565571584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.426665:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74891264, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b78 00010000:00010000:2.0:1789760792.426675:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.426690:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.426695:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.426702:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.426735:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.431756:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985592 is committed 00002000:00010000:2.0:1789760792.431878:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74891264 -> 74895360 00002000:00010000:2.0:1789760792.431883:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146296 -> 146304 00010000:00010000:2.0:1789760792.431896:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431909:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431917:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431923:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.431928:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431936:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431954:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.431962:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74891264->74895359] (req 74891264->74895359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.432070:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565571584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5464us (6493us total) trans 4294985592 rc 0/0 00000100:00100000:2.0:1789760792.432080:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18295 00000100:00100000:2.0:1789760792.432090:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730662756400 time 730686882726 state 0x2 ref 0 00000100:00100000:1.0:1789760792.441580:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.442116:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571712 00000100:00100000:0.0:1789760792.442130:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571712 00000100:00100000:0.0:1789760792.442192:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730662756400 time 730686882726 state 0x0 ref 1 00000100:00100000:0.0:1789760792.442208:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730687143142 time 730686882726 state 0x1 ref 1 00000100:00100000:0.0:1789760792.442289:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730687143142 time 730702579931 state 0x0 ref 1 00000100:00100000:0.0:1789760792.442303:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.442351:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74895360, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b80 00010000:00010000:0.0:1789760792.442362:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.442379:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.442384:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.442390:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.442404:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.452093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985593 is committed 00002000:00010000:2.0:1789760792.452583:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74895360 -> 74899456 00002000:00010000:2.0:1789760792.452672:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146304 -> 146312 00010000:00010000:2.0:1789760792.452688:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452702:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452732:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452740:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.452744:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452753:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452773:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.452787:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74895360->74899455] (req 74895360->74899455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.453087:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10782us (11514us total) trans 4294985593 rc 0/0 00000100:00100000:2.0:1789760792.453098:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18296 00000100:00100000:2.0:1789760792.453108:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730687143142 time 730702579931 state 0x2 ref 0 00000100:00100000:1.0:1789760792.462946:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.465769:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571840 00000100:00100000:2.0:1789760792.465785:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571840 00000100:00100000:2.0:1789760792.465918:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730687143142 time 730702579931 state 0x0 ref 1 00000100:00100000:2.0:1789760792.465934:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730702840347 time 730702579931 state 0x1 ref 1 00000100:00100000:2.0:1789760792.466288:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730702840347 time 730726578465 state 0x0 ref 1 00000100:00100000:2.0:1789760792.466306:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.466357:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74899456, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b88 00010000:00010000:2.0:1789760792.466366:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.466382:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.466386:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.466392:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.466411:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.474197:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985594 is committed 00002000:00010000:1.0:1789760792.474384:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74899456 -> 74903552 00002000:00010000:1.0:1789760792.474390:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146312 -> 146320 00010000:00010000:1.0:1789760792.474415:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474429:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474439:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474447:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.474453:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474462:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474483:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.474492:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674f312 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74899456->74903551] (req 74899456->74903551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.474583:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565571840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8278us (11644us total) trans 4294985594 rc 0/0 00000100:00100000:1.0:1789760792.474594:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18297 00000100:00100000:1.0:1789760792.474603:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730702840347 time 730726578465 state 0x2 ref 0 00000100:00100000:1.0:1789760792.480281:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.482228:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565571968 00000100:00100000:2.0:1789760792.482244:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565571968 00000100:00100000:2.0:1789760792.482327:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730702840347 time 730726578465 state 0x0 ref 1 00000100:00100000:2.0:1789760792.482343:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730726838881 time 730726578465 state 0x1 ref 1 00000100:00100000:2.0:1789760792.482365:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730726838881 time 730742657297 state 0x0 ref 1 00000100:00100000:2.0:1789760792.482381:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565571968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.482432:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74903552, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b90 00010000:00010000:2.0:1789760792.482441:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.482457:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.482462:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.482468:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.482483:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.490365:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985595 is committed 00002000:00010000:2.0:1789760792.490753:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74903552 -> 74907648 00002000:00010000:2.0:1789760792.490758:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146320 -> 146328 00010000:00010000:2.0:1789760792.490771:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490784:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490803:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490810:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.490814:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490822:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490842:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.490850:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9096546/0x721975f94674f319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74903552->74907647] (req 74903552->74907647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.490947:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565571968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8565us (10671us total) trans 4294985595 rc 0/0 00000100:00100000:2.0:1789760792.490957:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18298 00000100:00100000:2.0:1789760792.490974:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730726838881 time 730742657297 state 0x2 ref 0 00000100:00100000:2.0:1789760792.505050:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.508161:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572096 00000100:00100000:0.0:1789760792.508177:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572096 00000100:00100000:0.0:1789760792.508240:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730726838881 time 730742657297 state 0x0 ref 1 00000100:00100000:0.0:1789760792.508255:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730742917713 time 730742657297 state 0x1 ref 1 00000100:00100000:0.0:1789760792.508340:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730742917713 time 730768631376 state 0x0 ref 1 00000100:00100000:0.0:1789760792.508356:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.508405:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74907648, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23b98 00010000:00010000:0.0:1789760792.508416:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.508432:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1789760792.508437:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.508443:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.508459:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.518119:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985596 is committed 00002000:00010000:0.0:1789760792.518856:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74907648 -> 74911744 00002000:00010000:0.0:1789760792.518862:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146328 -> 146336 00010000:00010000:0.0:1789760792.518876:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518888:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518896:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518907:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.518912:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518919:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518937:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.518945:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74907648->74911743] (req 74907648->74911743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.519137:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10780us (14093us total) trans 4294985596 rc 0/0 00000100:00100000:0.0:1789760792.519147:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18299 00000100:00100000:0.0:1789760792.519156:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730742917713 time 730768631376 state 0x2 ref 0 00000100:00100000:1.0:1789760792.529057:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.529192:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572224 00000100:00100000:3.0:1789760792.529203:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572224 00000100:00100000:3.0:1789760792.529255:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730742917713 time 730768631376 state 0x0 ref 1 00000100:00100000:3.0:1789760792.529270:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730768891792 time 730768631376 state 0x1 ref 1 00000100:00100000:3.0:1789760792.529297:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730768891792 time 730789589009 state 0x0 ref 1 00000100:00100000:3.0:1789760792.529309:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.529360:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74911744, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ba0 00010000:00010000:3.0:1789760792.529369:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.529383:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.529387:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.529394:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.529407:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.540899:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985597 is committed 00002000:00010000:3.0:1789760792.541101:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74911744 -> 74915840 00002000:00010000:3.0:1789760792.541106:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146336 -> 146344 00010000:00010000:3.0:1789760792.541120:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541132:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541141:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541148:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.541153:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541167:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541186:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.541193:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74911744->74915839] (req 74911744->74915839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.541300:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11988us (12248us total) trans 4294985597 rc 0/0 00000100:00100000:3.0:1789760792.541311:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18300 00000100:00100000:3.0:1789760792.541321:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730768891792 time 730789589009 state 0x2 ref 0 00000100:00100000:1.0:1789760792.553293:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.556952:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572352 00000100:00100000:2.0:1789760792.557020:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572352 00000100:00100000:2.0:1789760792.557088:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730768891792 time 730789589009 state 0x0 ref 1 00000100:00100000:2.0:1789760792.557104:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730789849425 time 730789589009 state 0x1 ref 1 00000100:00100000:2.0:1789760792.557202:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730789849425 time 730817493190 state 0x0 ref 1 00000100:00100000:2.0:1789760792.557216:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565572352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.557263:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74915840, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23ba8 00010000:00010000:2.0:1789760792.557273:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.557289:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.557293:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.557299:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.557313:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.563529:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985598 is committed 00002000:00010000:2.0:1789760792.563731:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74915840 -> 74919936 00002000:00010000:2.0:1789760792.563737:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146344 -> 146352 00010000:00010000:2.0:1789760792.563750:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563767:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563776:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563784:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.563789:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563798:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563817:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.563824:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f32e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74915840->74919935] (req 74915840->74919935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.563959:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565572352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6742us (10987us total) trans 4294985598 rc 0/0 00000100:00100000:2.0:1789760792.563979:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18301 00000100:00100000:2.0:1789760792.563989:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730789849425 time 730817493190 state 0x2 ref 0 00000100:00100000:0.0:1789760792.580943:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.581324:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572480 00000100:00100000:2.0:1789760792.581396:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572480 00000100:00100000:2.0:1789760792.581450:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730789849425 time 730817493190 state 0x0 ref 1 00000100:00100000:2.0:1789760792.581465:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730817753606 time 730817493190 state 0x1 ref 1 00000100:00100000:2.0:1789760792.581527:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730817753606 time 730841818821 state 0x0 ref 1 00000100:00100000:2.0:1789760792.581540:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.581585:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74919936, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bb0 00010000:00010000:2.0:1789760792.581594:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.581609:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.581613:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.581807:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.581827:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.594373:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985599 is committed 00002000:00010000:2.0:1789760792.603828:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74919936 -> 74924032 00002000:00010000:2.0:1789760792.603839:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146352 -> 146360 00010000:00010000:2.0:1789760792.603855:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603869:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603885:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603893:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.603897:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603907:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603928:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.603937:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74919936->74924031] (req 74919936->74924031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.604362:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 22818us (23422us total) trans 4294985599 rc 0/0 00000100:00100000:2.0:1789760792.604374:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18302 00000100:00100000:2.0:1789760792.604382:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730817753606 time 730841818821 state 0x2 ref 0 00000100:00100000:1.0:1789760792.618257:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.618402:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572608 00000100:00100000:3.0:1789760792.618411:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572608 00000100:00100000:3.0:1789760792.618466:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730817753606 time 730841818821 state 0x0 ref 1 00000100:00100000:3.0:1789760792.618482:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730842079237 time 730841818821 state 0x1 ref 1 00000100:00100000:3.0:1789760792.618512:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730842079237 time 730878804421 state 0x0 ref 1 00000100:00100000:3.0:1789760792.618525:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565572608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.618575:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74924032, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bb8 00010000:00010000:3.0:1789760792.618584:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.618600:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.618605:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.618612:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.618640:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.627853:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985600 is committed 00002000:00010000:1.0:1789760792.628055:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74924032 -> 74928128 00002000:00010000:1.0:1789760792.628061:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146360 -> 146368 00010000:00010000:1.0:1789760792.628076:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628099:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628108:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628115:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.628120:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628129:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628149:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.628156:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f33c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74924032->74928127] (req 74924032->74928127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.628385:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565572608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9857us (10133us total) trans 4294985600 rc 0/0 00000100:00100000:1.0:1789760792.628397:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18303 00000100:00100000:1.0:1789760792.628407:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730842079237 time 730878804421 state 0x2 ref 0 00000100:00100000:1.0:1789760792.636842:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.636961:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572736 00000100:00100000:2.0:1789760792.636971:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572736 00000100:00100000:2.0:1789760792.637025:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730842079237 time 730878804421 state 0x0 ref 1 00000100:00100000:2.0:1789760792.637039:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730879064837 time 730878804421 state 0x1 ref 1 00000100:00100000:2.0:1789760792.637805:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730879064837 time 730898091889 state 0x0 ref 1 00000100:00100000:2.0:1789760792.637822:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.637866:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74928128, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bc0 00010000:00010000:2.0:1789760792.637875:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.637891:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.637895:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.637902:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.637916:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.650281:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985601 is committed 00002000:00010000:2.0:1789760792.650446:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74928128 -> 74932224 00002000:00010000:2.0:1789760792.650452:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146368 -> 146376 00010000:00010000:2.0:1789760792.650467:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650481:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650490:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650504:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.650510:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650520:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650540:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.650548:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74928128->74932223] (req 74928128->74932223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.650878:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13053us (14040us total) trans 4294985601 rc 0/0 00000100:00100000:2.0:1789760792.650889:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18304 00000100:00100000:2.0:1789760792.650899:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730879064837 time 730898091889 state 0x2 ref 0 00000100:00100000:1.0:1789760792.658931:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.661315:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572864 00000100:00100000:2.0:1789760792.661330:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572864 00000100:00100000:3.0:1789760792.661465:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730879064837 time 730898091889 state 0x0 ref 1 00000100:00100000:3.0:1789760792.661482:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730898352305 time 730898091889 state 0x1 ref 1 00000100:00100000:3.0:1789760792.661516:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730898352305 time 730921807799 state 0x0 ref 1 00000100:00100000:3.0:1789760792.661531:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.661773:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74932224, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bc8 00010000:00010000:3.0:1789760792.661784:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.661801:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.661806:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.661812:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.661831:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.672396:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985602 is committed 00002000:00010000:3.0:1789760792.672550:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74932224 -> 74936320 00002000:00010000:3.0:1789760792.672554:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146376 -> 146384 00010000:00010000:3.0:1789760792.672567:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672579:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672587:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672595:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.672599:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672608:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672640:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.672647:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f34a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74932224->74936319] (req 74932224->74936319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.673069:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565572864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11534us (14139us total) trans 4294985602 rc 0/0 00000100:00100000:3.0:1789760792.673082:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18305 00000100:00100000:3.0:1789760792.673093:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730898352305 time 730921807799 state 0x2 ref 0 00000100:00100000:1.0:1789760792.681427:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.681643:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565572992 00000100:00100000:3.0:1789760792.681654:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565572992 00000100:00100000:3.0:1789760792.681744:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730898352305 time 730921807799 state 0x0 ref 1 00000100:00100000:3.0:1789760792.681761:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730922068215 time 730921807799 state 0x1 ref 1 00000100:00100000:3.0:1789760792.681782:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730922068215 time 730942075145 state 0x0 ref 1 00000100:00100000:3.0:1789760792.681795:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565572992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.681848:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74936320, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bd0 00010000:00010000:3.0:1789760792.681858:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.681878:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.681883:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.681890:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.681903:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760792.688912:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985603 is committed 00002000:00010000:3.0:1789760792.689063:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74936320 -> 74940416 00002000:00010000:3.0:1789760792.689068:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146384 -> 146392 00010000:00010000:3.0:1789760792.689082:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689179:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689191:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689198:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.689202:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689211:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689230:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.689236:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74936320->74940415] (req 74936320->74940415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.689492:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565572992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7691us (8067us total) trans 4294985603 rc 0/0 00000100:00100000:3.0:1789760792.689503:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18306 00000100:00100000:3.0:1789760792.689512:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730922068215 time 730942075145 state 0x2 ref 0 00000100:00100000:1.0:1789760792.694606:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.694750:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573120 00000100:00100000:2.0:1789760792.694759:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573120 00000100:00100000:2.0:1789760792.694813:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730922068215 time 730942075145 state 0x0 ref 1 00000100:00100000:2.0:1789760792.694828:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730942335561 time 730942075145 state 0x1 ref 1 00000100:00100000:2.0:1789760792.694862:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730942335561 time 730955154028 state 0x0 ref 1 00000100:00100000:2.0:1789760792.694875:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565573120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.694923:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74940416, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bd8 00010000:00010000:2.0:1789760792.694933:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.694948:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.694953:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.694959:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.695117:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.706080:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985604 is committed 00002000:00010000:2.0:1789760792.706474:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74940416 -> 74944512 00002000:00010000:2.0:1789760792.706480:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146392 -> 146400 00010000:00010000:2.0:1789760792.706494:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706507:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706517:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706530:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.706534:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706544:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706564:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.706572:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74940416->74944511] (req 74940416->74944511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.706938:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565573120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12061us (12337us total) trans 4294985604 rc 0/0 00000100:00100000:2.0:1789760792.706949:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18307 00000100:00100000:2.0:1789760792.706959:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730942335561 time 730955154028 state 0x2 ref 0 00000100:00100000:1.0:1789760792.711937:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.712248:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573248 00000100:00100000:3.0:1789760792.712258:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573248 00000100:00100000:3.0:1789760792.712313:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730942335561 time 730955154028 state 0x0 ref 1 00000100:00100000:3.0:1789760792.712328:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730955414444 time 730955154028 state 0x1 ref 1 00000100:00100000:3.0:1789760792.712405:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730955414444 time 730972696137 state 0x0 ref 1 00000100:00100000:3.0:1789760792.712419:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565573248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.712465:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74944512, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23be0 00010000:00010000:3.0:1789760792.712478:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.712497:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.712501:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.712507:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.712521:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.718804:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985605 is committed 00002000:00010000:3.0:1789760792.718928:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74944512 -> 74948608 00002000:00010000:3.0:1789760792.718933:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146400 -> 146408 00010000:00010000:3.0:1789760792.718946:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.718959:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.718967:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.718976:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.718981:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.718991:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.719010:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.719019:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f35f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74944512->74948607] (req 74944512->74948607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.719109:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565573248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6689us (7177us total) trans 4294985605 rc 0/0 00000100:00100000:3.0:1789760792.719120:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18308 00000100:00100000:3.0:1789760792.719130:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730955414444 time 730972696137 state 0x2 ref 0 00000100:00100000:1.0:1789760792.722435:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.722510:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573376 00000100:00100000:3.0:1789760792.722519:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573376 00000100:00100000:3.0:1789760792.722582:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730955414444 time 730972696137 state 0x0 ref 1 00000100:00100000:3.0:1789760792.722598:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730972956553 time 730972696137 state 0x1 ref 1 00000100:00100000:3.0:1789760792.722636:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730972956553 time 730982927725 state 0x0 ref 1 00000100:00100000:3.0:1789760792.722650:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565573376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.722730:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74948608, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23be8 00010000:00010000:3.0:1789760792.722740:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.722755:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1789760792.722760:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.722766:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.722781:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.729566:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985606 is committed 00002000:00010000:3.0:1789760792.730205:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74948608 -> 74952704 00002000:00010000:3.0:1789760792.730211:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146408 -> 146416 00010000:00010000:3.0:1789760792.730223:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730255:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730265:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730275:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.730279:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730288:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730308:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.730316:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74948608->74952703] (req 74948608->74952703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.730433:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565573376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7776us (7997us total) trans 4294985606 rc 0/0 00000100:00100000:3.0:1789760792.730449:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18309 00000100:00100000:3.0:1789760792.730466:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730972956553 time 730982927725 state 0x2 ref 0 00000100:00100000:1.0:1789760792.735224:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.735446:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573504 00000100:00100000:2.0:1789760792.735455:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573504 00000100:00100000:2.0:1789760792.735510:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730972956553 time 730982927725 state 0x0 ref 1 00000100:00100000:2.0:1789760792.735526:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730983188141 time 730982927725 state 0x1 ref 1 00000100:00100000:2.0:1789760792.735559:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730983188141 time 730995851604 state 0x0 ref 1 00000100:00100000:2.0:1789760792.735574:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.735882:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74952704, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bf0 00010000:00010000:2.0:1789760792.735893:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.735909:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1789760792.735914:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.735920:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.735935:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.744818:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985607 is committed 00002000:00010000:2.0:1789760792.744934:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74952704 -> 74956800 00002000:00010000:2.0:1789760792.744940:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146416 -> 146424 00010000:00010000:2.0:1789760792.744954:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.744968:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.744978:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.744986:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.744991:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.745000:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.745021:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.745028:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f36d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74952704->74956799] (req 74952704->74956799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.745435:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9857us (10214us total) trans 4294985607 rc 0/0 00000100:00100000:2.0:1789760792.745447:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18310 00000100:00100000:2.0:1789760792.745456:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730983188141 time 730995851604 state 0x2 ref 0 00000100:00100000:1.0:1789760792.753091:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.753239:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573632 00000100:00100000:3.0:1789760792.753250:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573632 00000100:00100000:3.0:1789760792.753311:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730983188141 time 730995851604 state 0x0 ref 1 00000100:00100000:3.0:1789760792.753327:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730996112020 time 730995851604 state 0x1 ref 1 00000100:00100000:3.0:1789760792.753353:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730996112020 time 731013645100 state 0x0 ref 1 00000100:00100000:3.0:1789760792.753366:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.753414:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74956800, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23bf8 00010000:00010000:3.0:1789760792.753423:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.753439:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.753443:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.753449:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.753462:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.764568:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985608 is committed 00002000:00010000:3.0:1789760792.765089:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74956800 -> 74960896 00002000:00010000:3.0:1789760792.765095:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146424 -> 146432 00010000:00010000:3.0:1789760792.765107:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765119:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765133:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765140:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.765145:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765154:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765173:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.765181:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74956800->74960895] (req 74956800->74960895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.765273:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11905us (12189us total) trans 4294985608 rc 0/0 00000100:00100000:3.0:1789760792.765284:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18311 00000100:00100000:3.0:1789760792.765293:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730996112020 time 731013645100 state 0x2 ref 0 00000100:00100000:1.0:1789760792.775541:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.775645:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573760 00000100:00100000:3.0:1789760792.775655:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573760 00000100:00100000:3.0:1789760792.775734:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 730996112020 time 731013645100 state 0x0 ref 1 00000100:00100000:3.0:1789760792.775756:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731013905516 time 731013645100 state 0x1 ref 1 00000100:00100000:3.0:1789760792.775777:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731013905516 time 731036069225 state 0x0 ref 1 00000100:00100000:3.0:1789760792.775789:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565573760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.775832:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74960896, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c00 00010000:00010000:3.0:1789760792.775841:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.775855:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.775859:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.775865:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.775878:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.779919:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760792.783119:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985609 is committed 00002000:00010000:3.0:1789760792.783261:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74960896 -> 74964992 00002000:00010000:3.0:1789760792.783276:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146432 -> 146440 00010000:00010000:3.0:1789760792.783290:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783304:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783313:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783327:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.783332:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783493:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783513:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.783521:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f37b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74960896->74964991] (req 74960896->74964991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.783666:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565573760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7873us (8129us total) trans 4294985609 rc 0/0 00000100:00100000:3.0:1789760792.783677:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18312 00000100:00100000:3.0:1789760792.783686:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731013905516 time 731036069225 state 0x2 ref 0 00000100:00100000:1.0:1789760792.791661:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.791773:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565573888 00000100:00100000:2.0:1789760792.791783:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565573888 00000100:00100000:2.0:1789760792.791834:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731013905516 time 731036069225 state 0x0 ref 1 00000100:00100000:2.0:1789760792.791848:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731036329641 time 731036069225 state 0x1 ref 1 00000100:00100000:2.0:1789760792.791877:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731036329641 time 731052169093 state 0x0 ref 1 00000100:00100000:2.0:1789760792.791888:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.791931:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74964992, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c08 00010000:00010000:2.0:1789760792.791941:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.791957:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760792.791961:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.791977:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.791991:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.799700:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985610 is committed 00002000:00010000:2.0:1789760792.799826:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74964992 -> 74969088 00002000:00010000:2.0:1789760792.799831:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146440 -> 146448 00010000:00010000:2.0:1789760792.799844:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799857:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799866:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799873:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.799878:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799887:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799907:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.799914:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74964992->74969087] (req 74964992->74969087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.800055:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e5f4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565573888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8164us (8401us total) trans 4294985610 rc 0/0 00000100:00100000:2.0:1789760792.800065:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18313 00000100:00100000:2.0:1789760792.800075:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731036329641 time 731052169093 state 0x2 ref 0 00000100:00100000:1.0:1789760792.804216:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.804307:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574016 00000100:00100000:3.0:1789760792.804318:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574016 00000100:00100000:3.0:1789760792.804491:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731036329641 time 731052169093 state 0x0 ref 1 00000100:00100000:3.0:1789760792.804507:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731052429509 time 731052169093 state 0x1 ref 1 00000100:00100000:3.0:1789760792.804608:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731052429509 time 731064898754 state 0x0 ref 1 00000100:00100000:3.0:1789760792.804633:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.804682:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74969088, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c10 00010000:00010000:3.0:1789760792.804692:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.804748:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.804753:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.804759:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.804775:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.811228:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985611 is committed 00002000:00010000:3.0:1789760792.812162:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74969088 -> 74973184 00002000:00010000:3.0:1789760792.812224:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146448 -> 146456 00010000:00010000:3.0:1789760792.812239:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812253:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812263:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812549:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.812561:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812572:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812592:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.812600:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74969088->74973183] (req 74969088->74973183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.812698:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8075us (8488us total) trans 4294985611 rc 0/0 00000100:00100000:3.0:1789760792.812754:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18314 00000100:00100000:3.0:1789760792.812764:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731052429509 time 731064898754 state 0x2 ref 0 00000100:00100000:1.0:1789760792.815934:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.816006:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574144 00000100:00100000:3.0:1789760792.816015:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574144 00000100:00100000:3.0:1789760792.816061:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731052429509 time 731064898754 state 0x0 ref 1 00000100:00100000:3.0:1789760792.816075:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731065159170 time 731064898754 state 0x1 ref 1 00000100:00100000:3.0:1789760792.816102:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731065159170 time 731076393993 state 0x0 ref 1 00000100:00100000:3.0:1789760792.816112:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.816154:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74973184, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c18 00010000:00010000:3.0:1789760792.816163:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.816178:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.816182:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.816188:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.816201:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.821153:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985612 is committed 00002000:00010000:3.0:1789760792.821691:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74973184 -> 74977280 00002000:00010000:3.0:1789760792.821696:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146456 -> 146464 00010000:00010000:3.0:1789760792.821782:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821795:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821804:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821811:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.821815:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821824:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821845:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.821853:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74973184->74977279] (req 74973184->74977279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.824420:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8297us (8482us total) trans 4294985612 rc 0/0 00000100:00100000:2.0:1789760792.824436:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18315 00000100:00100000:1.0:1789760792.828158:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.828340:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574272 00000100:00100000:3.0:1789760792.828350:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574272 00000100:00100000:3.0:1789760792.828399:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731065159170 time 731076393993 state 0x0 ref 1 00000100:00100000:3.0:1789760792.828414:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731076654409 time 731076393993 state 0x1 ref 1 00000100:00100000:3.0:1789760792.828447:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731076654409 time 731088739074 state 0x0 ref 1 00000100:00100000:3.0:1789760792.828459:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+6:2357:x1876699565574272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.828506:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74977280, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c20 00010000:00010000:3.0:1789760792.828516:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.828532:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.828537:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.828543:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.828557:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.829803:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731065159170 time 731076393993 state 0x2 ref 0 00000001:00080000:0.0:1789760792.836998:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985613 is committed 00002000:00010000:3.0:1789760792.837172:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74977280 -> 74981376 00002000:00010000:3.0:1789760792.837177:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146464 -> 146472 00010000:00010000:3.0:1789760792.837190:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837203:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837212:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837220:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.837225:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837234:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837253:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837329:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74977280->74981375] (req 74977280->74981375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.837426:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e69933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565574272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8964us (9272us total) trans 4294985613 rc 0/0 00000100:00100000:3.0:1789760792.837438:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18316 00000100:00100000:3.0:1789760792.837447:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731076654409 time 731088739074 state 0x2 ref 0 00000100:00100000:1.0:1789760792.844227:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760792.844251:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580068992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760792.844335:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760792.844503:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580068992 00000100:00100000:2.0:1789760792.844512:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580068992 00000100:00100000:2.0:1789760792.844581:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760792.844590:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580068992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760792.844610:0:6955:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3848925184 avail 3615653888 00000100:00100000:2.0:1789760792.844660:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580068992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.844667:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760792.844723:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580068992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760792.844884:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760792.846284:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.847117:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574400 00000100:00100000:3.0:1789760792.847126:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574400 00000100:00100000:3.0:1789760792.847172:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731076654409 time 731088739074 state 0x0 ref 1 00000100:00100000:3.0:1789760792.847188:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731088999490 time 731088739074 state 0x1 ref 1 00000100:00100000:3.0:1789760792.847218:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731088999490 time 731107509827 state 0x0 ref 1 00000100:00100000:3.0:1789760792.847230:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.847284:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74981376, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c28 00010000:00010000:3.0:1789760792.847293:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.847309:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.847313:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.847320:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.847334:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.853941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985614 is committed 00002000:00010000:0.0:1789760792.854348:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74981376 -> 74985472 00002000:00010000:0.0:1789760792.854354:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146472 -> 146480 00010000:00010000:0.0:1789760792.854367:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854443:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854454:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854463:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.854468:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854478:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854498:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.854507:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f39e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74981376->74985471] (req 74981376->74985471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.854673:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7440us (8390us total) trans 4294985614 rc 0/0 00000100:00100000:0.0:1789760792.854685:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18317 00000100:00100000:0.0:1789760792.854694:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731088999490 time 731107509827 state 0x2 ref 0 00000100:00100000:1.0:1789760792.858559:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.858909:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574528 00000100:00100000:0.0:1789760792.858919:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574528 00000100:00100000:0.0:1789760792.859039:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731088999490 time 731107509827 state 0x0 ref 1 00000100:00100000:0.0:1789760792.859055:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731107770243 time 731107509827 state 0x1 ref 1 00000100:00100000:0.0:1789760792.859082:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731107770243 time 731119373557 state 0x0 ref 1 00000100:00100000:0.0:1789760792.859095:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565574528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.859139:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74985472, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c30 00010000:00010000:0.0:1789760792.859149:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.859165:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760792.859169:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.859175:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.859189:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760792.868846:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985615 is committed 00002000:00010000:0.0:1789760792.870804:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74985472 -> 74989568 00002000:00010000:0.0:1789760792.870813:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146480 -> 146488 00010000:00010000:0.0:1789760792.870828:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871011:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871021:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871029:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.871220:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871233:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871253:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.871261:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74985472->74989567] (req 74985472->74989567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.871509:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565574528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12411us (12955us total) trans 4294985615 rc 0/0 00000100:00100000:0.0:1789760792.871521:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18318 00000100:00100000:0.0:1789760792.871531:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731107770243 time 731119373557 state 0x2 ref 0 00000100:00100000:1.0:1789760792.876567:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.876648:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574656 00000100:00100000:3.0:1789760792.876661:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574656 00000100:00100000:3.0:1789760792.876746:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731107770243 time 731119373557 state 0x0 ref 1 00000100:00100000:3.0:1789760792.876763:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731119633973 time 731119373557 state 0x1 ref 1 00000100:00100000:3.0:1789760792.876791:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731119633973 time 731137083078 state 0x0 ref 1 00000100:00100000:3.0:1789760792.876804:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.876850:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74989568, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c38 00010000:00010000:3.0:1789760792.876859:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.876873:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.876878:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.876884:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.876897:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760792.882184:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985616 is committed 00002000:00010000:3.0:1789760792.882575:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74989568 -> 74993664 00002000:00010000:3.0:1789760792.882580:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146488 -> 146496 00010000:00010000:3.0:1789760792.882594:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882606:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882629:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882637:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.882642:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882650:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882669:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.882677:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74989568->74993663] (req 74989568->74993663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.882817:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565574656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6011us (6264us total) trans 4294985616 rc 0/0 00000100:00100000:3.0:1789760792.882826:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18319 00000100:00100000:3.0:1789760792.882836:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731119633973 time 731137083078 state 0x2 ref 0 00000100:00100000:1.0:1789760792.887570:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.887665:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574784 00000100:00100000:0.0:1789760792.887675:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574784 00000100:00100000:0.0:1789760792.887754:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731119633973 time 731137083078 state 0x0 ref 1 00000100:00100000:0.0:1789760792.887770:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731137343494 time 731137083078 state 0x1 ref 1 00000100:00100000:0.0:1789760792.887855:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731137343494 time 731148145700 state 0x0 ref 1 00000100:00100000:0.0:1789760792.887869:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565574784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.887919:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74993664, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c40 00010000:00010000:0.0:1789760792.887929:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.887945:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760792.887950:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.887956:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.887971:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.895186:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985617 is committed 00002000:00010000:0.0:1789760792.895317:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74993664 -> 74997760 00002000:00010000:0.0:1789760792.895323:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146496 -> 146504 00010000:00010000:0.0:1789760792.895337:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895350:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895359:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895367:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760792.895372:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895380:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895401:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.895410:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74993664->74997759] (req 74993664->74997759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.895672:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565574784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7800us (8105us total) trans 4294985617 rc 0/0 00000100:00100000:0.0:1789760792.895684:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18320 00000100:00100000:0.0:1789760792.895694:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731137343494 time 731148145700 state 0x2 ref 0 00000100:00100000:1.0:1789760792.905654:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.905758:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565574912 00000100:00100000:0.0:1789760792.905768:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565574912 00000100:00100000:0.0:1789760792.905826:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731137343494 time 731148145700 state 0x0 ref 1 00000100:00100000:0.0:1789760792.905853:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731148406116 time 731148145700 state 0x1 ref 1 00000100:00100000:0.0:1789760792.905884:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731148406116 time 731166176321 state 0x0 ref 1 00000100:00100000:0.0:1789760792.905897:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565574912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760792.905943:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74997760, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c48 00010000:00010000:0.0:1789760792.905953:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.905979:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760792.905985:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760792.905991:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.906007:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.910802:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985618 is committed 00002000:00010000:2.0:1789760792.917945:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74997760 -> 75001856 00002000:00010000:2.0:1789760792.917956:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146504 -> 146512 00010000:00010000:2.0:1789760792.917982:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.917995:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.918004:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.918011:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.918016:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.918025:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.918045:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.918053:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f3ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74997760->75001855] (req 74997760->75001855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.918150:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565574912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12252us (12501us total) trans 4294985618 rc 0/0 00000100:00100000:2.0:1789760792.918161:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18321 00000100:00100000:2.0:1789760792.918171:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731148406116 time 731166176321 state 0x2 ref 0 00000100:00100000:1.0:1789760792.921256:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.921341:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575040 00000100:00100000:3.0:1789760792.921351:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575040 00000100:00100000:3.0:1789760792.921407:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731148406116 time 731166176321 state 0x0 ref 1 00000100:00100000:3.0:1789760792.921439:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731166436737 time 731166176321 state 0x1 ref 1 00000100:00100000:3.0:1789760792.921468:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731166436737 time 731181759345 state 0x0 ref 1 00000100:00100000:3.0:1789760792.921480:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565575040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.921529:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75001856, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c50 00010000:00010000:3.0:1789760792.921539:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.921554:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.921559:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.921565:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.921580:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.928316:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985619 is committed 00002000:00010000:3.0:1789760792.931126:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75001856 -> 75005952 00002000:00010000:3.0:1789760792.931135:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146512 -> 146520 00010000:00010000:3.0:1789760792.931149:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931163:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931172:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931181:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760792.931186:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931194:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931213:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.931220:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75001856->75005951] (req 75001856->75005951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.931385:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565575040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9902us (10132us total) trans 4294985619 rc 0/0 00000100:00100000:3.0:1789760792.931396:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18322 00000100:00100000:3.0:1789760792.931406:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731166436737 time 731181759345 state 0x2 ref 0 00000100:00100000:1.0:1789760792.937634:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760792.938217:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575168 00000100:00100000:0.0:1789760792.938227:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575168 00000100:00100000:1.0:1789760792.938346:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731166436737 time 731181759345 state 0x0 ref 1 00000100:00100000:1.0:1789760792.938358:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731182019761 time 731181759345 state 0x1 ref 1 00000100:00100000:1.0:1789760792.938505:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731182019761 time 731198705334 state 0x0 ref 1 00000100:00100000:1.0:1789760792.938520:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760792.938569:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75005952, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0x23c58 00010000:00010000:1.0:1789760792.940038:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.940123:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760792.940127:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.940134:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.940148:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.946868:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985620 is committed 00002000:00010000:1.0:1789760792.946986:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75005952 -> 75010048 00002000:00010000:1.0:1789760792.946991:0:6958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760792 -> 1789760793 00002000:00010000:1.0:1789760792.946994:0:6958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760792 -> 1789760793 00002000:00010000:1.0:1789760792.946997:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146520 -> 146528 00010000:00010000:1.0:1789760792.947010:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947027:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947036:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947044:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.947049:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947058:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947078:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.947086:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f3c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75005952->75010047] (req 75005952->75010047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.947239:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8716us (9622us total) trans 4294985620 rc 0/0 00000100:00100000:1.0:1789760792.947251:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18323 00000100:00100000:1.0:1789760792.947269:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731182019761 time 731198705334 state 0x2 ref 0 00000100:00100000:1.0:1789760792.951906:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760792.952039:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575296 00000100:00100000:2.0:1789760792.952049:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575296 00000100:00100000:2.0:1789760792.952259:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731182019761 time 731198705334 state 0x0 ref 1 00000100:00100000:2.0:1789760792.952275:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731198965750 time 731198705334 state 0x1 ref 1 00000100:00100000:2.0:1789760792.952306:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731198965750 time 731212598426 state 0x0 ref 1 00000100:00100000:2.0:1789760792.952320:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565575296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760792.952433:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75010048, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c60 00010000:00010000:2.0:1789760792.952443:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.952459:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760792.952463:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.952469:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.952482:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760792.957466:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985621 is committed 00002000:00010000:1.0:1789760792.957669:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75010048 -> 75014144 00002000:00010000:1.0:1789760792.957675:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146528 -> 146536 00010000:00010000:1.0:1789760792.957692:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957736:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957745:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957752:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.957756:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957766:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957787:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.957795:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75010048->75014143] (req 75010048->75014143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.957886:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565575296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5565us (5985us total) trans 4294985621 rc 0/0 00000100:00100000:1.0:1789760792.957896:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18324 00000100:00100000:1.0:1789760792.957907:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731198965750 time 731212598426 state 0x2 ref 0 00000100:00100000:2.0:1789760792.963572:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760792.963700:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575424 00000100:00100000:3.0:1789760792.963731:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575424 00000100:00100000:3.0:1789760792.963787:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731198965750 time 731212598426 state 0x0 ref 1 00000100:00100000:3.0:1789760792.963805:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731212858842 time 731212598426 state 0x1 ref 1 00000100:00100000:3.0:1789760792.963882:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731212858842 time 731224172598 state 0x0 ref 1 00000100:00100000:3.0:1789760792.963897:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565575424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760792.963947:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75014144, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c68 00010000:00010000:3.0:1789760792.963957:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.963985:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760792.963990:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760792.963997:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.964012:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.973180:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985622 is committed 00002000:00010000:2.0:1789760792.973532:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75014144 -> 75018240 00002000:00010000:2.0:1789760792.973537:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146536 -> 146544 00010000:00010000:2.0:1789760792.973550:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973562:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973570:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973576:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760792.973581:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973590:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973684:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.973692:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f3d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75014144->75018239] (req 75014144->75018239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.973907:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565575424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10008us (10339us total) trans 4294985622 rc 0/0 00000100:00100000:2.0:1789760792.973917:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18325 00000100:00100000:2.0:1789760792.973927:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731212858842 time 731224172598 state 0x2 ref 0 00000100:00100000:0.0:1789760792.982838:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760792.982947:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575552 00000100:00100000:1.0:1789760792.982957:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575552 00000100:00100000:1.0:1789760792.983012:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731212858842 time 731224172598 state 0x0 ref 1 00000100:00100000:1.0:1789760792.983028:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731224433014 time 731224172598 state 0x1 ref 1 00000100:00100000:1.0:1789760792.983066:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731224433014 time 731243357501 state 0x0 ref 1 00000100:00100000:1.0:1789760792.983080:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565575552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760792.983133:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75018240, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c70 00010000:00010000:1.0:1789760792.983143:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.983159:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760792.983164:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.983221:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.983236:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760792.994346:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985623 is committed 00002000:00010000:1.0:1789760792.994514:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75018240 -> 75022336 00002000:00010000:1.0:1789760792.994520:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146544 -> 146552 00010000:00010000:1.0:1789760792.994537:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994565:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994575:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994582:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760792.994587:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994596:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994631:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.994639:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f3dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75018240->75022335] (req 75018240->75022335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.994988:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565575552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11902us (12150us total) trans 4294985623 rc 0/0 00000100:00100000:1.0:1789760792.994999:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18326 00000100:00100000:1.0:1789760792.995009:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731224433014 time 731243357501 state 0x2 ref 0 00000100:00100000:1.0:1789760792.999870:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.000097:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575680 00000100:00100000:2.0:1789760793.000107:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575680 00000100:00100000:2.0:1789760793.000159:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731224433014 time 731243357501 state 0x0 ref 1 00000100:00100000:2.0:1789760793.000172:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731243617917 time 731243357501 state 0x1 ref 1 00000100:00100000:2.0:1789760793.000204:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731243617917 time 731260496273 state 0x0 ref 1 00000100:00100000:2.0:1789760793.000216:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.000261:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75022336, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c78 00010000:00010000:2.0:1789760793.000270:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.000285:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.000289:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.000295:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.000307:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.006886:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985624 is committed 00002000:00010000:2.0:1789760793.012588:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75022336 -> 75026432 00002000:00010000:2.0:1789760793.012599:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146552 -> 146560 00010000:00010000:2.0:1789760793.012612:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012642:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012652:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012659:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.012664:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012672:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012691:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.012699:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75022336->75026431] (req 75022336->75026431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.012843:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12624us (12979us total) trans 4294985624 rc 0/0 00000100:00100000:2.0:1789760793.012854:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18327 00000100:00100000:2.0:1789760793.012864:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731243617917 time 731260496273 state 0x2 ref 0 00000100:00100000:2.0:1789760793.018130:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.018198:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575808 00000100:00100000:3.0:1789760793.018207:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575808 00000100:00100000:3.0:1789760793.018255:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731243617917 time 731260496273 state 0x0 ref 1 00000100:00100000:3.0:1789760793.018335:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731260756689 time 731260496273 state 0x1 ref 1 00000100:00100000:3.0:1789760793.018360:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731260756689 time 731278652678 state 0x0 ref 1 00000100:00100000:3.0:1789760793.018373:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.018415:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75026432, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c80 00010000:00010000:3.0:1789760793.018425:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.018545:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.018550:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.018557:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.018572:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.025872:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985625 is committed 00002000:00010000:0.0:1789760793.026200:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75026432 -> 75030528 00002000:00010000:0.0:1789760793.026205:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146560 -> 146568 00010000:00010000:0.0:1789760793.026218:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026231:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026240:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026247:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.026252:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026261:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026281:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.026288:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f3eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75026432->75030527] (req 75026432->75030527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.026399:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565575808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8023us (8271us total) trans 4294985625 rc 0/0 00000100:00100000:0.0:1789760793.026414:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18328 00000100:00100000:0.0:1789760793.026423:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731260756689 time 731278652678 state 0x2 ref 0 00000100:00100000:1.0:1789760793.031822:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.031936:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565575936 00000100:00100000:3.0:1789760793.031945:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565575936 00000100:00100000:2.0:1789760793.032152:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731260756689 time 731278652678 state 0x0 ref 1 00000100:00100000:2.0:1789760793.032168:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731278913094 time 731278652678 state 0x1 ref 1 00000100:00100000:2.0:1789760793.032197:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731278913094 time 731292489756 state 0x0 ref 1 00000100:00100000:2.0:1789760793.032209:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565575936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.032254:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75030528, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c88 00010000:00010000:2.0:1789760793.032263:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.032279:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.032283:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.032289:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.032303:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.043262:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985626 is committed 00002000:00010000:1.0:1789760793.043534:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75030528 -> 75034624 00002000:00010000:1.0:1789760793.043541:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146568 -> 146576 00010000:00010000:1.0:1789760793.043564:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043576:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043585:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043593:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.043598:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043607:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043639:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.043648:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f3f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75030528->75034623] (req 75030528->75034623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.043800:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565575936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11579us (11976us total) trans 4294985626 rc 0/0 00000100:00100000:1.0:1789760793.043815:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18329 00000100:00100000:1.0:1789760793.043825:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731278913094 time 731292489756 state 0x2 ref 0 00000100:00100000:1.0:1789760793.051220:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.051286:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576064 00000100:00100000:2.0:1789760793.051295:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576064 00000100:00100000:2.0:1789760793.051347:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731278913094 time 731292489756 state 0x0 ref 1 00000100:00100000:2.0:1789760793.051361:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731292750172 time 731292489756 state 0x1 ref 1 00000100:00100000:2.0:1789760793.051881:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731292750172 time 731312169175 state 0x0 ref 1 00000100:00100000:2.0:1789760793.051898:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.052126:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75034624, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c90 00010000:00010000:2.0:1789760793.052217:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.052233:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.052237:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.052243:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.052258:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.062930:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985627 is committed 00002000:00010000:2.0:1789760793.063155:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75034624 -> 75038720 00002000:00010000:2.0:1789760793.063161:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146576 -> 146584 00010000:00010000:2.0:1789760793.063175:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063188:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063198:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063205:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.063210:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063219:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063239:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.063247:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f3f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75034624->75038719] (req 75034624->75038719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.063345:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11446us (12128us total) trans 4294985627 rc 0/0 00000100:00100000:2.0:1789760793.063356:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18330 00000100:00100000:2.0:1789760793.063366:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731292750172 time 731312169175 state 0x2 ref 0 00000100:00100000:2.0:1789760793.070892:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760793.071274:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576192 00000100:00100000:0.0:1789760793.071284:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576192 00000100:00100000:0.0:1789760793.071339:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731292750172 time 731312169175 state 0x0 ref 1 00000100:00100000:0.0:1789760793.071354:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731312429591 time 731312169175 state 0x1 ref 1 00000100:00100000:0.0:1789760793.071862:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731312429591 time 731332150180 state 0x0 ref 1 00000100:00100000:0.0:1789760793.071878:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760793.071928:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75038720, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23c98 00010000:00010000:0.0:1789760793.071938:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.071953:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760793.071957:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.071963:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.071978:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.080687:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985628 is committed 00002000:00010000:0.0:1789760793.080845:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75038720 -> 75042816 00002000:00010000:0.0:1789760793.080851:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146584 -> 146592 00010000:00010000:0.0:1789760793.080864:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080876:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080885:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080892:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.080897:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080906:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080926:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.080934:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75038720->75042815] (req 75038720->75042815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.081135:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9160us (10153us total) trans 4294985628 rc 0/0 00000100:00100000:0.0:1789760793.081147:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18331 00000100:00100000:0.0:1789760793.081157:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731312429591 time 731332150180 state 0x2 ref 0 00000100:00100000:1.0:1789760793.092121:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.094414:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576320 00000100:00100000:2.0:1789760793.094431:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576320 00000100:00100000:2.0:1789760793.094496:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731312429591 time 731332150180 state 0x0 ref 1 00000100:00100000:2.0:1789760793.094512:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731332410596 time 731332150180 state 0x1 ref 1 00000100:00100000:2.0:1789760793.094635:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731332410596 time 731354924884 state 0x0 ref 1 00000100:00100000:2.0:1789760793.094650:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.094700:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75042816, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23ca0 00010000:00010000:2.0:1789760793.094754:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.094771:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.094775:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.094783:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.094797:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.102517:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985629 is committed 00002000:00010000:2.0:1789760793.102759:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75042816 -> 75046912 00002000:00010000:2.0:1789760793.102765:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146592 -> 146600 00010000:00010000:2.0:1789760793.102778:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102791:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102801:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102808:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.102812:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102825:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102844:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.102852:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75042816->75046911] (req 75042816->75046911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.102947:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8296us (10830us total) trans 4294985629 rc 0/0 00000100:00100000:2.0:1789760793.102956:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18332 00000100:00100000:2.0:1789760793.102966:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731332410596 time 731354924884 state 0x2 ref 0 00000100:00100000:1.0:1789760793.114342:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.114428:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576448 00000100:00100000:2.0:1789760793.114438:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576448 00000100:00100000:2.0:1789760793.114488:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731332410596 time 731354924884 state 0x0 ref 1 00000100:00100000:2.0:1789760793.114503:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731355185300 time 731354924884 state 0x1 ref 1 00000100:00100000:2.0:1789760793.114533:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731355185300 time 731374825393 state 0x0 ref 1 00000100:00100000:2.0:1789760793.114545:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.114591:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75046912, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23ca8 00010000:00010000:2.0:1789760793.114601:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.114628:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.114633:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.114639:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.114654:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.124863:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985630 is committed 00002000:00010000:2.0:1789760793.125264:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75046912 -> 75051008 00002000:00010000:2.0:1789760793.125269:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146600 -> 146608 00010000:00010000:2.0:1789760793.125284:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125298:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125308:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125315:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.125320:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125329:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125354:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.125362:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f40e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75046912->75051007] (req 75046912->75051007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.125497:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565576448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10949us (11159us total) trans 4294985630 rc 0/0 00000100:00100000:2.0:1789760793.125506:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18333 00000100:00100000:2.0:1789760793.125516:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731355185300 time 731374825393 state 0x2 ref 0 00000100:00100000:1.0:1789760793.141659:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760793.141852:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576576 00000100:00100000:0.0:1789760793.141862:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576576 00000100:00100000:0.0:1789760793.141915:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731355185300 time 731374825393 state 0x0 ref 1 00000100:00100000:0.0:1789760793.141930:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731375085809 time 731374825393 state 0x1 ref 1 00000100:00100000:0.0:1789760793.141960:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731375085809 time 731402252135 state 0x0 ref 1 00000100:00100000:0.0:1789760793.141974:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760793.142024:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75051008, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cb0 00010000:00010000:0.0:1789760793.142034:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.142050:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760793.142054:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.142061:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.142075:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.148377:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985631 is committed 00002000:00010000:2.0:1789760793.148778:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75051008 -> 75055104 00002000:00010000:2.0:1789760793.148783:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146608 -> 146616 00010000:00010000:2.0:1789760793.148797:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.148810:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.148819:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.148825:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.148830:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.149652:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.149674:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.149781:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75051008->75055103] (req 75051008->75055103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.149936:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7960us (8282us total) trans 4294985631 rc 0/0 00000100:00100000:2.0:1789760793.149947:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18334 00000100:00100000:2.0:1789760793.149957:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731375085809 time 731402252135 state 0x2 ref 0 00000100:00100000:0.0:1789760793.157604:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.157668:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576704 00000100:00100000:2.0:1789760793.157688:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576704 00000100:00100000:2.0:1789760793.157779:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731375085809 time 731402252135 state 0x0 ref 1 00000100:00100000:2.0:1789760793.157793:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731402512551 time 731402252135 state 0x1 ref 1 00000100:00100000:2.0:1789760793.157831:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731402512551 time 731418122164 state 0x0 ref 1 00000100:00100000:2.0:1789760793.157843:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.157888:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75055104, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cb8 00010000:00010000:2.0:1789760793.157899:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.157915:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.157919:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.157926:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.157940:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.163011:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985632 is committed 00002000:00010000:2.0:1789760793.163203:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75055104 -> 75059200 00002000:00010000:2.0:1789760793.163208:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146616 -> 146624 00010000:00010000:2.0:1789760793.163222:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163235:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163243:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163250:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.163255:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163263:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163304:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.163311:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f41c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75055104->75059199] (req 75055104->75059199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.163390:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565576704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5544us (5790us total) trans 4294985632 rc 0/0 00000100:00100000:2.0:1789760793.163400:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18335 00000100:00100000:2.0:1789760793.163409:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731402512551 time 731418122164 state 0x2 ref 0 00000100:00100000:1.0:1789760793.170862:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.170930:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576832 00000100:00100000:2.0:1789760793.170940:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576832 00000100:00100000:2.0:1789760793.170999:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731402512551 time 731418122164 state 0x0 ref 1 00000100:00100000:2.0:1789760793.171015:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731418382580 time 731418122164 state 0x1 ref 1 00000100:00100000:1.0:1789760793.171182:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731418382580 time 731431471299 state 0x0 ref 1 00000100:00100000:1.0:1789760793.171197:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565576832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.171246:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75059200, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cc0 00010000:00010000:1.0:1789760793.171256:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.171273:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.171278:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.171288:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.171303:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.179356:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985633 is committed 00002000:00010000:1.0:1789760793.186153:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75059200 -> 75063296 00002000:00010000:1.0:1789760793.186163:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146624 -> 146632 00010000:00010000:1.0:1789760793.186179:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186193:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186202:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186211:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.186216:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186226:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186246:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.186255:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75059200->75063295] (req 75059200->75063295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.186357:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565576832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15157us (15498us total) trans 4294985633 rc 0/0 00000100:00100000:1.0:1789760793.186367:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18336 00000100:00100000:1.0:1789760793.186377:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731418382580 time 731431471299 state 0x2 ref 0 00000100:00100000:1.0:1789760793.190362:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.190563:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565576960 00000100:00100000:2.0:1789760793.190571:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565576960 00000100:00100000:2.0:1789760793.190628:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731418382580 time 731431471299 state 0x0 ref 1 00000100:00100000:2.0:1789760793.190643:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731431731715 time 731431471299 state 0x1 ref 1 00000100:00100000:2.0:1789760793.190668:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731431731715 time 731450961009 state 0x0 ref 1 00000100:00100000:2.0:1789760793.190679:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565576960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.190757:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75063296, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cc8 00010000:00010000:2.0:1789760793.190766:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.190784:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.190788:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.190794:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.190906:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.199224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985634 is committed 00002000:00010000:3.0:1789760793.199356:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75063296 -> 75067392 00002000:00010000:3.0:1789760793.199362:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146632 -> 146640 00010000:00010000:3.0:1789760793.199376:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199389:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199398:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199405:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.199409:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199424:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199445:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.199453:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc32c94/0x721975f94674f42a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75063296->75067391] (req 75063296->75067391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.199564:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565576960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8871us (9195us total) trans 4294985634 rc 0/0 00000100:00100000:3.0:1789760793.199575:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18337 00000100:00100000:3.0:1789760793.199584:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731431731715 time 731450961009 state 0x2 ref 0 00000100:00100000:0.0:1789760793.210308:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.210442:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577088 00000100:00100000:2.0:1789760793.210452:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577088 00000100:00100000:2.0:1789760793.210506:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731431731715 time 731450961009 state 0x0 ref 1 00000100:00100000:2.0:1789760793.210521:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731451221425 time 731450961009 state 0x1 ref 1 00000100:00100000:2.0:1789760793.210559:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731451221425 time 731470850451 state 0x0 ref 1 00000100:00100000:2.0:1789760793.210651:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.210699:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75067392, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cd0 00010000:00010000:2.0:1789760793.210788:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.210810:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.210815:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.210822:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.210835:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.217787:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985635 is committed 00002000:00010000:1.0:1789760793.217934:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75067392 -> 75071488 00002000:00010000:1.0:1789760793.217939:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146640 -> 146648 00010000:00010000:1.0:1789760793.217952:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.217965:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.217974:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.217982:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.217987:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.217996:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.218016:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.218025:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75067392->75071487] (req 75067392->75071487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.222069:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11489us (11760us total) trans 4294985635 rc 0/0 00000100:00100000:1.0:1789760793.222085:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18338 00000100:00100000:1.0:1789760793.223603:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731451221425 time 731470850451 state 0x2 ref 0 00000100:00100000:1.0:1789760793.230532:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.231944:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577216 00000100:00100000:2.0:1789760793.231958:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577216 00000100:00100000:2.0:1789760793.232017:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731451221425 time 731470850451 state 0x0 ref 1 00000100:00100000:2.0:1789760793.232032:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731471110867 time 731470850451 state 0x1 ref 1 00000100:00100000:2.0:1789760793.232069:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731471110867 time 731492361412 state 0x0 ref 1 00000100:00100000:2.0:1789760793.232082:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565577216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.232134:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75071488, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cd8 00010000:00010000:2.0:1789760793.232144:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.232160:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.232170:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.232177:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.232191:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.239117:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985636 is committed 00002000:00010000:2.0:1789760793.239237:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75071488 -> 75075584 00002000:00010000:2.0:1789760793.239242:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146648 -> 146656 00010000:00010000:2.0:1789760793.239255:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239267:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239277:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239284:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.239289:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239298:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239317:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.239324:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75071488->75075583] (req 75071488->75075583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.239454:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565577216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7370us (8928us total) trans 4294985636 rc 0/0 00000100:00100000:2.0:1789760793.239464:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18339 00000100:00100000:2.0:1789760793.239474:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731471110867 time 731492361412 state 0x2 ref 0 00000100:00100000:2.0:1789760793.242472:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.242547:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577344 00000100:00100000:3.0:1789760793.242565:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577344 00000100:00100000:3.0:1789760793.242628:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731471110867 time 731492361412 state 0x0 ref 1 00000100:00100000:3.0:1789760793.242643:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731492621828 time 731492361412 state 0x1 ref 1 00000100:00100000:3.0:1789760793.242675:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731492621828 time 731502967751 state 0x0 ref 1 00000100:00100000:3.0:1789760793.242688:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565577344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.242760:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75075584, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23ce0 00010000:00010000:3.0:1789760793.242769:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.242783:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.242787:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.242793:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.242807:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.250548:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985637 is committed 00002000:00010000:3.0:1789760793.250696:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75075584 -> 75079680 00002000:00010000:3.0:1789760793.250701:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146656 -> 146664 00010000:00010000:3.0:1789760793.250736:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250750:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250760:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250768:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.250772:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250781:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250806:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.250814:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f43f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75075584->75079679] (req 75075584->75079679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.250918:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565577344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8228us (8450us total) trans 4294985637 rc 0/0 00000100:00100000:3.0:1789760793.250929:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18340 00000100:00100000:3.0:1789760793.250939:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731492621828 time 731502967751 state 0x2 ref 0 00000100:00100000:0.0:1789760793.254662:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.254993:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577472 00000100:00100000:1.0:1789760793.255003:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577472 00000100:00100000:1.0:1789760793.255063:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731492621828 time 731502967751 state 0x0 ref 1 00000100:00100000:1.0:1789760793.255080:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731503228167 time 731502967751 state 0x1 ref 1 00000100:00100000:1.0:1789760793.255113:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731503228167 time 731515404739 state 0x0 ref 1 00000100:00100000:1.0:1789760793.255127:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.255183:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75079680, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23ce8 00010000:00010000:1.0:1789760793.255193:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.255209:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.255215:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.255221:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.255236:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.260174:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985638 is committed 00002000:00010000:2.0:1789760793.261329:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75079680 -> 75083776 00002000:00010000:2.0:1789760793.261337:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146664 -> 146672 00010000:00010000:2.0:1789760793.261352:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261365:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261375:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261383:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.261387:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261396:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261416:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.261425:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75079680->75083775] (req 75079680->75083775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.261522:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6393us (6866us total) trans 4294985638 rc 0/0 00000100:00100000:2.0:1789760793.261533:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18341 00000100:00100000:2.0:1789760793.261542:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731503228167 time 731515404739 state 0x2 ref 0 00000100:00100000:3.0:1789760793.269374:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.269461:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577600 00000100:00100000:2.0:1789760793.269471:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577600 00000100:00100000:2.0:1789760793.269527:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731503228167 time 731515404739 state 0x0 ref 1 00000100:00100000:2.0:1789760793.269543:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731515665155 time 731515404739 state 0x1 ref 1 00000100:00100000:2.0:1789760793.269576:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731515665155 time 731529867790 state 0x0 ref 1 00000100:00100000:2.0:1789760793.269589:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565577600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.269647:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75083776, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cf0 00010000:00010000:2.0:1789760793.269656:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.269672:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.269677:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.269684:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.269747:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.274493:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985639 is committed 00002000:00010000:2.0:1789760793.274639:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75083776 -> 75087872 00002000:00010000:2.0:1789760793.274645:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146672 -> 146680 00010000:00010000:2.0:1789760793.274659:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274672:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274682:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274690:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.274695:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274739:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274760:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.274767:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f44d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75083776->75087871] (req 75083776->75087871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.274853:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565577600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5261us (5485us total) trans 4294985639 rc 0/0 00000100:00100000:2.0:1789760793.274876:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18342 00000100:00100000:2.0:1789760793.274887:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731515665155 time 731529867790 state 0x2 ref 0 00000100:00100000:1.0:1789760793.279362:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.279439:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577728 00000100:00100000:3.0:1789760793.279450:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577728 00000100:00100000:3.0:1789760793.279505:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731515665155 time 731529867790 state 0x0 ref 1 00000100:00100000:3.0:1789760793.279520:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731530128206 time 731529867790 state 0x1 ref 1 00000100:00100000:3.0:1789760793.279547:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731530128206 time 731539840076 state 0x0 ref 1 00000100:00100000:3.0:1789760793.279566:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.279607:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75087872, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23cf8 00010000:00010000:3.0:1789760793.279624:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.279647:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.279652:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.279658:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.279670:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.283752:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985640 is committed 00002000:00010000:3.0:1789760793.287765:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75087872 -> 75091968 00002000:00010000:3.0:1789760793.287776:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146680 -> 146688 00010000:00010000:3.0:1789760793.287789:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287801:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287809:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287817:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.287821:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287829:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287852:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.287861:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75087872->75091967] (req 75087872->75091967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.287967:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565577728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8397us (8610us total) trans 4294985640 rc 0/0 00000100:00100000:3.0:1789760793.287979:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18343 00000100:00100000:3.0:1789760793.287988:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731530128206 time 731539840076 state 0x2 ref 0 00000100:00100000:0.0:1789760793.295490:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.295590:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577856 00000100:00100000:2.0:1789760793.295599:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577856 00000100:00100000:2.0:1789760793.295660:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731530128206 time 731539840076 state 0x0 ref 1 00000100:00100000:2.0:1789760793.295675:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731540100492 time 731539840076 state 0x1 ref 1 00000100:00100000:2.0:1789760793.295926:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731540100492 time 731556216024 state 0x0 ref 1 00000100:00100000:2.0:1789760793.296055:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565577856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.296104:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75091968, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d00 00010000:00010000:2.0:1789760793.296114:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.296129:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.296133:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.296139:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.296152:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.300814:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985641 is committed 00002000:00010000:1.0:1789760793.301066:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75091968 -> 75096064 00002000:00010000:1.0:1789760793.301072:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146688 -> 146696 00010000:00010000:1.0:1789760793.301087:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301101:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301112:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301119:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.301124:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301134:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301154:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.301161:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f45b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75091968->75096063] (req 75091968->75096063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.301253:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565577856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5198us (5768us total) trans 4294985641 rc 0/0 00000100:00100000:1.0:1789760793.301263:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18344 00000100:00100000:1.0:1789760793.301272:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731540100492 time 731556216024 state 0x2 ref 0 00000100:00100000:0.0:1789760793.305386:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.306136:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565577984 00000100:00100000:2.0:1789760793.306147:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565577984 00000100:00100000:2.0:1789760793.306200:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731540100492 time 731556216024 state 0x0 ref 1 00000100:00100000:2.0:1789760793.306215:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731556476440 time 731556216024 state 0x1 ref 1 00000100:00100000:2.0:1789760793.306283:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731556476440 time 731566573823 state 0x0 ref 1 00000100:00100000:2.0:1789760793.306296:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565577984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.306340:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75096064, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d08 00010000:00010000:2.0:1789760793.306349:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.306365:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.306369:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.306376:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.306389:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.309939:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985642 is committed 00002000:00010000:2.0:1789760793.313318:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75096064 -> 75100160 00002000:00010000:2.0:1789760793.313328:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146696 -> 146704 00010000:00010000:2.0:1789760793.313342:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313356:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313365:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313371:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.313375:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313383:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313401:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.313408:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75096064->75100159] (req 75096064->75100159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.313500:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565577984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7202us (8121us total) trans 4294985642 rc 0/0 00000100:00100000:2.0:1789760793.313509:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18345 00000100:00100000:2.0:1789760793.313519:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731556476440 time 731566573823 state 0x2 ref 0 00000100:00100000:2.0:1789760793.320076:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.320256:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578112 00000100:00100000:3.0:1789760793.320266:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578112 00000100:00100000:3.0:1789760793.320328:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731556476440 time 731566573823 state 0x0 ref 1 00000100:00100000:3.0:1789760793.320344:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731566834239 time 731566573823 state 0x1 ref 1 00000100:00100000:3.0:1789760793.320436:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731566834239 time 731580727684 state 0x0 ref 1 00000100:00100000:3.0:1789760793.320450:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565578112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.320493:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75100160, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d10 00010000:00010000:3.0:1789760793.320502:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.320518:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.320523:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.320528:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.320552:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.324928:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985643 is committed 00002000:00010000:0.0:1789760793.325747:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75100160 -> 75104256 00002000:00010000:0.0:1789760793.325754:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146704 -> 146712 00010000:00010000:0.0:1789760793.325767:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325779:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325787:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325794:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.325798:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325807:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325827:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.325835:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674f469 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75100160->75104255] (req 75100160->75104255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.326812:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565578112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5482us (5864us total) trans 4294985643 rc 0/0 00000100:00100000:0.0:1789760793.326826:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18346 00000100:00100000:0.0:1789760793.326836:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731566834239 time 731580727684 state 0x2 ref 0 00000100:00100000:0.0:1789760793.336768:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.337157:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578240 00000100:00100000:1.0:1789760793.337167:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578240 00000100:00100000:1.0:1789760793.337223:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731566834239 time 731580727684 state 0x0 ref 1 00000100:00100000:1.0:1789760793.337239:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731580988100 time 731580727684 state 0x1 ref 1 00000100:00100000:1.0:1789760793.337380:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731580988100 time 731597670568 state 0x0 ref 1 00000100:00100000:1.0:1789760793.337395:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565578240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.337445:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75104256, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d18 00010000:00010000:1.0:1789760793.337455:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.337469:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.337474:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.337481:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.337508:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.341432:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985644 is committed 00002000:00010000:1.0:1789760793.341549:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75104256 -> 75108352 00002000:00010000:1.0:1789760793.342083:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146712 -> 146720 00010000:00010000:1.0:1789760793.342098:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342111:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342120:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342192:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.342198:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342207:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342224:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.342231:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f470 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75104256->75108351] (req 75104256->75108351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.342356:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565578240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4960us (5595us total) trans 4294985644 rc 0/0 00000100:00100000:1.0:1789760793.342366:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18347 00000100:00100000:1.0:1789760793.342375:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731580988100 time 731597670568 state 0x2 ref 0 00000100:00100000:3.0:1789760793.346107:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.346192:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578368 00000100:00100000:2.0:1789760793.346201:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578368 00000100:00100000:2.0:1789760793.346263:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731580988100 time 731597670568 state 0x0 ref 1 00000100:00100000:2.0:1789760793.346279:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731597930984 time 731597670568 state 0x1 ref 1 00000100:00100000:2.0:1789760793.346314:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731597930984 time 731606606082 state 0x0 ref 1 00000100:00100000:2.0:1789760793.346328:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565578368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.346373:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75108352, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d20 00010000:00010000:2.0:1789760793.346382:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.346398:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.346403:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.346409:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.346423:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.351463:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985645 is committed 00002000:00010000:1.0:1789760793.351813:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75108352 -> 75112448 00002000:00010000:1.0:1789760793.351818:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146720 -> 146728 00010000:00010000:1.0:1789760793.351831:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351844:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351853:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351861:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.351866:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351876:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351894:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.351903:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d1571a/0x721975f94674f477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75108352->75112447] (req 75108352->75112447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.352263:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565578368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5933us (6160us total) trans 4294985645 rc 0/0 00000100:00100000:1.0:1789760793.352275:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18348 00000100:00100000:1.0:1789760793.352285:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731597930984 time 731606606082 state 0x2 ref 0 00000100:00100000:1.0:1789760793.358405:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760793.358497:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578496 00000100:00100000:0.0:1789760793.358507:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578496 00000100:00100000:0.0:1789760793.358681:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731597930984 time 731606606082 state 0x0 ref 1 00000100:00100000:0.0:1789760793.358697:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731606866498 time 731606606082 state 0x1 ref 1 00000100:00100000:0.0:1789760793.358814:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731606866498 time 731619104285 state 0x0 ref 1 00000100:00100000:0.0:1789760793.358828:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760793.358887:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75112448, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d28 00010000:00010000:0.0:1789760793.358896:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.358911:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760793.358916:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.358921:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.358944:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.362418:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985646 is committed 00002000:00010000:0.0:1789760793.362530:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75112448 -> 75116544 00002000:00010000:0.0:1789760793.362535:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146728 -> 146736 00010000:00010000:0.0:1789760793.362547:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362690:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362701:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362880:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.362885:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362895:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362916:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.362924:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f47e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75112448->75116543] (req 75112448->75116543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.363399:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4568us (4999us total) trans 4294985646 rc 0/0 00000100:00100000:0.0:1789760793.363410:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18349 00000100:00100000:0.0:1789760793.363420:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731606866498 time 731619104285 state 0x2 ref 0 00000100:00100000:0.0:1789760793.370104:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.370258:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578624 00000100:00100000:1.0:1789760793.370267:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578624 00000100:00100000:1.0:1789760793.370320:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731606866498 time 731619104285 state 0x0 ref 1 00000100:00100000:1.0:1789760793.370336:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731619364701 time 731619104285 state 0x1 ref 1 00000100:00100000:1.0:1789760793.370367:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731619364701 time 731630658899 state 0x0 ref 1 00000100:00100000:1.0:1789760793.370380:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565578624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.370427:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75116544, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d30 00010000:00010000:1.0:1789760793.370436:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.370451:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.370455:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.370461:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.370473:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.374675:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985647 is committed 00002000:00010000:1.0:1789760793.374987:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75116544 -> 75120640 00002000:00010000:1.0:1789760793.374992:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146736 -> 146744 00010000:00010000:1.0:1789760793.375006:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375018:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375027:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375035:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.375041:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375050:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375068:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.375076:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75116544->75120639] (req 75116544->75120639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.376013:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565578624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5627us (5913us total) trans 4294985647 rc 0/0 00000100:00100000:1.0:1789760793.376026:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18350 00000100:00100000:1.0:1789760793.376036:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731619364701 time 731630658899 state 0x2 ref 0 00000100:00100000:3.0:1789760793.385778:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.385995:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578752 00000100:00100000:1.0:1789760793.386005:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578752 00000100:00100000:1.0:1789760793.386059:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731619364701 time 731630658899 state 0x0 ref 1 00000100:00100000:1.0:1789760793.386074:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731630919315 time 731630658899 state 0x1 ref 1 00000100:00100000:1.0:1789760793.386211:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731630919315 time 731646501534 state 0x0 ref 1 00000100:00100000:1.0:1789760793.386225:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.386285:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75120640, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d38 00010000:00010000:1.0:1789760793.386294:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.386310:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.386320:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.386327:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.386341:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.391559:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985648 is committed 00002000:00010000:1.0:1789760793.391672:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75120640 -> 75124736 00002000:00010000:1.0:1789760793.391677:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146744 -> 146752 00010000:00010000:1.0:1789760793.391692:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391735:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391744:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391751:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.391756:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391766:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391785:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.391793:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f48c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75120640->75124735] (req 75120640->75124735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.391882:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5656us (6109us total) trans 4294985648 rc 0/0 00000100:00100000:1.0:1789760793.391893:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18351 00000100:00100000:1.0:1789760793.391902:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731630919315 time 731646501534 state 0x2 ref 0 00000100:00100000:3.0:1789760793.398158:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760793.399269:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565578880 00000100:00100000:0.0:1789760793.399281:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565578880 00000100:00100000:2.0:1789760793.399429:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731630919315 time 731646501534 state 0x0 ref 1 00000100:00100000:2.0:1789760793.399445:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731646761950 time 731646501534 state 0x1 ref 1 00000100:00100000:2.0:1789760793.399514:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731646761950 time 731659804879 state 0x0 ref 1 00000100:00100000:2.0:1789760793.399528:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.399580:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75124736, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d40 00010000:00010000:2.0:1789760793.399590:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.399606:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.399611:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.399628:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.399642:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.406266:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985649 is committed 00002000:00010000:2.0:1789760793.406391:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75124736 -> 75128832 00002000:00010000:2.0:1789760793.406396:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146752 -> 146760 00010000:00010000:2.0:1789760793.406409:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406421:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406430:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406438:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.406443:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406453:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406471:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.406479:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f493 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75124736->75128831] (req 75124736->75128831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.406572:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565578880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7042us (8417us total) trans 4294985649 rc 0/0 00000100:00100000:2.0:1789760793.406581:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18352 00000100:00100000:2.0:1789760793.406591:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731646761950 time 731659804879 state 0x2 ref 0 00000100:00100000:0.0:1789760793.420944:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.421047:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579008 00000100:00100000:1.0:1789760793.421056:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579008 00000100:00100000:1.0:1789760793.421113:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731646761950 time 731659804879 state 0x0 ref 1 00000100:00100000:1.0:1789760793.421129:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731660065295 time 731659804879 state 0x1 ref 1 00000100:00100000:1.0:1789760793.421157:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731660065295 time 731681449188 state 0x0 ref 1 00000100:00100000:1.0:1789760793.421170:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565579008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.421219:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75128832, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d48 00010000:00010000:1.0:1789760793.421229:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.421243:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.421247:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.421253:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.421266:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.427542:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985650 is committed 00002000:00010000:2.0:1789760793.427853:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75128832 -> 75132928 00002000:00010000:2.0:1789760793.427859:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146760 -> 146768 00010000:00010000:2.0:1789760793.427871:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427884:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427893:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427904:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.427908:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427917:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427935:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.427943:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f49a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75128832->75132927] (req 75128832->75132927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.428044:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565579008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6873us (7107us total) trans 4294985650 rc 0/0 00000100:00100000:2.0:1789760793.428055:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18353 00000100:00100000:2.0:1789760793.428064:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731660065295 time 731681449188 state 0x2 ref 0 00000100:00100000:3.0:1789760793.434631:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.434860:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579136 00000100:00100000:1.0:1789760793.434870:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579136 00000100:00100000:1.0:1789760793.434920:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731660065295 time 731681449188 state 0x0 ref 1 00000100:00100000:1.0:1789760793.434934:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731681709604 time 731681449188 state 0x1 ref 1 00000100:00100000:1.0:1789760793.435023:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731681709604 time 731695314681 state 0x0 ref 1 00000100:00100000:1.0:1789760793.435036:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.435082:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75132928, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d50 00010000:00010000:1.0:1789760793.435091:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.435105:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.435110:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.435116:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.435130:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.439107:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985651 is committed 00002000:00010000:1.0:1789760793.439220:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75132928 -> 75137024 00002000:00010000:1.0:1789760793.439225:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146768 -> 146776 00010000:00010000:1.0:1789760793.439237:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439250:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439260:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439274:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.439279:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439289:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439309:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.439318:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75132928->75137023] (req 75132928->75137023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.439412:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4374us (4795us total) trans 4294985651 rc 0/0 00000100:00100000:1.0:1789760793.439422:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18354 00000100:00100000:1.0:1789760793.439432:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731681709604 time 731695314681 state 0x2 ref 0 00000100:00100000:3.0:1789760793.450030:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.450135:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579264 00000100:00100000:2.0:1789760793.450145:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579264 00000100:00100000:2.0:1789760793.450198:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731681709604 time 731695314681 state 0x0 ref 1 00000100:00100000:2.0:1789760793.450215:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731695575097 time 731695314681 state 0x1 ref 1 00000100:00100000:2.0:1789760793.450248:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731695575097 time 731710539823 state 0x0 ref 1 00000100:00100000:2.0:1789760793.450267:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565579264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.450316:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75137024, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d58 00010000:00010000:2.0:1789760793.450326:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.450342:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.450346:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.450352:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.450366:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.456230:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985652 is committed 00002000:00010000:2.0:1789760793.456356:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75137024 -> 75141120 00002000:00010000:2.0:1789760793.456361:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146776 -> 146784 00010000:00010000:2.0:1789760793.456374:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456389:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456398:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456406:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.456412:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456421:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456441:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.456449:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75137024->75141119] (req 75137024->75141119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.456545:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565579264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6275us (6519us total) trans 4294985652 rc 0/0 00000100:00100000:2.0:1789760793.456556:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18355 00000100:00100000:2.0:1789760793.456567:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731695575097 time 731710539823 state 0x2 ref 0 00000100:00100000:0.0:1789760793.462926:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.463075:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579392 00000100:00100000:2.0:1789760793.463085:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579392 00000100:00100000:2.0:1789760793.463138:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731695575097 time 731710539823 state 0x0 ref 1 00000100:00100000:2.0:1789760793.463155:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731710800239 time 731710539823 state 0x1 ref 1 00000100:00100000:2.0:1789760793.463188:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731710800239 time 731723480036 state 0x0 ref 1 00000100:00100000:2.0:1789760793.463201:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565579392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.463248:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75141120, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d60 00010000:00010000:2.0:1789760793.463257:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.463273:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.463278:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.463284:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.463298:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.467437:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985653 is committed 00002000:00010000:0.0:1789760793.467565:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75141120 -> 75145216 00002000:00010000:0.0:1789760793.467571:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146784 -> 146792 00010000:00010000:0.0:1789760793.467584:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467596:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467605:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467622:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.467628:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467637:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467656:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.467665:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f4af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75141120->75145215] (req 75141120->75145215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.467788:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565579392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4584us (4866us total) trans 4294985653 rc 0/0 00000100:00100000:0.0:1789760793.467799:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18356 00000100:00100000:0.0:1789760793.467808:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731710800239 time 731723480036 state 0x2 ref 0 00000100:00100000:3.0:1789760793.471350:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.471746:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579520 00000100:00100000:1.0:1789760793.471756:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579520 00000100:00100000:1.0:1789760793.471810:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731710800239 time 731723480036 state 0x0 ref 1 00000100:00100000:1.0:1789760793.471824:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731723740452 time 731723480036 state 0x1 ref 1 00000100:00100000:1.0:1789760793.471846:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731723740452 time 731732139244 state 0x0 ref 1 00000100:00100000:1.0:1789760793.471859:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.471904:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75145216, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d68 00010000:00010000:1.0:1789760793.471914:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.471928:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.471933:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.471939:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.471952:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.478866:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985654 is committed 00002000:00010000:1.0:1789760793.479985:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75145216 -> 75149312 00002000:00010000:1.0:1789760793.479994:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146792 -> 146800 00010000:00010000:1.0:1789760793.480007:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480021:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480031:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480038:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.480043:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480053:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480072:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.480080:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f4b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75145216->75149311] (req 75145216->75149311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.480174:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8311us (8832us total) trans 4294985654 rc 0/0 00000100:00100000:1.0:1789760793.480184:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18357 00000100:00100000:1.0:1789760793.480194:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731723740452 time 731732139244 state 0x2 ref 0 00000100:00100000:1.0:1789760793.485313:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.485383:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579648 00000100:00100000:2.0:1789760793.485393:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579648 00000100:00100000:2.0:1789760793.485446:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731723740452 time 731732139244 state 0x0 ref 1 00000100:00100000:2.0:1789760793.485538:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731732399660 time 731732139244 state 0x1 ref 1 00000100:00100000:2.0:1789760793.485574:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731732399660 time 731745865965 state 0x0 ref 1 00000100:00100000:2.0:1789760793.485586:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.485828:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75149312, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d70 00010000:00010000:2.0:1789760793.485838:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.485854:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.485859:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.485866:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.485881:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.491860:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985655 is committed 00002000:00010000:2.0:1789760793.493391:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75149312 -> 75153408 00002000:00010000:2.0:1789760793.493400:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146800 -> 146808 00010000:00010000:2.0:1789760793.493412:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493426:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493435:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493443:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.493448:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493457:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493474:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.493551:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75149312->75153407] (req 75149312->75153407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.493821:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8232us (8512us total) trans 4294985655 rc 0/0 00000100:00100000:2.0:1789760793.493831:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18358 00000100:00100000:2.0:1789760793.493841:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731732399660 time 731745865965 state 0x2 ref 0 00000100:00100000:0.0:1789760793.497586:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.497690:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579776 00000100:00100000:2.0:1789760793.497699:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579776 00000100:00100000:2.0:1789760793.497884:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731732399660 time 731745865965 state 0x0 ref 1 00000100:00100000:2.0:1789760793.497899:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731746126381 time 731745865965 state 0x1 ref 1 00000100:00100000:2.0:1789760793.497930:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731746126381 time 731758221962 state 0x0 ref 1 00000100:00100000:2.0:1789760793.497942:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565579776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.497989:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75153408, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d78 00010000:00010000:2.0:1789760793.497998:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.498015:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.498019:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.498025:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.498043:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.502542:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985656 is committed 00002000:00010000:2.0:1789760793.502671:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75153408 -> 75157504 00002000:00010000:2.0:1789760793.502676:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146808 -> 146816 00010000:00010000:2.0:1789760793.502692:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502741:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502750:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502760:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.502765:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502773:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502790:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.502796:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75153408->75157503] (req 75153408->75157503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.502880:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565579776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4936us (5299us total) trans 4294985656 rc 0/0 00000100:00100000:2.0:1789760793.502891:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18359 00000100:00100000:2.0:1789760793.502899:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731746126381 time 731758221962 state 0x2 ref 0 00000100:00100000:3.0:1789760793.507245:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.507818:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565579904 00000100:00100000:1.0:1789760793.507829:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565579904 00000100:00100000:1.0:1789760793.507888:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731746126381 time 731758221962 state 0x0 ref 1 00000100:00100000:1.0:1789760793.507902:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731758482378 time 731758221962 state 0x1 ref 1 00000100:00100000:1.0:1789760793.507923:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731758482378 time 731768216419 state 0x0 ref 1 00000100:00100000:1.0:1789760793.507935:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.508132:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75157504, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d80 00010000:00010000:1.0:1789760793.508142:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.508158:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.508163:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.508169:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.508184:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.514916:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985657 is committed 00002000:00010000:1.0:1789760793.517000:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75157504 -> 75161600 00002000:00010000:1.0:1789760793.517009:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146816 -> 146824 00010000:00010000:1.0:1789760793.517023:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517036:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517046:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517054:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.517058:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517072:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517093:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.517207:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f4cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75157504->75161599] (req 75157504->75161599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.517346:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565579904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9408us (10106us total) trans 4294985657 rc 0/0 00000100:00100000:1.0:1789760793.517356:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18360 00000100:00100000:1.0:1789760793.517365:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731758482378 time 731768216419 state 0x2 ref 0 00000100:00100000:1.0:1789760793.524277:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.524356:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580032 00000100:00100000:2.0:1789760793.524366:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580032 00000100:00100000:2.0:1789760793.524417:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731758482378 time 731768216419 state 0x0 ref 1 00000100:00100000:2.0:1789760793.524432:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731768476835 time 731768216419 state 0x1 ref 1 00000100:00100000:2.0:1789760793.524461:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731768476835 time 731784753826 state 0x0 ref 1 00000100:00100000:2.0:1789760793.524472:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.524517:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75161600, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d88 00010000:00010000:2.0:1789760793.524525:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.524541:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.524546:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.524552:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.524565:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.528608:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985658 is committed 00002000:00010000:2.0:1789760793.528772:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75161600 -> 75165696 00002000:00010000:2.0:1789760793.528778:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146824 -> 146832 00010000:00010000:2.0:1789760793.528790:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528802:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528811:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528819:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.528823:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528833:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528853:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.528861:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75161600->75165695] (req 75161600->75165695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.528970:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4488us (4691us total) trans 4294985658 rc 0/0 00000100:00100000:2.0:1789760793.528982:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18361 00000100:00100000:2.0:1789760793.528991:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731768476835 time 731784753826 state 0x2 ref 0 00000100:00100000:0.0:1789760793.537451:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.537602:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580160 00000100:00100000:2.0:1789760793.537611:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580160 00000100:00100000:2.0:1789760793.537671:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731768476835 time 731784753826 state 0x0 ref 1 00000100:00100000:2.0:1789760793.537685:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731785014242 time 731784753826 state 0x1 ref 1 00000100:00100000:0.0:1789760793.537796:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731785014242 time 731798085562 state 0x0 ref 1 00000100:00100000:0.0:1789760793.537812:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565580160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760793.537860:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75165696, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d90 00010000:00010000:0.0:1789760793.537869:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.537884:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:0.0:1789760793.537888:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.537895:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.537914:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.542233:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985659 is committed 00002000:00010000:0.0:1789760793.547148:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75165696 -> 75169792 00002000:00010000:0.0:1789760793.547157:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146832 -> 146840 00010000:00010000:0.0:1789760793.547170:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547183:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547192:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547201:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.547205:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547214:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547245:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.547254:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f4d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75165696->75169791] (req 75165696->75169791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.547346:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565580160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9535us (9899us total) trans 4294985659 rc 0/0 00000100:00100000:0.0:1789760793.547356:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18362 00000100:00100000:0.0:1789760793.547365:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731785014242 time 731798085562 state 0x2 ref 0 00000100:00100000:3.0:1789760793.551022:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.551103:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580288 00000100:00100000:1.0:1789760793.551113:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580288 00000100:00100000:1.0:1789760793.551169:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731785014242 time 731798085562 state 0x0 ref 1 00000100:00100000:1.0:1789760793.551184:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731798345978 time 731798085562 state 0x1 ref 1 00000100:00100000:1.0:1789760793.551250:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731798345978 time 731811541788 state 0x0 ref 1 00000100:00100000:1.0:1789760793.551264:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.551310:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75169792, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23d98 00010000:00010000:1.0:1789760793.551320:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.551336:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.551340:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.551345:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.551359:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.554651:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985660 is committed 00002000:00010000:1.0:1789760793.555554:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75169792 -> 75173888 00002000:00010000:1.0:1789760793.555563:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146840 -> 146848 00010000:00010000:1.0:1789760793.555577:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555590:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555599:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555607:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.555622:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555633:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555654:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.555661:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75169792->75173887] (req 75169792->75173887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.559297:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8023us (8271us total) trans 4294985660 rc 0/0 00000100:00100000:1.0:1789760793.559313:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18363 00000100:00100000:1.0:1789760793.559325:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731798345978 time 731811541788 state 0x2 ref 0 00000100:00100000:1.0:1789760793.568190:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.568390:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580416 00000100:00100000:2.0:1789760793.568399:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580416 00000100:00100000:2.0:1789760793.568451:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731798345978 time 731811541788 state 0x0 ref 1 00000100:00100000:2.0:1789760793.568466:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731811802204 time 731811541788 state 0x1 ref 1 00000100:00100000:2.0:1789760793.568549:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731811802204 time 731828839950 state 0x0 ref 1 00000100:00100000:2.0:1789760793.568562:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565580416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.568609:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75173888, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23da0 00010000:00010000:2.0:1789760793.568630:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.568647:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.568652:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.568658:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.568672:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.575090:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985661 is committed 00002000:00010000:3.0:1789760793.577573:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75173888 -> 75177984 00002000:00010000:3.0:1789760793.577640:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146848 -> 146856 00010000:00010000:3.0:1789760793.577657:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577675:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577684:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577691:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.577696:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577749:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577771:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.577779:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674f4e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75173888->75177983] (req 75173888->75177983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.577866:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565580416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9301us (9679us total) trans 4294985661 rc 0/0 00000100:00100000:3.0:1789760793.577878:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18364 00000100:00100000:3.0:1789760793.577888:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731811802204 time 731828839950 state 0x2 ref 0 00000100:00100000:0.0:1789760793.585912:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.589101:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580544 00000100:00100000:1.0:1789760793.589119:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580544 00000100:00100000:1.0:1789760793.589186:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731811802204 time 731828839950 state 0x0 ref 1 00000100:00100000:1.0:1789760793.589202:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731829100366 time 731828839950 state 0x1 ref 1 00000100:00100000:1.0:1789760793.589242:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731829100366 time 731849534025 state 0x0 ref 1 00000100:00100000:1.0:1789760793.589256:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.589304:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75177984, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23da8 00010000:00010000:1.0:1789760793.589315:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.589337:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.589341:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.589347:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.589361:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.593435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985662 is committed 00002000:00010000:0.0:1789760793.593677:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75177984 -> 75182080 00002000:00010000:0.0:1789760793.593683:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146856 -> 146864 00010000:00010000:0.0:1789760793.593698:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593793:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593801:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593808:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.593812:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593820:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593840:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.593899:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f4ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75177984->75182079] (req 75177984->75182079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.594030:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4770us (8120us total) trans 4294985662 rc 0/0 00000100:00100000:0.0:1789760793.594196:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18365 00000100:00100000:0.0:1789760793.594206:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731829100366 time 731849534025 state 0x2 ref 0 00000100:00100000:0.0:1789760793.603690:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.603907:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580672 00000100:00100000:1.0:1789760793.603918:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580672 00000100:00100000:1.0:1789760793.604117:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731829100366 time 731849534025 state 0x0 ref 1 00000100:00100000:1.0:1789760793.604132:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731849794441 time 731849534025 state 0x1 ref 1 00000100:00100000:1.0:1789760793.604163:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731849794441 time 731864454889 state 0x0 ref 1 00000100:00100000:1.0:1789760793.604175:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565580672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.604222:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75182080, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23db0 00010000:00010000:1.0:1789760793.604230:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.604246:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.604250:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.604257:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.604278:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760793.614673:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985663 is committed 00002000:00010000:1.0:1789760793.614914:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75182080 -> 75186176 00002000:00010000:1.0:1789760793.614920:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146864 -> 146872 00010000:00010000:1.0:1789760793.614943:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.614956:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.614972:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.614979:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.614984:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.615001:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.615021:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.615028:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f4f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75182080->75186175] (req 75182080->75186175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.615123:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565580672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10944us (11438us total) trans 4294985663 rc 0/0 00000100:00100000:1.0:1789760793.615133:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18366 00000100:00100000:1.0:1789760793.615143:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731849794441 time 731864454889 state 0x2 ref 0 00000100:00100000:1.0:1789760793.619214:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.621391:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580800 00000100:00100000:3.0:1789760793.621405:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580800 00000100:00100000:3.0:1789760793.621466:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731849794441 time 731864454889 state 0x0 ref 1 00000100:00100000:3.0:1789760793.621482:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731864715305 time 731864454889 state 0x1 ref 1 00000100:00100000:3.0:1789760793.621521:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731864715305 time 731881812909 state 0x0 ref 1 00000100:00100000:3.0:1789760793.621534:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.621599:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75186176, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23db8 00010000:00010000:3.0:1789760793.621609:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.621633:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.621638:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.621652:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.621668:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.627124:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985664 is committed 00002000:00010000:3.0:1789760793.627249:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75186176 -> 75190272 00002000:00010000:3.0:1789760793.627254:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146872 -> 146880 00010000:00010000:3.0:1789760793.627268:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627280:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627290:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627298:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.627303:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627312:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627333:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.627340:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f4fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75186176->75190271] (req 75186176->75190271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.627427:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565580800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5891us (8217us total) trans 4294985664 rc 0/0 00000100:00100000:3.0:1789760793.627438:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18367 00000100:00100000:3.0:1789760793.627447:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731864715305 time 731881812909 state 0x2 ref 0 00000100:00100000:0.0:1789760793.633056:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.633456:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565580928 00000100:00100000:1.0:1789760793.633465:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565580928 00000100:00100000:1.0:1789760793.633521:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731864715305 time 731881812909 state 0x0 ref 1 00000100:00100000:1.0:1789760793.633535:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731882073325 time 731881812909 state 0x1 ref 1 00000100:00100000:1.0:1789760793.633564:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731882073325 time 731893856072 state 0x0 ref 1 00000100:00100000:1.0:1789760793.633580:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565580928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.633634:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75190272, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23dc0 00010000:00010000:1.0:1789760793.633699:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.633738:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.633742:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.633748:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.633762:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.641341:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985665 is committed 00002000:00010000:0.0:1789760793.641568:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75190272 -> 75194368 00002000:00010000:0.0:1789760793.641572:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146880 -> 146888 00010000:00010000:0.0:1789760793.641585:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641743:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641751:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641758:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.641762:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641774:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641792:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.641800:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f503 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75190272->75194367] (req 75190272->75194367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.641890:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565580928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8307us (8839us total) trans 4294985665 rc 0/0 00000100:00100000:0.0:1789760793.641900:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18368 00000100:00100000:0.0:1789760793.641909:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731882073325 time 731893856072 state 0x2 ref 0 00000100:00100000:0.0:1789760793.647796:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.649047:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581056 00000100:00100000:1.0:1789760793.649060:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581056 00000100:00100000:1.0:1789760793.649114:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731882073325 time 731893856072 state 0x0 ref 1 00000100:00100000:1.0:1789760793.649136:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731894116488 time 731893856072 state 0x1 ref 1 00000100:00100000:1.0:1789760793.649167:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731894116488 time 731909458943 state 0x0 ref 1 00000100:00100000:1.0:1789760793.649180:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565581056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.649226:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75194368, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23dc8 00010000:00010000:1.0:1789760793.649236:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.649257:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.649262:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.649268:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.649282:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.655755:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985666 is committed 00002000:00010000:1.0:1789760793.655947:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75194368 -> 75198464 00002000:00010000:1.0:1789760793.655953:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146888 -> 146896 00010000:00010000:1.0:1789760793.656023:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656038:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656049:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656057:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.656062:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656072:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656096:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656105:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f50a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75194368->75198463] (req 75194368->75198463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.656470:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565581056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7287us (8679us total) trans 4294985666 rc 0/0 00000100:00100000:1.0:1789760793.656480:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18369 00000100:00100000:1.0:1789760793.656489:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731894116488 time 731909458943 state 0x2 ref 0 00000100:00100000:1.0:1789760793.661439:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760793.661512:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581184 00000100:00100000:3.0:1789760793.661522:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581184 00000100:00100000:3.0:1789760793.661585:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731894116488 time 731909458943 state 0x0 ref 1 00000100:00100000:3.0:1789760793.661599:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731909719359 time 731909458943 state 0x1 ref 1 00000100:00100000:3.0:1789760793.661637:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731909719359 time 731921929305 state 0x0 ref 1 00000100:00100000:3.0:1789760793.661658:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565581184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760793.661739:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75198464, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23dd0 00010000:00010000:3.0:1789760793.661749:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.661763:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:3.0:1789760793.661768:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.661775:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.661789:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.666869:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985667 is committed 00002000:00010000:3.0:1789760793.667238:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75198464 -> 75202560 00002000:00010000:3.0:1789760793.667244:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146896 -> 146904 00010000:00010000:3.0:1789760793.667257:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667270:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667279:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667292:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760793.667296:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667304:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667324:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.667331:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f511 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75198464->75202559] (req 75198464->75202559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.667464:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565581184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5803us (6029us total) trans 4294985667 rc 0/0 00000100:00100000:3.0:1789760793.667474:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18370 00000100:00100000:3.0:1789760793.667484:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731909719359 time 731921929305 state 0x2 ref 0 00000100:00100000:0.0:1789760793.672370:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.672445:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581312 00000100:00100000:1.0:1789760793.672454:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581312 00000100:00100000:1.0:1789760793.672504:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731909719359 time 731921929305 state 0x0 ref 1 00000100:00100000:1.0:1789760793.672517:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731922189721 time 731921929305 state 0x1 ref 1 00000100:00100000:1.0:1789760793.672544:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731922189721 time 731932836663 state 0x0 ref 1 00000100:00100000:1.0:1789760793.672571:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.672628:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75202560, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23dd8 00010000:00010000:1.0:1789760793.672636:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.672651:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.672655:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.672661:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.672675:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.677822:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985668 is committed 00002000:00010000:1.0:1789760793.678091:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75202560 -> 75206656 00002000:00010000:1.0:1789760793.678096:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146904 -> 146912 00010000:00010000:1.0:1789760793.678108:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678194:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678202:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678210:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.678215:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678225:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678242:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.678250:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75202560->75206655] (req 75202560->75206655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.678373:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5814us (6009us total) trans 4294985668 rc 0/0 00000100:00100000:1.0:1789760793.678384:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18371 00000100:00100000:1.0:1789760793.678393:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731922189721 time 731932836663 state 0x2 ref 0 00000100:00100000:0.0:1789760793.683667:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.683806:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581440 00000100:00100000:1.0:1789760793.683816:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581440 00000100:00100000:1.0:1789760793.683869:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731922189721 time 731932836663 state 0x0 ref 1 00000100:00100000:1.0:1789760793.683883:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731933097079 time 731932836663 state 0x1 ref 1 00000100:00100000:1.0:1789760793.683905:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731933097079 time 731944197342 state 0x0 ref 1 00000100:00100000:1.0:1789760793.683917:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.683975:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75206656, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23de0 00010000:00010000:1.0:1789760793.683984:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.684000:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.684005:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.684012:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.684026:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.689947:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985669 is committed 00002000:00010000:1.0:1789760793.691218:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75206656 -> 75210752 00002000:00010000:1.0:1789760793.691227:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146912 -> 146920 00010000:00010000:1.0:1789760793.691241:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691255:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691269:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691277:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.691282:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691291:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691310:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.691318:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f51f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75206656->75210751] (req 75206656->75210751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.691589:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7667us (7927us total) trans 4294985669 rc 0/0 00000100:00100000:1.0:1789760793.691601:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18372 00000100:00100000:1.0:1789760793.691610:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731933097079 time 731944197342 state 0x2 ref 0 00000100:00100000:3.0:1789760793.697109:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.700812:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581568 00000100:00100000:2.0:1789760793.700827:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581568 00000100:00100000:2.0:1789760793.700900:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731933097079 time 731944197342 state 0x0 ref 1 00000100:00100000:2.0:1789760793.700915:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731944457758 time 731944197342 state 0x1 ref 1 00000100:00100000:2.0:1789760793.700938:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731944457758 time 731961230572 state 0x0 ref 1 00000100:00100000:2.0:1789760793.700950:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.701913:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75210752, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23de8 00010000:00010000:2.0:1789760793.701927:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.701942:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.701947:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.701954:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.701984:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.706109:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985670 is committed 00002000:00010000:2.0:1789760793.706338:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75210752 -> 75214848 00002000:00010000:2.0:1789760793.706343:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146920 -> 146928 00010000:00010000:2.0:1789760793.706355:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706364:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706370:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706374:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.706378:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706384:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706399:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.706404:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f526 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75210752->75214847] (req 75210752->75214847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.706482:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565581568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5532us (9426us total) trans 4294985670 rc 0/0 00000100:00100000:2.0:1789760793.706490:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18373 00000100:00100000:2.0:1789760793.706498:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731944457758 time 731961230572 state 0x2 ref 0 00000100:00100000:0.0:1789760793.710695:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.710778:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581696 00000100:00100000:1.0:1789760793.710787:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581696 00000100:00100000:1.0:1789760793.710838:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731944457758 time 731961230572 state 0x0 ref 1 00000100:00100000:1.0:1789760793.710854:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731961490988 time 731961230572 state 0x1 ref 1 00000100:00100000:1.0:1789760793.710884:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731961490988 time 731971176442 state 0x0 ref 1 00000100:00100000:1.0:1789760793.710897:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565581696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.710942:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75214848, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23df0 00010000:00010000:1.0:1789760793.710950:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.710966:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.710970:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.710976:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.710989:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.716490:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985671 is committed 00002000:00010000:1.0:1789760793.716643:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75214848 -> 75218944 00002000:00010000:1.0:1789760793.716647:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146928 -> 146936 00010000:00010000:1.0:1789760793.716841:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716851:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716857:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716863:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.716866:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716873:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716887:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.716892:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f52d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75214848->75218943] (req 75214848->75218943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.716973:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565581696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6065us (6274us total) trans 4294985671 rc 0/0 00000100:00100000:1.0:1789760793.716983:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18374 00000100:00100000:1.0:1789760793.716998:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731961490988 time 731971176442 state 0x2 ref 0 00000100:00100000:0.0:1789760793.721769:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.721800:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581824 00000100:00100000:1.0:1789760793.721809:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581824 00000100:00100000:1.0:1789760793.721865:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731961490988 time 731971176442 state 0x0 ref 1 00000100:00100000:1.0:1789760793.721879:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731971436858 time 731971176442 state 0x1 ref 1 00000100:00100000:1.0:1789760793.721908:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731971436858 time 731982200765 state 0x0 ref 1 00000100:00100000:1.0:1789760793.721923:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565581824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.721966:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75218944, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23df8 00010000:00010000:1.0:1789760793.721975:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.721989:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789760793.721994:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.722000:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.722013:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.726554:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985672 is committed 00002000:00010000:1.0:1789760793.726667:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75218944 -> 75223040 00002000:00010000:1.0:1789760793.726672:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146936 -> 146944 00010000:00010000:1.0:1789760793.726685:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.726697:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.727579:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.727589:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.727594:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.727604:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.727634:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.727643:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75218944->75223039] (req 75218944->75223039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.727812:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565581824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5886us (6050us total) trans 4294985672 rc 0/0 00000100:00100000:1.0:1789760793.727822:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18375 00000100:00100000:1.0:1789760793.727831:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731971436858 time 731982200765 state 0x2 ref 0 00000100:00100000:3.0:1789760793.736794:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.736898:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565581952 00000100:00100000:2.0:1789760793.736907:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565581952 00000100:00100000:2.0:1789760793.736958:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731971436858 time 731982200765 state 0x0 ref 1 00000100:00100000:2.0:1789760793.736973:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731982461181 time 731982200765 state 0x1 ref 1 00000100:00100000:2.0:1789760793.737081:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731982461181 time 731997371552 state 0x0 ref 1 00000100:00100000:2.0:1789760793.737094:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565581952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.737141:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75223040, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e00 00010000:00010000:2.0:1789760793.737150:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.737165:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789760793.737169:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.737176:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.737194:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.741753:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985673 is committed 00002000:00010000:2.0:1789760793.741848:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75223040 -> 75227136 00002000:00010000:2.0:1789760793.741854:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146944 -> 146952 00010000:00010000:2.0:1789760793.741867:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741880:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741890:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741897:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.741902:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741910:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741933:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.741941:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f53b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75223040->75227135] (req 75223040->75227135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.742033:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565581952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4937us (5245us total) trans 4294985673 rc 0/0 00000100:00100000:2.0:1789760793.742043:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18376 00000100:00100000:2.0:1789760793.742053:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731982461181 time 731997371552 state 0x2 ref 0 00000100:00100000:0.0:1789760793.745982:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.746086:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582080 00000100:00100000:1.0:1789760793.746095:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582080 00000100:00100000:1.0:1789760793.746147:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731982461181 time 731997371552 state 0x0 ref 1 00000100:00100000:1.0:1789760793.746163:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731997631968 time 731997371552 state 0x1 ref 1 00000100:00100000:1.0:1789760793.746195:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731997631968 time 732006487278 state 0x0 ref 1 00000100:00100000:1.0:1789760793.746207:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565582080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.746254:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75227136, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e08 00010000:00010000:1.0:1789760793.746262:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.746276:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.746280:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.746286:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.746300:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.752038:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985674 is committed 00002000:00010000:1.0:1789760793.752206:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75227136 -> 75231232 00002000:00010000:1.0:1789760793.752211:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146952 -> 146960 00010000:00010000:1.0:1789760793.752224:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752238:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752247:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752255:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.752260:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752274:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752294:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.752302:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f542 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75227136->75231231] (req 75227136->75231231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.752461:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565582080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6250us (6483us total) trans 4294985674 rc 0/0 00000100:00100000:1.0:1789760793.752472:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18377 00000100:00100000:1.0:1789760793.752482:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731997631968 time 732006487278 state 0x2 ref 0 00000100:00100000:0.0:1789760793.757215:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.757290:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582208 00000100:00100000:1.0:1789760793.757298:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582208 00000100:00100000:1.0:1789760793.757344:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 731997631968 time 732006487278 state 0x0 ref 1 00000100:00100000:1.0:1789760793.757358:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732006747694 time 732006487278 state 0x1 ref 1 00000100:00100000:1.0:1789760793.757384:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732006747694 time 732017676493 state 0x0 ref 1 00000100:00100000:1.0:1789760793.757394:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.757434:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75231232, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e10 00010000:00010000:1.0:1789760793.757443:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.757459:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.757463:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.757469:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.757482:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.764306:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985675 is committed 00002000:00010000:2.0:1789760793.764471:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75231232 -> 75235328 00002000:00010000:2.0:1789760793.764477:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146960 -> 146968 00010000:00010000:2.0:1789760793.764490:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764502:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764512:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764519:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.764524:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764533:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764553:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.764562:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeba7aa/0x721975f94674f549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75231232->75235327] (req 75231232->75235327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.764754:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7356us (7542us total) trans 4294985675 rc 0/0 00000100:00100000:2.0:1789760793.764765:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18378 00000100:00100000:2.0:1789760793.764775:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732006747694 time 732017676493 state 0x2 ref 0 00000100:00100000:3.0:1789760793.768029:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.768352:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582336 00000100:00100000:2.0:1789760793.768361:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582336 00000100:00100000:2.0:1789760793.768409:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732006747694 time 732017676493 state 0x0 ref 1 00000100:00100000:2.0:1789760793.768424:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732017936909 time 732017676493 state 0x1 ref 1 00000100:00100000:2.0:1789760793.768455:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732017936909 time 732028747777 state 0x0 ref 1 00000100:00100000:2.0:1789760793.768467:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565582336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.768517:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75235328, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e18 00010000:00010000:2.0:1789760793.768524:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.768540:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.768544:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.768670:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.768692:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.773302:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985676 is committed 00002000:00010000:2.0:1789760793.773405:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75235328 -> 75239424 00002000:00010000:2.0:1789760793.773410:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146968 -> 146976 00010000:00010000:2.0:1789760793.773425:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773437:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773446:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773454:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.773459:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773468:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773489:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.773497:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75235328->75239423] (req 75235328->75239423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.773670:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565582336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5199us (5644us total) trans 4294985676 rc 0/0 00000100:00100000:2.0:1789760793.773682:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18379 00000100:00100000:2.0:1789760793.773691:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732017936909 time 732028747777 state 0x2 ref 0 00000100:00100000:0.0:1789760793.778329:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.778404:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582464 00000100:00100000:1.0:1789760793.778413:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582464 00000100:00100000:1.0:1789760793.778461:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732017936909 time 732028747777 state 0x0 ref 1 00000100:00100000:1.0:1789760793.778476:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732029008193 time 732028747777 state 0x1 ref 1 00000100:00100000:1.0:1789760793.778504:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732029008193 time 732038796710 state 0x0 ref 1 00000100:00100000:1.0:1789760793.778516:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565582464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.778568:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75239424, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e20 00010000:00010000:1.0:1789760793.778576:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.778592:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.778597:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.778603:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.778629:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.782846:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985677 is committed 00002000:00010000:1.0:1789760793.783049:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75239424 -> 75243520 00002000:00010000:1.0:1789760793.783054:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146976 -> 146984 00010000:00010000:1.0:1789760793.783067:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783080:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783088:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783095:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.783099:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783108:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783125:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.783133:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f557 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75239424->75243519] (req 75239424->75243519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.783260:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565582464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 4741us (4936us total) trans 4294985677 rc 0/0 00000100:00100000:1.0:1789760793.783271:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18380 00000100:00100000:1.0:1789760793.783280:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732029008193 time 732038796710 state 0x2 ref 0 00000100:00100000:0.0:1789760793.786756:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.786859:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582592 00000100:00100000:2.0:1789760793.786869:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582592 00000100:00100000:2.0:1789760793.786923:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732029008193 time 732038796710 state 0x0 ref 1 00000100:00100000:2.0:1789760793.786937:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732039057126 time 732038796710 state 0x1 ref 1 00000100:00100000:2.0:1789760793.786997:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732039057126 time 732047289432 state 0x0 ref 1 00000100:00100000:2.0:1789760793.787009:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.787057:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75243520, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e28 00010000:00010000:2.0:1789760793.787066:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.787082:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.787087:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.787093:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.787107:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.793027:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985678 is committed 00002000:00010000:2.0:1789760793.793407:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75243520 -> 75247616 00002000:00010000:2.0:1789760793.793413:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146984 -> 146992 00010000:00010000:2.0:1789760793.793429:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793443:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793452:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793460:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.793465:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793474:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793496:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.793504:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f55e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75243520->75247615] (req 75243520->75247615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.793759:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6696us (6956us total) trans 4294985678 rc 0/0 00000100:00100000:2.0:1789760793.793771:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18381 00000100:00100000:2.0:1789760793.793781:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732039057126 time 732047289432 state 0x2 ref 0 00000100:00100000:3.0:1789760793.803382:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.803479:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582720 00000100:00100000:2.0:1789760793.803489:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582720 00000100:00100000:2.0:1789760793.803541:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732039057126 time 732047289432 state 0x0 ref 1 00000100:00100000:2.0:1789760793.803555:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732047549848 time 732047289432 state 0x1 ref 1 00000100:00100000:2.0:1789760793.803589:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732047549848 time 732063880884 state 0x0 ref 1 00000100:00100000:2.0:1789760793.803602:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565582720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.803662:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75247616, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e30 00010000:00010000:2.0:1789760793.803671:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.803687:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.803691:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.803696:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.803876:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760793.803967:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.810934:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985679 is committed 00002000:00010000:2.0:1789760793.811265:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75247616 -> 75251712 00002000:00010000:2.0:1789760793.811270:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 146992 -> 147000 00010000:00010000:2.0:1789760793.811287:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811300:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811308:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811316:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.811321:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811405:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811426:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.811434:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f565 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75247616->75251711] (req 75247616->75251711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.811566:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565582720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7961us (8189us total) trans 4294985679 rc 0/0 00000100:00100000:2.0:1789760793.811577:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18382 00000100:00100000:2.0:1789760793.811588:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732047549848 time 732063880884 state 0x2 ref 0 00000100:00100000:0.0:1789760793.819878:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.820404:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582848 00000100:00100000:1.0:1789760793.820414:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582848 00000100:00100000:1.0:1789760793.820651:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732047549848 time 732063880884 state 0x0 ref 1 00000100:00100000:1.0:1789760793.820667:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732064141300 time 732063880884 state 0x1 ref 1 00000100:00100000:1.0:1789760793.820830:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732064141300 time 732081120545 state 0x0 ref 1 00000100:00100000:1.0:1789760793.820844:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.821190:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75251712, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e38 00010000:00010000:1.0:1789760793.821201:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.821216:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.821221:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.821227:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.821240:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.826758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985680 is committed 00002000:00010000:0.0:1789760793.826917:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75251712 -> 75255808 00002000:00010000:0.0:1789760793.826921:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147000 -> 147008 00010000:00010000:0.0:1789760793.826934:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.826947:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.827016:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.827027:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760793.827031:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.827212:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.827234:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.827243:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f56c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75251712->75255807] (req 75251712->75255807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.827371:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565582848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6524us (7496us total) trans 4294985680 rc 0/0 00000100:00100000:0.0:1789760793.827384:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18383 00000100:00100000:0.0:1789760793.827395:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732064141300 time 732081120545 state 0x2 ref 0 00000100:00100000:1.0:1789760793.837201:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.837322:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565582976 00000100:00100000:2.0:1789760793.837332:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565582976 00000100:00100000:2.0:1789760793.837386:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732064141300 time 732081120545 state 0x0 ref 1 00000100:00100000:2.0:1789760793.837401:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732081380961 time 732081120545 state 0x1 ref 1 00000100:00100000:2.0:1789760793.837464:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732081380961 time 732097755732 state 0x0 ref 1 00000100:00100000:2.0:1789760793.837476:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565582976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.837519:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75255808, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e40 00010000:00010000:2.0:1789760793.837528:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.837543:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.837547:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.837554:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.837566:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.843676:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985681 is committed 00002000:00010000:1.0:1789760793.843798:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75255808 -> 75259904 00002000:00010000:1.0:1789760793.843803:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147008 -> 147016 00010000:00010000:1.0:1789760793.843815:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843827:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843837:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843845:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.843850:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843861:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843880:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.843886:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75255808->75259903] (req 75255808->75259903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.843978:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565582976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6499us (6780us total) trans 4294985681 rc 0/0 00000100:00100000:1.0:1789760793.843989:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18384 00000100:00100000:1.0:1789760793.843999:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732081380961 time 732097755732 state 0x2 ref 0 00000100:00100000:3.0:1789760793.850101:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.850206:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583104 00000100:00100000:2.0:1789760793.850216:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583104 00000100:00100000:2.0:1789760793.850268:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732081380961 time 732097755732 state 0x0 ref 1 00000100:00100000:2.0:1789760793.850283:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732098016148 time 732097755732 state 0x1 ref 1 00000100:00100000:2.0:1789760793.850315:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732098016148 time 732110606597 state 0x0 ref 1 00000100:00100000:2.0:1789760793.850336:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565583104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.850391:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75259904, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e48 00010000:00010000:2.0:1789760793.850404:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.850418:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.850423:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.850429:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.850442:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.857625:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985682 is committed 00002000:00010000:2.0:1789760793.857857:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75259904 -> 75264000 00002000:00010000:2.0:1789760793.857862:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147016 -> 147024 00010000:00010000:2.0:1789760793.857876:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.857888:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.857897:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.857910:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.857915:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.857925:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.858079:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.858090:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f57a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75259904->75263999] (req 75259904->75263999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.858221:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565583104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7890us (8134us total) trans 4294985682 rc 0/0 00000100:00100000:2.0:1789760793.858232:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18385 00000100:00100000:2.0:1789760793.858241:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732098016148 time 732110606597 state 0x2 ref 0 00000100:00100000:0.0:1789760793.862594:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.862838:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583232 00000100:00100000:1.0:1789760793.862849:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583232 00000100:00100000:1.0:1789760793.862904:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732098016148 time 732110606597 state 0x0 ref 1 00000100:00100000:1.0:1789760793.862918:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732110867013 time 732110606597 state 0x1 ref 1 00000100:00100000:1.0:1789760793.862954:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732110867013 time 732123245910 state 0x0 ref 1 00000100:00100000:1.0:1789760793.862967:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.863012:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75264000, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e50 00010000:00010000:1.0:1789760793.863020:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.863035:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.863040:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.863046:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.863063:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.869243:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985683 is committed 00002000:00010000:1.0:1789760793.869374:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75264000 -> 75268096 00002000:00010000:1.0:1789760793.869379:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147024 -> 147032 00010000:00010000:1.0:1789760793.869392:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869404:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869412:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869419:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.869424:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869433:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869451:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.869459:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75264000->75268095] (req 75264000->75268095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.869548:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6580us (6959us total) trans 4294985683 rc 0/0 00000100:00100000:1.0:1789760793.869559:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18386 00000100:00100000:1.0:1789760793.869570:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732110867013 time 732123245910 state 0x2 ref 0 00000100:00100000:1.0:1789760793.874537:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.874633:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583360 00000100:00100000:2.0:1789760793.874642:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583360 00000100:00100000:2.0:1789760793.874745:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732110867013 time 732123245910 state 0x0 ref 1 00000100:00100000:2.0:1789760793.874760:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732123506326 time 732123245910 state 0x1 ref 1 00000100:00100000:2.0:1789760793.874781:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732123506326 time 732135073029 state 0x0 ref 1 00000100:00100000:2.0:1789760793.874794:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565583360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.874850:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75268096, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e58 00010000:00010000:2.0:1789760793.874859:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.875206:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.875213:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.875221:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.875238:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.880988:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985684 is committed 00002000:00010000:2.0:1789760793.881282:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75268096 -> 75272192 00002000:00010000:2.0:1789760793.881287:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147032 -> 147040 00010000:00010000:2.0:1789760793.881299:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881313:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881322:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881340:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.881347:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881356:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881377:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.881385:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75268096->75272191] (req 75268096->75272191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.881526:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565583360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6730us (6994us total) trans 4294985684 rc 0/0 00000100:00100000:2.0:1789760793.881539:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18387 00000100:00100000:2.0:1789760793.881560:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732123506326 time 732135073029 state 0x2 ref 0 00000100:00100000:3.0:1789760793.889374:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.889459:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583488 00000100:00100000:2.0:1789760793.889468:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583488 00000100:00100000:2.0:1789760793.889521:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732123506326 time 732135073029 state 0x0 ref 1 00000100:00100000:2.0:1789760793.889536:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732135333445 time 732135073029 state 0x1 ref 1 00000100:00100000:2.0:1789760793.889571:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732135333445 time 732149863060 state 0x0 ref 1 00000100:00100000:2.0:1789760793.889583:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565583488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.889642:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75272192, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e60 00010000:00010000:2.0:1789760793.889651:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.889665:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.889669:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.889685:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.889699:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.894665:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985685 is committed 00002000:00010000:2.0:1789760793.894850:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75272192 -> 75276288 00002000:00010000:2.0:1789760793.894856:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147040 -> 147048 00010000:00010000:2.0:1789760793.894869:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894883:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894893:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894901:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.894906:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894915:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894935:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.894943:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f58f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75272192->75276287] (req 75272192->75276287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.895210:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565583488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5624us (5843us total) trans 4294985685 rc 0/0 00000100:00100000:2.0:1789760793.895220:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18388 00000100:00100000:2.0:1789760793.895229:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732135333445 time 732149863060 state 0x2 ref 0 00000100:00100000:0.0:1789760793.900565:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.900739:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583616 00000100:00100000:1.0:1789760793.900748:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583616 00000100:00100000:1.0:1789760793.900801:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732135333445 time 732149863060 state 0x0 ref 1 00000100:00100000:1.0:1789760793.900815:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732150123476 time 732149863060 state 0x1 ref 1 00000100:00100000:1.0:1789760793.900837:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732150123476 time 732161130022 state 0x0 ref 1 00000100:00100000:1.0:1789760793.900847:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.900889:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75276288, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e68 00010000:00010000:1.0:1789760793.900898:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.900912:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.900916:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.900922:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.900936:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.908548:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985686 is committed 00002000:00010000:1.0:1789760793.908792:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75276288 -> 75280384 00002000:00010000:1.0:1789760793.908797:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147048 -> 147056 00010000:00010000:1.0:1789760793.908812:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908824:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908833:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908839:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.908844:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908853:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908870:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.908878:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f596 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75276288->75280383] (req 75276288->75280383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.909855:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9000us (9291us total) trans 4294985686 rc 0/0 00000100:00100000:1.0:1789760793.909868:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18389 00000100:00100000:1.0:1789760793.909879:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732150123476 time 732161130022 state 0x2 ref 0 00000100:00100000:1.0:1789760793.916337:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.916425:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583744 00000100:00100000:2.0:1789760793.916434:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583744 00000100:00100000:2.0:1789760793.916483:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732150123476 time 732161130022 state 0x0 ref 1 00000100:00100000:2.0:1789760793.916496:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732161390438 time 732161130022 state 0x1 ref 1 00000100:00100000:2.0:1789760793.916523:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732161390438 time 732176815979 state 0x0 ref 1 00000100:00100000:2.0:1789760793.916534:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565583744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.916579:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75280384, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e70 00010000:00010000:2.0:1789760793.916588:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.916607:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.916620:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.916626:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.916639:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.922383:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985687 is committed 00002000:00010000:2.0:1789760793.922500:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75280384 -> 75284480 00002000:00010000:2.0:1789760793.922506:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147056 -> 147064 00010000:00010000:2.0:1789760793.922518:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922531:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922542:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922550:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.922555:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922562:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922586:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.922598:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f59d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75280384->75284479] (req 75280384->75284479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.922787:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565583744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6246us (6451us total) trans 4294985687 rc 0/0 00000100:00100000:2.0:1789760793.922797:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18390 00000100:00100000:2.0:1789760793.922807:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732161390438 time 732176815979 state 0x2 ref 0 00000100:00100000:3.0:1789760793.930534:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.930659:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565583872 00000100:00100000:2.0:1789760793.930669:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565583872 00000100:00100000:2.0:1789760793.930755:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732161390438 time 732176815979 state 0x0 ref 1 00000100:00100000:2.0:1789760793.930772:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732177076395 time 732176815979 state 0x1 ref 1 00000100:00100000:2.0:1789760793.930793:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732177076395 time 732191084787 state 0x0 ref 1 00000100:00100000:2.0:1789760793.930805:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.930853:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75284480, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x23e78 00010000:00010000:2.0:1789760793.930862:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.930878:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.930883:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.930890:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.930903:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.938284:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985688 is committed 00002000:00010000:2.0:1789760793.938583:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75284480 -> 75288576 00002000:00010000:2.0:1789760793.938588:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760793 -> 1789760794 00002000:00010000:2.0:1789760793.938591:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760793 -> 1789760794 00002000:00010000:2.0:1789760793.938593:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147064 -> 147072 00010000:00010000:2.0:1789760793.938626:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938640:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938650:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938657:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.938662:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938672:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938747:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.938756:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75284480->75288575] (req 75284480->75288575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.938848:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565583872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8040us (8318us total) trans 4294985688 rc 0/0 00000100:00100000:2.0:1789760793.938860:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18391 00000100:00100000:2.0:1789760793.938869:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732177076395 time 732191084787 state 0x2 ref 0 00000100:00100000:0.0:1789760793.942898:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.943006:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584000 00000100:00100000:1.0:1789760793.943015:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584000 00000100:00100000:1.0:1789760793.943067:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732177076395 time 732191084787 state 0x0 ref 1 00000100:00100000:1.0:1789760793.943082:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732191345203 time 732191084787 state 0x1 ref 1 00000100:00100000:1.0:1789760793.943115:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732191345203 time 732203406700 state 0x0 ref 1 00000100:00100000:1.0:1789760793.943127:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.943174:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75288576, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23e80 00010000:00010000:1.0:1789760793.943183:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.943199:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.943204:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.943210:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.943223:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.949236:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985689 is committed 00002000:00010000:1.0:1789760793.949358:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75288576 -> 75292672 00002000:00010000:1.0:1789760793.949363:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147072 -> 147080 00010000:00010000:1.0:1789760793.949377:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949390:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949400:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949408:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.949414:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949424:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949444:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.949451:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674f5ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75288576->75292671] (req 75288576->75292671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.949557:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6426us (6661us total) trans 4294985689 rc 0/0 00000100:00100000:1.0:1789760793.949567:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18392 00000100:00100000:1.0:1789760793.949576:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732191345203 time 732203406700 state 0x2 ref 0 00000100:00100000:1.0:1789760793.954671:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.954749:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584128 00000100:00100000:2.0:1789760793.954759:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584128 00000100:00100000:2.0:1789760793.954811:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732191345203 time 732203406700 state 0x0 ref 1 00000100:00100000:2.0:1789760793.954825:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732203667116 time 732203406700 state 0x1 ref 1 00000100:00100000:2.0:1789760793.954857:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732203667116 time 732215149981 state 0x0 ref 1 00000100:00100000:2.0:1789760793.954869:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.954916:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75292672, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23e88 00010000:00010000:2.0:1789760793.954925:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954946:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.954951:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.954968:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954982:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.959913:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985690 is committed 00002000:00010000:2.0:1789760793.960010:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75292672 -> 75296768 00002000:00010000:2.0:1789760793.960015:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147080 -> 147088 00010000:00010000:2.0:1789760793.960028:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960040:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960054:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960061:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.960066:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960074:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960099:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.960107:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75292672->75296767] (req 75292672->75296767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.960196:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5326us (5531us total) trans 4294985690 rc 0/0 00000100:00100000:2.0:1789760793.960204:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18393 00000100:00100000:2.0:1789760793.960211:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732203667116 time 732215149981 state 0x2 ref 0 00000100:00100000:3.0:1789760793.964003:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760793.964161:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584256 00000100:00100000:2.0:1789760793.964170:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584256 00000100:00100000:2.0:1789760793.964222:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732203667116 time 732215149981 state 0x0 ref 1 00000100:00100000:2.0:1789760793.964237:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732215410397 time 732215149981 state 0x1 ref 1 00000100:00100000:2.0:1789760793.964267:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732215410397 time 732224559180 state 0x0 ref 1 00000100:00100000:2.0:1789760793.964279:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760793.964332:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75296768, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23e90 00010000:00010000:2.0:1789760793.964341:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.964357:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760793.964362:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.964367:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.964381:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.970016:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985691 is committed 00002000:00010000:2.0:1789760793.970147:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75296768 -> 75300864 00002000:00010000:2.0:1789760793.970150:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147088 -> 147096 00010000:00010000:2.0:1789760793.970161:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970172:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970182:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970190:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760793.970194:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970203:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970221:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.970235:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75296768->75300863] (req 75296768->75300863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.970315:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6031us (6315us total) trans 4294985691 rc 0/0 00000100:00100000:2.0:1789760793.970326:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18394 00000100:00100000:2.0:1789760793.970335:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732215410397 time 732224559180 state 0x2 ref 0 00000100:00100000:0.0:1789760793.981527:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760793.981737:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584384 00000100:00100000:1.0:1789760793.981747:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584384 00000100:00100000:1.0:1789760793.981802:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732215410397 time 732224559180 state 0x0 ref 1 00000100:00100000:1.0:1789760793.981818:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732224819596 time 732224559180 state 0x1 ref 1 00000100:00100000:1.0:1789760793.981849:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732224819596 time 732242141684 state 0x0 ref 1 00000100:00100000:1.0:1789760793.981861:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760793.981908:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75300864, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23e98 00010000:00010000:1.0:1789760793.981917:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.981931:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760793.981935:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760793.981941:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.981954:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760793.988339:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985692 is committed 00002000:00010000:1.0:1789760793.988914:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75300864 -> 75304960 00002000:00010000:1.0:1789760793.988920:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147096 -> 147104 00010000:00010000:1.0:1789760793.988933:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.988946:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.989019:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.989029:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760793.989034:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.989044:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.989066:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.989074:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75300864->75304959] (req 75300864->75304959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.989170:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7306us (7647us total) trans 4294985692 rc 0/0 00000100:00100000:1.0:1789760793.989181:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18395 00000100:00100000:1.0:1789760793.989191:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732224819596 time 732242141684 state 0x2 ref 0 00000100:00100000:1.0:1789760794.000668:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.000868:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584512 00000100:00100000:2.0:1789760794.000879:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584512 00000100:00100000:2.0:1789760794.000943:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732224819596 time 732242141684 state 0x0 ref 1 00000100:00100000:2.0:1789760794.000959:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732242402100 time 732242141684 state 0x1 ref 1 00000100:00100000:2.0:1789760794.000989:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732242402100 time 732261281417 state 0x0 ref 1 00000100:00100000:2.0:1789760794.001000:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.001048:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75304960, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ea0 00010000:00010000:2.0:1789760794.001057:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.001074:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.001078:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.001084:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.001098:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760794.001556:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760794.025081:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985693 is committed 00002000:00010000:2.0:1789760794.025890:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75304960 -> 75309056 00002000:00010000:2.0:1789760794.025897:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147104 -> 147112 00010000:00010000:2.0:1789760794.025979:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.025994:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.026003:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.026011:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.026016:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.026024:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.026045:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.026052:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75304960->75309055] (req 75304960->75309055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.026189:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565584512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 25186us (25526us total) trans 4294985693 rc 0/0 00000100:00100000:2.0:1789760794.026199:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18396 00000100:00100000:2.0:1789760794.026210:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732242402100 time 732261281417 state 0x2 ref 0 00000100:00100000:3.0:1789760794.038225:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.039429:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584640 00000100:00100000:2.0:1789760794.039443:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584640 00000100:00100000:2.0:1789760794.039504:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732242402100 time 732261281417 state 0x0 ref 1 00000100:00100000:2.0:1789760794.039531:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732261541833 time 732261281417 state 0x1 ref 1 00000100:00100000:2.0:1789760794.039565:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732261541833 time 732299856850 state 0x0 ref 1 00000100:00100000:2.0:1789760794.039577:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.039637:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75309056, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ea8 00010000:00010000:2.0:1789760794.039647:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.039663:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.039667:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.039673:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.039686:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.048280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985694 is committed 00002000:00010000:2.0:1789760794.050337:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75309056 -> 75313152 00002000:00010000:2.0:1789760794.050345:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147112 -> 147120 00010000:00010000:2.0:1789760794.050359:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050372:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050380:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050387:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.050391:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050400:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050419:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.050438:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75309056->75313151] (req 75309056->75313151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.050588:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565584640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11009us (12368us total) trans 4294985694 rc 0/0 00000100:00100000:2.0:1789760794.050600:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18397 00000100:00100000:2.0:1789760794.050618:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732261541833 time 732299856850 state 0x2 ref 0 00000100:00100000:0.0:1789760794.055510:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.055681:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584768 00000100:00100000:1.0:1789760794.055691:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584768 00000100:00100000:1.0:1789760794.055911:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732261541833 time 732299856850 state 0x0 ref 1 00000100:00100000:1.0:1789760794.055927:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732300117266 time 732299856850 state 0x1 ref 1 00000100:00100000:1.0:1789760794.056067:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732300117266 time 732316356985 state 0x0 ref 1 00000100:00100000:1.0:1789760794.056092:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565584768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.056145:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75313152, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23eb0 00010000:00010000:1.0:1789760794.056156:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.056171:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.056176:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.056182:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.056195:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.071093:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985695 is committed 00002000:00010000:1.0:1789760794.071224:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75313152 -> 75317248 00002000:00010000:1.0:1789760794.071230:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147120 -> 147128 00010000:00010000:1.0:1789760794.071243:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071257:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071266:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071274:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.071278:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071287:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071304:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.071312:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674f5d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75313152->75317247] (req 75313152->75317247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.071457:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565584768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15364us (15952us total) trans 4294985695 rc 0/0 00000100:00100000:1.0:1789760794.071468:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18398 00000100:00100000:1.0:1789760794.071478:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732300117266 time 732316356985 state 0x2 ref 0 00000100:00100000:1.0:1789760794.081160:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.081375:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565584896 00000100:00100000:2.0:1789760794.081385:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565584896 00000100:00100000:2.0:1789760794.081438:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732300117266 time 732316356985 state 0x0 ref 1 00000100:00100000:2.0:1789760794.081453:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732316617401 time 732316356985 state 0x1 ref 1 00000100:00100000:2.0:1789760794.081483:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732316617401 time 732341775791 state 0x0 ref 1 00000100:00100000:2.0:1789760794.081495:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565584896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.081542:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75317248, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23eb8 00010000:00010000:2.0:1789760794.081552:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.081569:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.081574:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.081579:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.081592:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.092043:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985696 is committed 00002000:00010000:2.0:1789760794.101037:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75317248 -> 75321344 00002000:00010000:2.0:1789760794.101049:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147128 -> 147136 00010000:00010000:2.0:1789760794.101066:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101079:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101087:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101095:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.101100:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101110:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101131:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.101139:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75317248->75321343] (req 75317248->75321343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.101510:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565584896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 20011us (20354us total) trans 4294985696 rc 0/0 00000100:00100000:2.0:1789760794.101523:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18399 00000100:00100000:2.0:1789760794.101533:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732316617401 time 732341775791 state 0x2 ref 0 00000100:00100000:3.0:1789760794.106807:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.106927:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585024 00000100:00100000:2.0:1789760794.106937:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585024 00000100:00100000:2.0:1789760794.107001:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732316617401 time 732341775791 state 0x0 ref 1 00000100:00100000:2.0:1789760794.107017:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732342036207 time 732341775791 state 0x1 ref 1 00000100:00100000:2.0:1789760794.107038:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732342036207 time 732367330708 state 0x0 ref 1 00000100:00100000:2.0:1789760794.107049:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.107099:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75321344, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ec0 00010000:00010000:2.0:1789760794.107109:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.107125:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.107130:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.107137:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.107153:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.113875:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985697 is committed 00002000:00010000:2.0:1789760794.113998:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75321344 -> 75325440 00002000:00010000:2.0:1789760794.114003:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147136 -> 147144 00010000:00010000:2.0:1789760794.114016:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114034:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114044:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114052:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.114057:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114066:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114086:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.114094:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75321344->75325439] (req 75321344->75325439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.114178:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7125us (7379us total) trans 4294985697 rc 0/0 00000100:00100000:2.0:1789760794.114189:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18400 00000100:00100000:2.0:1789760794.114199:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732342036207 time 732367330708 state 0x2 ref 0 00000100:00100000:0.0:1789760794.119227:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.119318:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585152 00000100:00100000:1.0:1789760794.119327:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585152 00000100:00100000:1.0:1789760794.119378:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732342036207 time 732367330708 state 0x0 ref 1 00000100:00100000:1.0:1789760794.119392:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732367591124 time 732367330708 state 0x1 ref 1 00000100:00100000:1.0:1789760794.119426:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732367591124 time 732379717422 state 0x0 ref 1 00000100:00100000:1.0:1789760794.119438:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.119486:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75325440, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ec8 00010000:00010000:1.0:1789760794.119496:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.119511:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.119515:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.119522:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.119536:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.125279:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985698 is committed 00002000:00010000:0.0:1789760794.127273:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75325440 -> 75329536 00002000:00010000:0.0:1789760794.127282:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147144 -> 147152 00010000:00010000:0.0:1789760794.127296:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127309:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127317:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127324:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.127329:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127341:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127360:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.127368:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674f5ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75325440->75329535] (req 75325440->75329535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.127469:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8028us (8260us total) trans 4294985698 rc 0/0 00000100:00100000:0.0:1789760794.127479:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18401 00000100:00100000:0.0:1789760794.127489:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732367591124 time 732379717422 state 0x2 ref 0 00000100:00100000:1.0:1789760794.137091:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.137192:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585280 00000100:00100000:2.0:1789760794.137202:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585280 00000100:00100000:2.0:1789760794.137260:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732367591124 time 732379717422 state 0x0 ref 1 00000100:00100000:2.0:1789760794.137276:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732379977838 time 732379717422 state 0x1 ref 1 00000100:00100000:2.0:1789760794.137307:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732379977838 time 732397599299 state 0x0 ref 1 00000100:00100000:2.0:1789760794.137320:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.137366:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75329536, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ed0 00010000:00010000:2.0:1789760794.137374:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.137390:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.137393:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.137399:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.137412:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.144140:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985699 is committed 00002000:00010000:3.0:1789760794.144473:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75329536 -> 75333632 00002000:00010000:3.0:1789760794.144478:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147152 -> 147160 00010000:00010000:3.0:1789760794.144492:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144505:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144515:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144522:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760794.144527:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144538:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144871:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.144881:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f5f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75329536->75333631] (req 75329536->75333631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.145066:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7743us (7980us total) trans 4294985699 rc 0/0 00000100:00100000:3.0:1789760794.145078:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18402 00000100:00100000:3.0:1789760794.145087:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732379977838 time 732397599299 state 0x2 ref 0 00000100:00100000:3.0:1789760794.148892:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.150800:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585408 00000100:00100000:2.0:1789760794.150814:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585408 00000100:00100000:2.0:1789760794.150875:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732379977838 time 732397599299 state 0x0 ref 1 00000100:00100000:2.0:1789760794.150890:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732397859715 time 732397599299 state 0x1 ref 1 00000100:00100000:2.0:1789760794.150926:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732397859715 time 732411218017 state 0x0 ref 1 00000100:00100000:2.0:1789760794.150939:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565585408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.150991:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75333632, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ed8 00010000:00010000:2.0:1789760794.151001:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.151016:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.151020:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.151026:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.151038:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.157428:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985700 is committed 00002000:00010000:2.0:1789760794.157622:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75333632 -> 75337728 00002000:00010000:2.0:1789760794.157628:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147160 -> 147168 00010000:00010000:2.0:1789760794.157642:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157654:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157663:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157804:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.157809:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157820:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157840:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.157847:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f5f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75333632->75337727] (req 75333632->75337727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.158045:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565585408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7102us (9160us total) trans 4294985700 rc 0/0 00000100:00100000:2.0:1789760794.158055:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18403 00000100:00100000:2.0:1789760794.158178:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732397859715 time 732411218017 state 0x2 ref 0 00000100:00100000:0.0:1789760794.165682:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.165910:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585536 00000100:00100000:1.0:1789760794.165919:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585536 00000100:00100000:1.0:1789760794.165971:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732397859715 time 732411218017 state 0x0 ref 1 00000100:00100000:1.0:1789760794.165985:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732411478433 time 732411218017 state 0x1 ref 1 00000100:00100000:1.0:1789760794.166072:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732411478433 time 732426355270 state 0x0 ref 1 00000100:00100000:1.0:1789760794.166085:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.166130:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75337728, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ee0 00010000:00010000:1.0:1789760794.166139:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.166155:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.166172:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.166178:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.166193:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.173033:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985701 is committed 00002000:00010000:1.0:1789760794.173194:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75337728 -> 75341824 00002000:00010000:1.0:1789760794.173200:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147168 -> 147176 00010000:00010000:1.0:1789760794.173214:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173227:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173235:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173242:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.173247:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173256:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173274:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.173282:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674f5ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75337728->75341823] (req 75337728->75341823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.173550:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565585536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7462us (7880us total) trans 4294985701 rc 0/0 00000100:00100000:1.0:1789760794.173560:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18404 00000100:00100000:1.0:1789760794.173569:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732411478433 time 732426355270 state 0x2 ref 0 00000100:00100000:0.0:1789760794.178263:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.178365:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585664 00000100:00100000:3.0:1789760794.178374:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585664 00000100:00100000:3.0:1789760794.178427:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732411478433 time 732426355270 state 0x0 ref 1 00000100:00100000:3.0:1789760794.178443:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732426615686 time 732426355270 state 0x1 ref 1 00000100:00100000:3.0:1789760794.178507:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732426615686 time 732438798834 state 0x0 ref 1 00000100:00100000:3.0:1789760794.178520:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.178577:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75341824, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ee8 00010000:00010000:3.0:1789760794.178587:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.178603:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.178616:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.178623:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.178636:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.189757:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985702 is committed 00002000:00010000:0.0:1789760794.190139:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75341824 -> 75345920 00002000:00010000:0.0:1789760794.190144:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147176 -> 147184 00010000:00010000:0.0:1789760794.190156:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190649:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190659:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190666:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.190671:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190680:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190699:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.190797:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674f606 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75341824->75345919] (req 75341824->75345919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.190938:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12416us (12680us total) trans 4294985702 rc 0/0 00000100:00100000:0.0:1789760794.190949:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18405 00000100:00100000:0.0:1789760794.190958:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732426615686 time 732438798834 state 0x2 ref 0 00000100:00100000:3.0:1789760794.197476:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.197671:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585792 00000100:00100000:2.0:1789760794.197685:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585792 00000100:00100000:2.0:1789760794.197937:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732426615686 time 732438798834 state 0x0 ref 1 00000100:00100000:2.0:1789760794.197960:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732439059250 time 732438798834 state 0x1 ref 1 00000100:00100000:2.0:1789760794.198291:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732439059250 time 732458580819 state 0x0 ref 1 00000100:00100000:2.0:1789760794.198308:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.198378:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75345920, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ef0 00010000:00010000:2.0:1789760794.198389:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.198409:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.198414:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.198422:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.198441:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.205808:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985703 is committed 00002000:00010000:2.0:1789760794.207535:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75345920 -> 75350016 00002000:00010000:2.0:1789760794.207658:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147184 -> 147192 00010000:00010000:2.0:1789760794.207683:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207700:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207830:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207840:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.207846:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207861:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207966:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.207977:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f60d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75345920->75350015] (req 75345920->75350015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.208239:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9927us (10771us total) trans 4294985703 rc 0/0 00000100:00100000:2.0:1789760794.208251:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18406 00000100:00100000:2.0:1789760794.208264:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732439059250 time 732458580819 state 0x2 ref 0 00000100:00100000:0.0:1789760794.212627:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.212762:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565585920 00000100:00100000:1.0:1789760794.212776:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565585920 00000100:00100000:1.0:1789760794.212850:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732439059250 time 732458580819 state 0x0 ref 1 00000100:00100000:1.0:1789760794.212869:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732458841235 time 732458580819 state 0x1 ref 1 00000100:00100000:1.0:1789760794.212912:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732458841235 time 732473203346 state 0x0 ref 1 00000100:00100000:1.0:1789760794.212927:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.212992:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75350016, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ef8 00010000:00010000:1.0:1789760794.213005:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.213025:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.213030:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.213038:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.213056:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.219833:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985704 is committed 00002000:00010000:1.0:1789760794.219996:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75350016 -> 75354112 00002000:00010000:1.0:1789760794.220003:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147192 -> 147200 00010000:00010000:1.0:1789760794.220020:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220038:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220048:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220055:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.220060:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220069:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220092:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.220100:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75350016->75354111] (req 75350016->75354111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.220291:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565585920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7355us (7677us total) trans 4294985704 rc 0/0 00000100:00100000:1.0:1789760794.220306:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18407 00000100:00100000:1.0:1789760794.220320:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732458841235 time 732473203346 state 0x2 ref 0 00000100:00100000:0.0:1789760794.227536:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.227658:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586048 00000100:00100000:3.0:1789760794.227668:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586048 00000100:00100000:3.0:1789760794.227759:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732458841235 time 732473203346 state 0x0 ref 1 00000100:00100000:3.0:1789760794.227774:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732473463762 time 732473203346 state 0x1 ref 1 00000100:00100000:3.0:1789760794.227796:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732473463762 time 732488088629 state 0x0 ref 1 00000100:00100000:3.0:1789760794.227809:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.227857:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75354112, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f00 00010000:00010000:3.0:1789760794.227868:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.227884:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.227889:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.227895:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.227910:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.235066:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985705 is committed 00002000:00010000:3.0:1789760794.235362:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75354112 -> 75358208 00002000:00010000:3.0:1789760794.235372:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147200 -> 147208 00010000:00010000:3.0:1789760794.235385:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235399:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235409:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235417:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760794.235422:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235432:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235454:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.235463:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f61b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75354112->75358207] (req 75354112->75358207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.235573:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7762us (8043us total) trans 4294985705 rc 0/0 00000100:00100000:3.0:1789760794.235585:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18408 00000100:00100000:3.0:1789760794.235594:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732473463762 time 732488088629 state 0x2 ref 0 00000100:00100000:2.0:1789760794.241136:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.241377:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586176 00000100:00100000:3.0:1789760794.241391:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586176 00000100:00100000:3.0:1789760794.241468:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732473463762 time 732488088629 state 0x0 ref 1 00000100:00100000:3.0:1789760794.241486:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732488349045 time 732488088629 state 0x1 ref 1 00000100:00100000:3.0:1789760794.241520:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732488349045 time 732501812282 state 0x0 ref 1 00000100:00100000:3.0:1789760794.241532:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565586176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.241592:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75358208, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f08 00010000:00010000:3.0:1789760794.241604:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.241633:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.241640:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.241647:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.241665:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.248785:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985706 is committed 00002000:00010000:3.0:1789760794.248951:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75358208 -> 75362304 00002000:00010000:3.0:1789760794.248961:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147208 -> 147216 00010000:00010000:3.0:1789760794.248980:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.248995:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.249011:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.249019:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760794.249025:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.249034:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.249060:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.249068:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75358208->75362303] (req 75358208->75362303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.249253:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565586176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7715us (8124us total) trans 4294985706 rc 0/0 00000100:00100000:3.0:1789760794.249265:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18409 00000100:00100000:3.0:1789760794.249277:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732488349045 time 732501812282 state 0x2 ref 0 00000100:00100000:0.0:1789760794.253858:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.253970:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586304 00000100:00100000:1.0:1789760794.253985:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586304 00000100:00100000:1.0:1789760794.254062:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732488349045 time 732501812282 state 0x0 ref 1 00000100:00100000:1.0:1789760794.254085:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732502072698 time 732501812282 state 0x1 ref 1 00000100:00100000:1.0:1789760794.254153:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732502072698 time 732514443990 state 0x0 ref 1 00000100:00100000:1.0:1789760794.254167:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.254229:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75362304, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f10 00010000:00010000:1.0:1789760794.254240:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.254260:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.254266:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.254274:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.254292:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.265377:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985707 is committed 00002000:00010000:1.0:1789760794.266205:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75362304 -> 75366400 00002000:00010000:1.0:1789760794.266214:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147216 -> 147224 00010000:00010000:1.0:1789760794.266233:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266248:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266262:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266270:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.266277:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266288:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266314:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.266321:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75362304->75366399] (req 75362304->75366399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.266456:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12284us (12608us total) trans 4294985707 rc 0/0 00000100:00100000:1.0:1789760794.266468:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18410 00000100:00100000:1.0:1789760794.266481:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732502072698 time 732514443990 state 0x2 ref 0 00000100:00100000:0.0:1789760794.269809:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.269915:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586432 00000100:00100000:3.0:1789760794.269929:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586432 00000100:00100000:3.0:1789760794.270015:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732502072698 time 732514443990 state 0x0 ref 1 00000100:00100000:3.0:1789760794.270038:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732514704406 time 732514443990 state 0x1 ref 1 00000100:00100000:3.0:1789760794.270075:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732514704406 time 732530366724 state 0x0 ref 1 00000100:00100000:3.0:1789760794.270098:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.270162:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75366400, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f18 00010000:00010000:3.0:1789760794.270173:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.270193:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.270198:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.270206:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.270222:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.280002:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985708 is committed 00002000:00010000:3.0:1789760794.280166:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75366400 -> 75370496 00002000:00010000:3.0:1789760794.280172:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147224 -> 147232 00010000:00010000:3.0:1789760794.280190:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280204:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280214:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280224:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760794.280230:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280240:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280267:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.280276:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f630 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75366400->75370495] (req 75366400->75370495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.280411:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10316us (10608us total) trans 4294985708 rc 0/0 00000100:00100000:3.0:1789760794.280424:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18411 00000100:00100000:3.0:1789760794.280436:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732514704406 time 732530366724 state 0x2 ref 0 00000100:00100000:2.0:1789760794.284055:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.284152:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586560 00000100:00100000:3.0:1789760794.284166:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586560 00000100:00100000:3.0:1789760794.284245:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732514704406 time 732530366724 state 0x0 ref 1 00000100:00100000:3.0:1789760794.284290:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732530627140 time 732530366724 state 0x1 ref 1 00000100:00100000:3.0:1789760794.284326:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732530627140 time 732544617303 state 0x0 ref 1 00000100:00100000:3.0:1789760794.284343:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.284412:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75370496, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f20 00010000:00010000:3.0:1789760794.284425:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.284444:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.284449:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.284457:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.284475:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.301161:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985709 is committed 00002000:00010000:2.0:1789760794.301309:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75370496 -> 75374592 00002000:00010000:2.0:1789760794.301315:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147232 -> 147240 00010000:00010000:2.0:1789760794.301332:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301348:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301359:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301367:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.301374:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301384:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301408:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.301418:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674f637 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75370496->75374591] (req 75370496->75374591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.301588:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17239us (17542us total) trans 4294985709 rc 0/0 00000100:00100000:2.0:1789760794.301601:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18412 00000100:00100000:2.0:1789760794.301625:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732530627140 time 732544617303 state 0x2 ref 0 00000100:00100000:0.0:1789760794.310329:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.313863:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586688 00000100:00100000:1.0:1789760794.313886:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586688 00000100:00100000:1.0:1789760794.314108:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732530627140 time 732544617303 state 0x0 ref 1 00000100:00100000:1.0:1789760794.314128:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732544877719 time 732544617303 state 0x1 ref 1 00000100:00100000:1.0:1789760794.314170:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732544877719 time 732574461108 state 0x0 ref 1 00000100:00100000:1.0:1789760794.314188:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.314252:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75374592, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f28 00010000:00010000:1.0:1789760794.314264:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.314283:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.314288:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.314295:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.314311:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.327013:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985710 is committed 00002000:00010000:0.0:1789760794.331754:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75374592 -> 75378688 00002000:00010000:0.0:1789760794.331767:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147240 -> 147248 00010000:00010000:0.0:1789760794.331789:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331805:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331815:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331823:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.331829:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331839:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331863:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.331870:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674f63e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75374592->75378687] (req 75374592->75378687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.332019:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17831us (21699us total) trans 4294985710 rc 0/0 00000100:00100000:0.0:1789760794.332032:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18413 00000100:00100000:0.0:1789760794.332049:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732544877719 time 732574461108 state 0x2 ref 0 00000100:00100000:0.0:1789760794.339812:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.340536:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586816 00000100:00100000:3.0:1789760794.340551:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586816 00000100:00100000:3.0:1789760794.340639:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732544877719 time 732574461108 state 0x0 ref 1 00000100:00100000:3.0:1789760794.340667:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732574721524 time 732574461108 state 0x1 ref 1 00000100:00100000:3.0:1789760794.340698:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732574721524 time 732600990304 state 0x0 ref 1 00000100:00100000:3.0:1789760794.340748:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.340809:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75378688, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f30 00010000:00010000:3.0:1789760794.340821:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.340841:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.340846:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.340854:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.340870:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.351022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985711 is committed 00002000:00010000:0.0:1789760794.351159:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75378688 -> 75382784 00002000:00010000:0.0:1789760794.351166:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147248 -> 147256 00010000:00010000:0.0:1789760794.351183:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351197:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351207:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351216:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.351221:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351231:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351256:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.351265:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674f645 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75378688->75382783] (req 75378688->75382783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.351388:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565586816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10637us (11584us total) trans 4294985711 rc 0/0 00000100:00100000:0.0:1789760794.351401:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18414 00000100:00100000:0.0:1789760794.351412:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732574721524 time 732600990304 state 0x2 ref 0 00000100:00100000:2.0:1789760794.356268:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760794.356388:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565586944 00000100:00100000:3.0:1789760794.356410:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565586944 00000100:00100000:3.0:1789760794.356489:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732574721524 time 732600990304 state 0x0 ref 1 00000100:00100000:3.0:1789760794.356514:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732601250720 time 732600990304 state 0x1 ref 1 00000100:00100000:3.0:1789760794.356562:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732601250720 time 732616853428 state 0x0 ref 1 00000100:00100000:3.0:1789760794.356576:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760794.357095:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75382784, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f38 00010000:00010000:3.0:1789760794.357110:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.357130:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1789760794.357135:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.357143:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.357167:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.365158:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985712 is committed 00002000:00010000:3.0:1789760794.365446:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75382784 -> 75386880 00002000:00010000:3.0:1789760794.365452:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147256 -> 147264 00010000:00010000:3.0:1789760794.365469:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365484:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365494:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365501:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760794.365507:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365516:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365539:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.365547:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674f64c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75382784->75386879] (req 75382784->75386879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.366045:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565586944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9453us (9772us total) trans 4294985712 rc 0/0 00000100:00100000:3.0:1789760794.366061:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18415 00000100:00100000:3.0:1789760794.366076:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732601250720 time 732616853428 state 0x2 ref 0 00000100:00100000:2.0:1789760794.369555:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.369837:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587072 00000100:00100000:0.0:1789760794.369850:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587072 00000100:00100000:0.0:1789760794.369928:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732601250720 time 732616853428 state 0x0 ref 1 00000100:00100000:0.0:1789760794.369946:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732617113844 time 732616853428 state 0x1 ref 1 00000100:00100000:0.0:1789760794.370221:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732617113844 time 732630327628 state 0x0 ref 1 00000100:00100000:0.0:1789760794.370242:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.370309:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75386880, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f40 00010000:00010000:0.0:1789760794.370321:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.370342:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.370347:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.370354:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.370370:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.378076:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985713 is committed 00002000:00010000:0.0:1789760794.378287:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75386880 -> 75390976 00002000:00010000:0.0:1789760794.378292:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147264 -> 147272 00010000:00010000:0.0:1789760794.378311:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378325:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378335:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378342:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.378348:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378357:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378382:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.378390:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eef722d/0x721975f94674f653 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75386880->75390975] (req 75386880->75390975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.378605:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8361us (9055us total) trans 4294985713 rc 0/0 00000100:00100000:0.0:1789760794.378627:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18416 00000100:00100000:0.0:1789760794.378639:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732617113844 time 732630327628 state 0x2 ref 0 00000100:00100000:1.0:1789760794.384429:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.388753:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587200 00000100:00100000:0.0:1789760794.388774:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587200 00000100:00100000:1.0:1789760794.389357:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732617113844 time 732630327628 state 0x0 ref 1 00000100:00100000:1.0:1789760794.389379:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732630588044 time 732630327628 state 0x1 ref 1 00000100:00100000:1.0:1789760794.389427:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732630588044 time 732649718253 state 0x0 ref 1 00000100:00100000:1.0:1789760794.389444:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565587200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.389509:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75390976, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f48 00010000:00010000:1.0:1789760794.389521:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.389541:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.389546:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.389553:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.389569:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.398659:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985714 is committed 00002000:00010000:2.0:1789760794.398820:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75390976 -> 75395072 00002000:00010000:2.0:1789760794.398825:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147272 -> 147280 00010000:00010000:2.0:1789760794.398845:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398861:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398872:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398880:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaba00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.398885:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398897:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398923:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.398931:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002471e5ae/0x721975f94674f65a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75390976->75395071] (req 75390976->75395071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.399429:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565587200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9978us (15003us total) trans 4294985714 rc 0/0 00000100:00100000:2.0:1789760794.399449:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18417 00000100:00100000:2.0:1789760794.399464:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732630588044 time 732649718253 state 0x2 ref 0 00000100:00100000:2.0:1789760794.408256:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.408362:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587328 00000100:00100000:0.0:1789760794.408373:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587328 00000100:00100000:0.0:1789760794.408483:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732630588044 time 732649718253 state 0x0 ref 1 00000100:00100000:0.0:1789760794.408501:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732649978669 time 732649718253 state 0x1 ref 1 00000100:00100000:0.0:1789760794.408533:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732649978669 time 732668824390 state 0x0 ref 1 00000100:00100000:0.0:1789760794.408633:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.408698:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75395072, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f50 00010000:00010000:0.0:1789760794.408781:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.408800:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.408805:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.408813:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.408830:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.415468:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985715 is committed 00002000:00010000:0.0:1789760794.415770:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75395072 -> 75399168 00002000:00010000:0.0:1789760794.415778:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147280 -> 147288 00010000:00010000:0.0:1789760794.415799:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415814:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415824:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415831:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.415836:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415845:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415868:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.415876:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f661 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75395072->75399167] (req 75395072->75399167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.416153:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7601us (7904us total) trans 4294985715 rc 0/0 00000100:00100000:1.0:1789760794.416166:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18418 00000100:00100000:1.0:1789760794.416178:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732649978669 time 732668824390 state 0x2 ref 0 00000100:00100000:1.0:1789760794.418691:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.418759:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587456 00000100:00100000:0.0:1789760794.418771:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587456 00000100:00100000:0.0:1789760794.418843:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732649978669 time 732668824390 state 0x0 ref 1 00000100:00100000:0.0:1789760794.418861:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732669084806 time 732668824390 state 0x1 ref 1 00000100:00100000:1.0:1789760794.418921:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732669084806 time 732679210406 state 0x0 ref 1 00000100:00100000:1.0:1789760794.418936:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.419009:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75399168, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f58 00010000:00010000:1.0:1789760794.419019:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.419041:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.419048:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.419057:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.419073:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.424511:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985716 is committed 00002000:00010000:1.0:1789760794.424823:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75399168 -> 75403264 00002000:00010000:1.0:1789760794.424829:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147288 -> 147296 00010000:00010000:1.0:1789760794.424847:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424860:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424870:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424878:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.424883:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424894:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424919:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.424932:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f668 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75399168->75403263] (req 75399168->75403263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.425051:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6111us (6367us total) trans 4294985716 rc 0/0 00000100:00100000:1.0:1789760794.425064:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18419 00000100:00100000:1.0:1789760794.425076:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732669084806 time 732679210406 state 0x2 ref 0 00000100:00100000:1.0:1789760794.431374:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.431487:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587584 00000100:00100000:2.0:1789760794.431502:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587584 00000100:00100000:2.0:1789760794.431577:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732669084806 time 732679210406 state 0x0 ref 1 00000100:00100000:2.0:1789760794.431677:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732679470822 time 732679210406 state 0x1 ref 1 00000100:00100000:2.0:1789760794.431746:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732679470822 time 732692035476 state 0x0 ref 1 00000100:00100000:2.0:1789760794.431761:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.431976:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75403264, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f60 00010000:00010000:2.0:1789760794.431987:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.432007:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.432012:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.432021:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.432039:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.439447:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985717 is committed 00002000:00010000:2.0:1789760794.439779:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75403264 -> 75407360 00002000:00010000:2.0:1789760794.439785:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147296 -> 147304 00010000:00010000:2.0:1789760794.439898:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439914:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439925:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439934:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.439940:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439961:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439987:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439996:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f66f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75403264->75407359] (req 75403264->75407359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.440113:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8349us (8749us total) trans 4294985717 rc 0/0 00000100:00100000:2.0:1789760794.440126:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18420 00000100:00100000:2.0:1789760794.440138:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732679470822 time 732692035476 state 0x2 ref 0 00000100:00100000:2.0:1789760794.448575:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.449256:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587712 00000100:00100000:1.0:1789760794.449271:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587712 00000100:00100000:1.0:1789760794.449356:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732679470822 time 732692035476 state 0x0 ref 1 00000100:00100000:1.0:1789760794.449385:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732692295892 time 732692035476 state 0x1 ref 1 00000100:00100000:1.0:1789760794.449422:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732692295892 time 732709714723 state 0x0 ref 1 00000100:00100000:1.0:1789760794.449436:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565587712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.449498:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75407360, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f68 00010000:00010000:1.0:1789760794.449509:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.449527:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.449531:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.449540:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.449554:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.455800:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985718 is committed 00002000:00010000:1.0:1789760794.466152:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75407360 -> 75411456 00002000:00010000:1.0:1789760794.466169:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147304 -> 147312 00010000:00010000:1.0:1789760794.466188:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466203:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466212:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466221:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.466227:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466238:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466264:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.466279:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f676 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75407360->75411455] (req 75407360->75411455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.466422:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565587712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16981us (17853us total) trans 4294985718 rc 0/0 00000100:00100000:1.0:1789760794.466435:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18421 00000100:00100000:1.0:1789760794.466449:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732692295892 time 732709714723 state 0x2 ref 0 00000100:00100000:3.0:1789760794.474147:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.474260:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587840 00000100:00100000:1.0:1789760794.474273:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587840 00000100:00100000:1.0:1789760794.474346:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732692295892 time 732709714723 state 0x0 ref 1 00000100:00100000:1.0:1789760794.474364:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732709975139 time 732709714723 state 0x1 ref 1 00000100:00100000:1.0:1789760794.474437:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732709975139 time 732734729075 state 0x0 ref 1 00000100:00100000:1.0:1789760794.474451:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.474514:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75411456, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f70 00010000:00010000:1.0:1789760794.474524:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.474544:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.474549:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.474557:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.474580:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.483338:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985719 is committed 00002000:00010000:1.0:1789760794.484815:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75411456 -> 75415552 00002000:00010000:1.0:1789760794.484827:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147312 -> 147320 00010000:00010000:1.0:1789760794.484846:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484874:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484889:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484898:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.484905:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484928:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484964:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.484973:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f67d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75411456->75415551] (req 75411456->75415551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.485119:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565587840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10663us (10981us total) trans 4294985719 rc 0/0 00000100:00100000:1.0:1789760794.485133:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18422 00000100:00100000:1.0:1789760794.485145:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732709975139 time 732734729075 state 0x2 ref 0 00000100:00100000:2.0:1789760794.490516:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.491156:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565587968 00000100:00100000:1.0:1789760794.491172:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565587968 00000100:00100000:1.0:1789760794.491256:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732709975139 time 732734729075 state 0x0 ref 1 00000100:00100000:1.0:1789760794.491276:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732734989491 time 732734729075 state 0x1 ref 1 00000100:00100000:1.0:1789760794.491355:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732734989491 time 732751644959 state 0x0 ref 1 00000100:00100000:1.0:1789760794.491371:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565587968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.491439:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75415552, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f78 00010000:00010000:1.0:1789760794.491451:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.491474:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.491480:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.491488:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.491506:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.501061:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985720 is committed 00002000:00010000:0.0:1789760794.501243:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75415552 -> 75419648 00002000:00010000:0.0:1789760794.501249:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147320 -> 147328 00010000:00010000:0.0:1789760794.501268:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501283:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501293:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501301:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.501307:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501317:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501340:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.501348:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f684 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75415552->75419647] (req 75415552->75419647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.501526:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565587968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10150us (11015us total) trans 4294985720 rc 0/0 00000100:00100000:0.0:1789760794.501539:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18423 00000100:00100000:0.0:1789760794.501561:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732734989491 time 732751644959 state 0x2 ref 0 00000100:00100000:2.0:1789760794.507147:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.507303:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588096 00000100:00100000:1.0:1789760794.507317:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588096 00000100:00100000:1.0:1789760794.507391:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732734989491 time 732751644959 state 0x0 ref 1 00000100:00100000:1.0:1789760794.507410:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732751905375 time 732751644959 state 0x1 ref 1 00000100:00100000:1.0:1789760794.507484:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732751905375 time 732767774586 state 0x0 ref 1 00000100:00100000:1.0:1789760794.507499:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.507575:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75419648, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f80 00010000:00010000:1.0:1789760794.507587:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.507813:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.507820:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.507856:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.507875:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.515428:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985721 is committed 00002000:00010000:2.0:1789760794.516179:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75419648 -> 75423744 00002000:00010000:2.0:1789760794.516188:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147328 -> 147336 00010000:00010000:2.0:1789760794.516205:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516220:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516230:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516238:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.516244:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516255:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516279:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.516289:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951ee5f/0x721975f94674f68b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75419648->75423743] (req 75419648->75423743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.516416:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8912us (9275us total) trans 4294985721 rc 0/0 00000100:00100000:2.0:1789760794.516429:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18424 00000100:00100000:2.0:1789760794.516441:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732751905375 time 732767774586 state 0x2 ref 0 00000100:00100000:0.0:1789760794.523821:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.524600:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588224 00000100:00100000:1.0:1789760794.524625:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588224 00000100:00100000:1.0:1789760794.525027:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732751905375 time 732767774586 state 0x0 ref 1 00000100:00100000:1.0:1789760794.525050:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732768035002 time 732767774586 state 0x1 ref 1 00000100:00100000:0.0:1789760794.525267:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732768035002 time 732785555415 state 0x0 ref 1 00000100:00100000:0.0:1789760794.525288:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565588224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.525353:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75423744, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f88 00010000:00010000:0.0:1789760794.525365:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.525384:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.525390:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.525398:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.525414:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.530514:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985722 is committed 00002000:00010000:0.0:1789760794.530796:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75423744 -> 75427840 00002000:00010000:0.0:1789760794.530803:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147336 -> 147344 00010000:00010000:0.0:1789760794.530820:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.530882:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.530894:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.530907:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.530913:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.530922:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.530947:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.531013:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75423744->75427839] (req 75423744->75427839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.531180:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565588224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5892us (7374us total) trans 4294985722 rc 0/0 00000100:00100000:0.0:1789760794.531193:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18425 00000100:00100000:0.0:1789760794.531206:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732768035002 time 732785555415 state 0x2 ref 0 00000100:00100000:1.0:1789760794.534921:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.534977:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588352 00000100:00100000:0.0:1789760794.534991:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588352 00000100:00100000:0.0:1789760794.535067:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732768035002 time 732785555415 state 0x0 ref 1 00000100:00100000:0.0:1789760794.535085:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732785815831 time 732785555415 state 0x1 ref 1 00000100:00100000:0.0:1789760794.535121:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732785815831 time 732795412254 state 0x0 ref 1 00000100:00100000:0.0:1789760794.535138:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565588352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.535204:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75427840, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f90 00010000:00010000:0.0:1789760794.535215:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.535235:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.535240:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.535247:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.535265:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.540210:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985723 is committed 00002000:00010000:0.0:1789760794.540347:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75427840 -> 75431936 00002000:00010000:0.0:1789760794.540354:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147344 -> 147352 00010000:00010000:0.0:1789760794.540372:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540388:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540399:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540407:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.540414:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540424:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540450:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.540458:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f699 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75427840->75431935] (req 75427840->75431935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.540589:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565588352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5446us (5673us total) trans 4294985723 rc 0/0 00000100:00100000:0.0:1789760794.540602:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18426 00000100:00100000:0.0:1789760794.540628:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732785815831 time 732795412254 state 0x2 ref 0 00000100:00100000:2.0:1789760794.543968:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.544301:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588480 00000100:00100000:1.0:1789760794.544313:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588480 00000100:00100000:1.0:1789760794.544387:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732785815831 time 732795412254 state 0x0 ref 1 00000100:00100000:1.0:1789760794.544406:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732795672670 time 732795412254 state 0x1 ref 1 00000100:00100000:1.0:1789760794.544441:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732795672670 time 732804733551 state 0x0 ref 1 00000100:00100000:1.0:1789760794.544454:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565588480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.544512:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75431936, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23f98 00010000:00010000:1.0:1789760794.544524:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.544553:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1789760794.544558:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.544567:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.544583:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.555478:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985724 is committed 00002000:00010000:0.0:1789760794.556115:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75431936 -> 75436032 00002000:00010000:0.0:1789760794.556123:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147352 -> 147360 00010000:00010000:0.0:1789760794.556140:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556156:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556166:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556181:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.556186:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556196:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556220:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.556228:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f6a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75431936->75436031] (req 75431936->75436031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.556405:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565588480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11944us (12453us total) trans 4294985724 rc 0/0 00000100:00100000:0.0:1789760794.556417:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18427 00000100:00100000:0.0:1789760794.556429:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732795672670 time 732804733551 state 0x2 ref 0 00000100:00100000:2.0:1789760794.565058:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.565234:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588608 00000100:00100000:0.0:1789760794.565247:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588608 00000100:00100000:0.0:1789760794.565324:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732795672670 time 732804733551 state 0x0 ref 1 00000100:00100000:0.0:1789760794.565410:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732804993967 time 732804733551 state 0x1 ref 1 00000100:00100000:0.0:1789760794.565481:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732804993967 time 732825772260 state 0x0 ref 1 00000100:00100000:0.0:1789760794.565500:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.565574:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75436032, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fa0 00010000:00010000:0.0:1789760794.565585:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.565604:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.565619:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.565627:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.565649:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.572261:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985725 is committed 00002000:00010000:0.0:1789760794.572501:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75436032 -> 75440128 00002000:00010000:0.0:1789760794.572507:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147360 -> 147368 00010000:00010000:0.0:1789760794.572525:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.572540:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.573039:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.573049:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.573055:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.573065:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.573090:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.573099:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75436032->75440127] (req 75436032->75440127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.573351:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7846us (8298us total) trans 4294985725 rc 0/0 00000100:00100000:0.0:1789760794.573363:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18428 00000100:00100000:0.0:1789760794.574048:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732804993967 time 732825772260 state 0x2 ref 0 00000100:00100000:0.0:1789760794.581050:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.581234:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588736 00000100:00100000:2.0:1789760794.581246:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588736 00000100:00100000:2.0:1789760794.581316:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732804993967 time 732825772260 state 0x0 ref 1 00000100:00100000:2.0:1789760794.581334:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732826032676 time 732825772260 state 0x1 ref 1 00000100:00100000:2.0:1789760794.581587:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732826032676 time 732841878054 state 0x0 ref 1 00000100:00100000:2.0:1789760794.581603:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.581677:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75440128, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fa8 00010000:00010000:2.0:1789760794.581688:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.581752:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1789760794.581758:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.581766:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.581783:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.591128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985726 is committed 00002000:00010000:2.0:1789760794.591374:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75440128 -> 75444224 00002000:00010000:2.0:1789760794.591380:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147368 -> 147376 00010000:00010000:2.0:1789760794.591398:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591412:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591423:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591431:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.591437:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591447:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591478:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.591487:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f6ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75440128->75444223] (req 75440128->75444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.591815:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10208us (10771us total) trans 4294985726 rc 0/0 00000100:00100000:2.0:1789760794.591828:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18429 00000100:00100000:2.0:1789760794.591840:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732826032676 time 732841878054 state 0x2 ref 0 00000100:00100000:1.0:1789760794.596658:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.596910:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588864 00000100:00100000:0.0:1789760794.596991:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588864 00000100:00100000:0.0:1789760794.597066:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732826032676 time 732841878054 state 0x0 ref 1 00000100:00100000:0.0:1789760794.597082:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732842138470 time 732841878054 state 0x1 ref 1 00000100:00100000:0.0:1789760794.597112:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732842138470 time 732857403792 state 0x0 ref 1 00000100:00100000:0.0:1789760794.597126:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565588864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.597195:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75444224, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fb0 00010000:00010000:0.0:1789760794.597206:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.597227:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.597232:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.597239:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.597256:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.605413:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985727 is committed 00002000:00010000:0.0:1789760794.606090:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75444224 -> 75448320 00002000:00010000:0.0:1789760794.606098:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147376 -> 147384 00010000:00010000:0.0:1789760794.606116:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606131:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606141:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606150:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.606157:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606253:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606280:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.606288:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75444224->75448319] (req 75444224->75448319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.606463:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565588864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9333us (9816us total) trans 4294985727 rc 0/0 00000100:00100000:0.0:1789760794.606476:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18430 00000100:00100000:0.0:1789760794.606488:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732842138470 time 732857403792 state 0x2 ref 0 00000100:00100000:1.0:1789760794.619886:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.620230:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565588992 00000100:00100000:0.0:1789760794.620246:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565588992 00000100:00100000:0.0:1789760794.620326:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732842138470 time 732857403792 state 0x0 ref 1 00000100:00100000:0.0:1789760794.620346:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732857664208 time 732857403792 state 0x1 ref 1 00000100:00100000:0.0:1789760794.620387:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732857664208 time 732880677959 state 0x0 ref 1 00000100:00100000:0.0:1789760794.620404:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.620482:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75448320, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fb8 00010000:00010000:0.0:1789760794.620495:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.620519:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.620525:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.620534:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.621293:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.635321:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985728 is committed 00002000:00010000:0.0:1789760794.635490:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75448320 -> 75452416 00002000:00010000:0.0:1789760794.635497:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147384 -> 147392 00010000:00010000:0.0:1789760794.635518:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635533:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635919:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635931:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.635938:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635948:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635990:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.635998:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75448320->75452415] (req 75448320->75452415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.636131:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565588992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15723us (16250us total) trans 4294985728 rc 0/0 00000100:00100000:0.0:1789760794.636144:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18431 00000100:00100000:0.0:1789760794.636156:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732857664208 time 732880677959 state 0x2 ref 0 00000100:00100000:2.0:1789760794.639155:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.639852:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589120 00000100:00100000:0.0:1789760794.639869:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589120 00000100:00100000:0.0:1789760794.639962:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732857664208 time 732880677959 state 0x0 ref 1 00000100:00100000:0.0:1789760794.639983:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732880938375 time 732880677959 state 0x1 ref 1 00000100:00100000:0.0:1789760794.640016:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732880938375 time 732900308388 state 0x0 ref 1 00000100:00100000:0.0:1789760794.640030:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565589120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.640094:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75452416, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fc0 00010000:00010000:0.0:1789760794.640106:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.640124:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.640131:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.640138:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.640155:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.652022:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985729 is committed 00002000:00010000:0.0:1789760794.652393:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75452416 -> 75456512 00002000:00010000:0.0:1789760794.652399:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147392 -> 147400 00010000:00010000:0.0:1789760794.652419:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652435:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652444:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652453:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.652458:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652469:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652495:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.652509:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75452416->75456511] (req 75452416->75456511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.652942:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565589120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12905us (13791us total) trans 4294985729 rc 0/0 00000100:00100000:0.0:1789760794.652966:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18432 00000100:00100000:0.0:1789760794.652978:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732880938375 time 732900308388 state 0x2 ref 0 00000100:00100000:2.0:1789760794.664100:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.664219:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589248 00000100:00100000:0.0:1789760794.664232:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589248 00000100:00100000:0.0:1789760794.664307:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732880938375 time 732900308388 state 0x0 ref 1 00000100:00100000:0.0:1789760794.664326:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732900568804 time 732900308388 state 0x1 ref 1 00000100:00100000:0.0:1789760794.664365:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732900568804 time 732924656014 state 0x0 ref 1 00000100:00100000:0.0:1789760794.664379:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.664441:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75456512, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fc8 00010000:00010000:0.0:1789760794.664451:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.664471:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.664476:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.664483:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.664505:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.675266:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985730 is committed 00002000:00010000:0.0:1789760794.675474:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75456512 -> 75460608 00002000:00010000:0.0:1789760794.675481:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147400 -> 147408 00010000:00010000:0.0:1789760794.675501:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675519:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675529:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675537:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.675543:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675553:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675577:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.675586:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75456512->75460607] (req 75456512->75460607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.676475:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12084us (12375us total) trans 4294985730 rc 0/0 00000100:00100000:0.0:1789760794.676491:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18433 00000100:00100000:0.0:1789760794.676505:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732900568804 time 732924656014 state 0x2 ref 0 00000100:00100000:2.0:1789760794.684902:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.685033:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589376 00000100:00100000:0.0:1789760794.685046:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589376 00000100:00100000:0.0:1789760794.685125:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732900568804 time 732924656014 state 0x0 ref 1 00000100:00100000:0.0:1789760794.685144:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732924916430 time 732924656014 state 0x1 ref 1 00000100:00100000:0.0:1789760794.685178:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732924916430 time 732945469385 state 0x0 ref 1 00000100:00100000:0.0:1789760794.685192:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565589376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.685270:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75460608, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fd0 00010000:00010000:0.0:1789760794.685281:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.685305:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.685310:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.685317:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.685333:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.697168:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985731 is committed 00002000:00010000:1.0:1789760794.701337:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75460608 -> 75464704 00002000:00010000:1.0:1789760794.701352:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147408 -> 147416 00010000:00010000:1.0:1789760794.701370:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701386:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701396:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701404:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.701409:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701420:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701447:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.701455:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710f303b/0x721975f94674f6d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75460608->75464703] (req 75460608->75464703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.701666:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565589376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16470us (16775us total) trans 4294985731 rc 0/0 00000100:00100000:1.0:1789760794.701684:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18434 00000100:00100000:1.0:1789760794.701696:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732924916430 time 732945469385 state 0x2 ref 0 00000100:00100000:3.0:1789760794.710525:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.711375:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589504 00000100:00100000:0.0:1789760794.711389:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589504 00000100:00100000:0.0:1789760794.711471:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732924916430 time 732945469385 state 0x0 ref 1 00000100:00100000:0.0:1789760794.711490:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732945729801 time 732945469385 state 0x1 ref 1 00000100:00100000:0.0:1789760794.711575:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732945729801 time 732971866190 state 0x0 ref 1 00000100:00100000:0.0:1789760794.711591:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.711855:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75464704, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fd8 00010000:00010000:0.0:1789760794.711868:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.711888:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.711894:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.711902:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.711919:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.719515:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985732 is committed 00002000:00010000:0.0:1789760794.719668:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75464704 -> 75468800 00002000:00010000:0.0:1789760794.719674:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147416 -> 147424 00010000:00010000:0.0:1789760794.719691:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719738:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719747:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719755:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.719761:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719771:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719796:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.719804:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75464704->75468799] (req 75464704->75468799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.719975:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8379us (9458us total) trans 4294985732 rc 0/0 00000100:00100000:0.0:1789760794.719987:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18435 00000100:00100000:0.0:1789760794.719998:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732945729801 time 732971866190 state 0x2 ref 0 00000100:00100000:2.0:1789760794.724874:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.725113:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589632 00000100:00100000:0.0:1789760794.725127:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589632 00000100:00100000:0.0:1789760794.725203:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732945729801 time 732971866190 state 0x0 ref 1 00000100:00100000:0.0:1789760794.725224:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732972126606 time 732971866190 state 0x1 ref 1 00000100:00100000:0.0:1789760794.725259:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732972126606 time 732985551206 state 0x0 ref 1 00000100:00100000:0.0:1789760794.725274:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.725338:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75468800, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fe0 00010000:00010000:0.0:1789760794.725348:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.725367:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1789760794.725372:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.725380:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.725396:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.731212:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985733 is committed 00002000:00010000:0.0:1789760794.731414:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75468800 -> 75472896 00002000:00010000:0.0:1789760794.731421:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147424 -> 147432 00010000:00010000:0.0:1789760794.731447:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731462:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731479:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731487:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.731493:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731505:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731532:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.731540:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75468800->75472895] (req 75468800->75472895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.731680:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6402us (6813us total) trans 4294985733 rc 0/0 00000100:00100000:0.0:1789760794.731701:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18436 00000100:00100000:0.0:1789760794.732067:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732972126606 time 732985551206 state 0x2 ref 0 00000100:00100000:2.0:1789760794.741779:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.743839:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589760 00000100:00100000:1.0:1789760794.743857:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589760 00000100:00100000:1.0:1789760794.743938:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732972126606 time 732985551206 state 0x0 ref 1 00000100:00100000:1.0:1789760794.743957:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732985811622 time 732985551206 state 0x1 ref 1 00000100:00100000:1.0:1789760794.744000:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732985811622 time 733004292607 state 0x0 ref 1 00000100:00100000:1.0:1789760794.744014:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.744074:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75472896, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23fe8 00010000:00010000:1.0:1789760794.744085:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.744103:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.744108:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.744114:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.744146:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.756457:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985734 is committed 00002000:00010000:1.0:1789760794.756600:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75472896 -> 75476992 00002000:00010000:1.0:1789760794.756616:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147432 -> 147440 00010000:00010000:1.0:1789760794.756635:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756650:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756660:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756668:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.756674:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756684:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756809:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.756819:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75472896->75476991] (req 75472896->75476991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.756991:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12971us (15218us total) trans 4294985734 rc 0/0 00000100:00100000:1.0:1789760794.757005:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18437 00000100:00100000:1.0:1789760794.757017:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732985811622 time 733004292607 state 0x2 ref 0 00000100:00100000:3.0:1789760794.763701:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.763916:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565589888 00000100:00100000:0.0:1789760794.763929:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565589888 00000100:00100000:0.0:1789760794.764062:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 732985811622 time 733004292607 state 0x0 ref 1 00000100:00100000:0.0:1789760794.764076:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733004553023 time 733004292607 state 0x1 ref 1 00000100:00100000:0.0:1789760794.764158:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733004553023 time 733024448620 state 0x0 ref 1 00000100:00100000:0.0:1789760794.764174:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.764245:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75476992, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ff0 00010000:00010000:0.0:1789760794.764257:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.764277:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.764283:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.764290:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.764309:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.773031:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985735 is committed 00002000:00010000:0.0:1789760794.773190:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75476992 -> 75481088 00002000:00010000:0.0:1789760794.773197:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147440 -> 147448 00010000:00010000:0.0:1789760794.773214:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773627:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773639:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773653:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.773659:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773670:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773695:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.773859:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f6ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75476992->75481087] (req 75476992->75481087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.774186:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565589888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10006us (10493us total) trans 4294985735 rc 0/0 00000100:00100000:0.0:1789760794.774200:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18438 00000100:00100000:0.0:1789760794.774212:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733004553023 time 733024448620 state 0x2 ref 0 00000100:00100000:2.0:1789760794.778479:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.778688:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590016 00000100:00100000:0.0:1789760794.778740:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590016 00000100:00100000:0.0:1789760794.778818:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733004553023 time 733024448620 state 0x0 ref 1 00000100:00100000:0.0:1789760794.778837:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733024709036 time 733024448620 state 0x1 ref 1 00000100:00100000:0.0:1789760794.778872:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733024709036 time 733039163090 state 0x0 ref 1 00000100:00100000:0.0:1789760794.778889:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.778970:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75481088, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x23ff8 00010000:00010000:0.0:1789760794.778983:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.779004:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.779009:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.779017:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.779035:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.787502:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985736 is committed 00002000:00010000:0.0:1789760794.788236:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75481088 -> 75485184 00002000:00010000:0.0:1789760794.788243:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147448 -> 147456 00010000:00010000:0.0:1789760794.788256:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788269:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788279:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788286:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.788292:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788301:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788321:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.788329:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f6f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75481088->75485183] (req 75481088->75485183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.788434:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9543us (9966us total) trans 4294985736 rc 0/0 00000100:00100000:0.0:1789760794.788445:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18439 00000100:00100000:0.0:1789760794.788454:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733024709036 time 733039163090 state 0x2 ref 0 00000100:00100000:2.0:1789760794.794294:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.794642:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590144 00000100:00100000:1.0:1789760794.794655:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590144 00000100:00100000:1.0:1789760794.794771:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733024709036 time 733039163090 state 0x0 ref 1 00000100:00100000:1.0:1789760794.794793:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733039423506 time 733039163090 state 0x1 ref 1 00000100:00100000:1.0:1789760794.794830:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733039423506 time 733055121073 state 0x0 ref 1 00000100:00100000:1.0:1789760794.794855:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.794931:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75485184, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24000 00010000:00010000:1.0:1789760794.794943:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.794972:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.794978:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.794985:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.795003:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.802076:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985737 is committed 00002000:00010000:1.0:1789760794.802246:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75485184 -> 75489280 00002000:00010000:1.0:1789760794.802252:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147456 -> 147464 00010000:00010000:1.0:1789760794.802272:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802297:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802308:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802317:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.802323:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802334:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802359:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.802368:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f6fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75485184->75489279] (req 75485184->75489279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.802510:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7650us (8220us total) trans 4294985737 rc 0/0 00000100:00100000:1.0:1789760794.802525:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18440 00000100:00100000:1.0:1789760794.802541:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733039423506 time 733055121073 state 0x2 ref 0 00000100:00100000:3.0:1789760794.811260:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.811476:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590272 00000100:00100000:0.0:1789760794.811492:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590272 00000100:00100000:0.0:1789760794.811582:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733039423506 time 733055121073 state 0x0 ref 1 00000100:00100000:0.0:1789760794.811601:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733055381489 time 733055121073 state 0x1 ref 1 00000100:00100000:0.0:1789760794.811808:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733055381489 time 733072098100 state 0x0 ref 1 00000100:00100000:0.0:1789760794.811840:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.811939:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75489280, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24008 00010000:00010000:0.0:1789760794.811950:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.811982:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.811988:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.811996:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.812029:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.819373:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985738 is committed 00002000:00010000:2.0:1789760794.819523:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75489280 -> 75493376 00002000:00010000:2.0:1789760794.819530:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147464 -> 147472 00010000:00010000:2.0:1789760794.819550:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819566:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819578:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819587:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.819593:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819618:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819840:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.819850:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75489280->75493375] (req 75489280->75493375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.820006:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8178us (8785us total) trans 4294985738 rc 0/0 00000100:00100000:2.0:1789760794.820019:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18441 00000100:00100000:2.0:1789760794.820031:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733055381489 time 733072098100 state 0x2 ref 0 00000100:00100000:2.0:1789760794.825685:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.825827:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590400 00000100:00100000:0.0:1789760794.825840:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590400 00000100:00100000:0.0:1789760794.826026:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733055381489 time 733072098100 state 0x0 ref 1 00000100:00100000:0.0:1789760794.826056:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733072358516 time 733072098100 state 0x1 ref 1 00000100:00100000:0.0:1789760794.826093:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733072358516 time 733086383918 state 0x0 ref 1 00000100:00100000:0.0:1789760794.826108:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.826330:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75493376, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24010 00010000:00010000:0.0:1789760794.826343:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.826369:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.826375:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.826382:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.826396:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.828290:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760794.832202:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985739 is committed 00002000:00010000:0.0:1789760794.832384:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75493376 -> 75497472 00002000:00010000:0.0:1789760794.832390:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147472 -> 147480 00010000:00010000:0.0:1789760794.832408:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832424:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832434:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832443:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.832448:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832459:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832490:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.832499:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f709 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75493376->75497471] (req 75493376->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.832916:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6804us (7274us total) trans 4294985739 rc 0/0 00000100:00100000:0.0:1789760794.832928:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18442 00000100:00100000:0.0:1789760794.832941:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733072358516 time 733086383918 state 0x2 ref 0 00000100:00100000:0.0:1789760794.837167:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.837294:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590528 00000100:00100000:1.0:1789760794.837307:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590528 00000100:00100000:1.0:1789760794.837378:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733072358516 time 733086383918 state 0x0 ref 1 00000100:00100000:1.0:1789760794.837396:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733086644334 time 733086383918 state 0x1 ref 1 00000100:00100000:1.0:1789760794.837482:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733086644334 time 733097772688 state 0x0 ref 1 00000100:00100000:1.0:1789760794.837497:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.837571:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75497472, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24018 00010000:00010000:1.0:1789760794.837583:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.837611:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.837617:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.837625:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.840171:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.847942:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985740 is committed 00002000:00010000:1.0:1789760794.849437:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75497472 -> 75501568 00002000:00010000:1.0:1789760794.849448:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147480 -> 147488 00010000:00010000:1.0:1789760794.849467:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849482:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849499:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849508:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.849514:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849525:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849562:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.849572:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f710 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->75501567] (req 75497472->75501567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.850158:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12654us (12995us total) trans 4294985740 rc 0/0 00000100:00100000:1.0:1789760794.850170:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18443 00000100:00100000:1.0:1789760794.850183:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733086644334 time 733097772688 state 0x2 ref 0 00000100:00100000:3.0:1789760794.855215:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.855923:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590656 00000100:00100000:0.0:1789760794.855939:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590656 00000100:00100000:0.0:1789760794.856019:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733086644334 time 733097772688 state 0x0 ref 1 00000100:00100000:0.0:1789760794.856039:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733098033104 time 733097772688 state 0x1 ref 1 00000100:00100000:0.0:1789760794.856079:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733098033104 time 733116371036 state 0x0 ref 1 00000100:00100000:0.0:1789760794.856095:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.856159:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75501568, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24020 00010000:00010000:0.0:1789760794.856170:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.856196:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.856214:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.856223:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.856239:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.862435:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985741 is committed 00002000:00010000:0.0:1789760794.864019:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75501568 -> 75505664 00002000:00010000:0.0:1789760794.864033:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147488 -> 147496 00010000:00010000:0.0:1789760794.864054:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864071:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864081:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864089:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.864095:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864105:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864139:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.864148:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f717 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75501568->75505663] (req 75501568->75505663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.864461:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565590656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8357us (9249us total) trans 4294985741 rc 0/0 00000100:00100000:0.0:1789760794.864475:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18444 00000100:00100000:0.0:1789760794.864488:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733098033104 time 733116371036 state 0x2 ref 0 00000100:00100000:3.0:1789760794.877111:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.877263:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590784 00000100:00100000:0.0:1789760794.877278:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590784 00000100:00100000:0.0:1789760794.877368:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733098033104 time 733116371036 state 0x0 ref 1 00000100:00100000:0.0:1789760794.877388:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733116631452 time 733116371036 state 0x1 ref 1 00000100:00100000:0.0:1789760794.877425:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733116631452 time 733137717022 state 0x0 ref 1 00000100:00100000:0.0:1789760794.877440:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.877511:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75505664, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24028 00010000:00010000:0.0:1789760794.877522:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.877594:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.877601:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.877618:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.877634:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.883401:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985742 is committed 00002000:00010000:0.0:1789760794.883584:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75505664 -> 75509760 00002000:00010000:0.0:1789760794.883590:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147496 -> 147504 00010000:00010000:0.0:1789760794.883619:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883636:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883645:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883653:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760794.883658:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883668:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883693:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883848:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f71e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75505664->75509759] (req 75505664->75509759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.884359:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6913us (7254us total) trans 4294985742 rc 0/0 00000100:00100000:0.0:1789760794.884372:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18445 00000100:00100000:0.0:1789760794.884384:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733116631452 time 733137717022 state 0x2 ref 0 00000100:00100000:0.0:1789760794.890308:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.890948:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565590912 00000100:00100000:1.0:1789760794.892690:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565590912 00000100:00100000:1.0:1789760794.893198:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733116631452 time 733137717022 state 0x0 ref 1 00000100:00100000:1.0:1789760794.893219:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733137977438 time 733137717022 state 0x1 ref 1 00000100:00100000:1.0:1789760794.893264:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733137977438 time 733153555881 state 0x0 ref 1 00000100:00100000:1.0:1789760794.893278:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.893683:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75509760, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24030 00010000:00010000:1.0:1789760794.893698:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.893752:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.893757:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.893766:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.893784:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.899785:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985743 is committed 00002000:00010000:1.0:1789760794.901131:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75509760 -> 75513856 00002000:00010000:1.0:1789760794.901142:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147504 -> 147512 00010000:00010000:1.0:1789760794.901162:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901178:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901189:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901204:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.901210:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901220:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901251:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.901260:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75509760->75513855] (req 75509760->75513855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.901396:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565590912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8112us (11092us total) trans 4294985743 rc 0/0 00000100:00100000:1.0:1789760794.901407:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18446 00000100:00100000:1.0:1789760794.901420:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733137977438 time 733153555881 state 0x2 ref 0 00000100:00100000:0.0:1789760794.910696:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.910885:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591040 00000100:00100000:2.0:1789760794.910898:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591040 00000100:00100000:2.0:1789760794.910975:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733137977438 time 733153555881 state 0x0 ref 1 00000100:00100000:2.0:1789760794.910994:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733153816297 time 733153555881 state 0x1 ref 1 00000100:00100000:2.0:1789760794.911025:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733153816297 time 733171317296 state 0x0 ref 1 00000100:00100000:2.0:1789760794.911038:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.911101:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75513856, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24038 00010000:00010000:2.0:1789760794.911113:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.911133:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760794.911138:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.911159:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.911176:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.919180:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985744 is committed 00002000:00010000:2.0:1789760794.919309:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75513856 -> 75517952 00002000:00010000:2.0:1789760794.919316:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147512 -> 147520 00010000:00010000:2.0:1789760794.919333:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919348:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919358:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919366:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.919372:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919381:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919405:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.919413:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f72c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75513856->75517951] (req 75513856->75517951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.919589:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8545us (8900us total) trans 4294985744 rc 0/0 00000100:00100000:2.0:1789760794.919611:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18447 00000100:00100000:2.0:1789760794.919624:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733153816297 time 733171317296 state 0x2 ref 0 00000100:00100000:3.0:1789760794.924675:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760794.924943:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591168 00000100:00100000:0.0:1789760794.925085:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591168 00000100:00100000:0.0:1789760794.925165:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733153816297 time 733171317296 state 0x0 ref 1 00000100:00100000:0.0:1789760794.925186:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733171577712 time 733171317296 state 0x1 ref 1 00000100:00100000:0.0:1789760794.925255:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733171577712 time 733185546165 state 0x0 ref 1 00000100:00100000:0.0:1789760794.925270:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760794.925332:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75517952, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24040 00010000:00010000:0.0:1789760794.925343:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.925365:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760794.925370:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.925380:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.925398:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.931831:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985745 is committed 00002000:00010000:2.0:1789760794.932154:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75517952 -> 75522048 00002000:00010000:2.0:1789760794.932162:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147520 -> 147528 00010000:00010000:2.0:1789760794.932184:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932201:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932212:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932220:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.932226:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932235:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932263:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.932638:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f733 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75517952->75522047] (req 75517952->75522047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.932828:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7553us (8159us total) trans 4294985745 rc 0/0 00000100:00100000:2.0:1789760794.932841:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18448 00000100:00100000:2.0:1789760794.932854:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733171577712 time 733185546165 state 0x2 ref 0 00000100:00100000:0.0:1789760794.936508:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.938175:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591296 00000100:00100000:1.0:1789760794.938194:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591296 00000100:00100000:1.0:1789760794.938274:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733171577712 time 733185546165 state 0x0 ref 1 00000100:00100000:1.0:1789760794.938293:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733185806581 time 733185546165 state 0x1 ref 1 00000100:00100000:1.0:1789760794.938331:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733185806581 time 733198622864 state 0x0 ref 1 00000100:00100000:1.0:1789760794.938349:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.938409:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75522048, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x24048 00010000:00010000:1.0:1789760794.938418:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.938437:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.938442:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.938449:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.938465:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.944444:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985746 is committed 00002000:00010000:1.0:1789760794.944680:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75522048 -> 75526144 00002000:00010000:1.0:1789760794.944687:0:6959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760794 -> 1789760795 00002000:00010000:1.0:1789760794.944689:0:6959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760794 -> 1789760795 00002000:00010000:1.0:1789760794.944692:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147528 -> 147536 00010000:00010000:1.0:1789760794.944734:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944749:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944758:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944771:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.944777:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944788:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944813:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.944823:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f73a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75522048->75526143] (req 75522048->75526143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.945003:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6649us (8505us total) trans 4294985746 rc 0/0 00000100:00100000:1.0:1789760794.945016:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18449 00000100:00100000:1.0:1789760794.945028:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733185806581 time 733198622864 state 0x2 ref 0 00000100:00100000:3.0:1789760794.948091:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.948383:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591424 00000100:00100000:2.0:1789760794.948396:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591424 00000100:00100000:2.0:1789760794.948468:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733185806581 time 733198622864 state 0x0 ref 1 00000100:00100000:2.0:1789760794.948489:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733198883280 time 733198622864 state 0x1 ref 1 00000100:00100000:2.0:1789760794.948525:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733198883280 time 733208816804 state 0x0 ref 1 00000100:00100000:2.0:1789760794.948549:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591424:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.948627:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75526144, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24050 00010000:00010000:2.0:1789760794.948639:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.948660:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760794.948665:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.948674:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.948691:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.955864:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985747 is committed 00002000:00010000:2.0:1789760794.957681:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75526144 -> 75530240 00002000:00010000:2.0:1789760794.957692:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147536 -> 147544 00010000:00010000:2.0:1789760794.957740:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957763:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957774:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957784:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760794.957790:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957811:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957837:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.957847:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f741 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75526144->75530239] (req 75526144->75530239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.958264:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591424:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9718us (10179us total) trans 4294985747 rc 0/0 00000100:00100000:2.0:1789760794.958279:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18450 00000100:00100000:2.0:1789760794.958291:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733198883280 time 733208816804 state 0x2 ref 0 00000100:00100000:3.0:1789760794.965457:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760794.965566:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591552 00000100:00100000:2.0:1789760794.965581:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591552 00000100:00100000:2.0:1789760794.965668:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733198883280 time 733208816804 state 0x0 ref 1 00000100:00100000:2.0:1789760794.965688:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733209077220 time 733208816804 state 0x1 ref 1 00000100:00100000:2.0:1789760794.965757:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733209077220 time 733226048609 state 0x0 ref 1 00000100:00100000:2.0:1789760794.965773:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591552:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760794.965854:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75530240, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24058 00010000:00010000:2.0:1789760794.965866:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.965887:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760794.965893:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.965902:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.965920:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.970941:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985748 is committed 00002000:00010000:1.0:1789760794.991343:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75530240 -> 75534336 00002000:00010000:1.0:1789760794.991357:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147544 -> 147552 00010000:00010000:1.0:1789760794.991377:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991393:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991410:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991420:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760794.991427:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991438:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991468:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.991478:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efad90b7/0x721975f94674f748 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75530240->75534335] (req 75530240->75534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760794.991632:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591552:12345-192.168.203.47@tcp:4:dd.0 Request processed in 25854us (26182us total) trans 4294985748 rc 0/0 00000100:00100000:1.0:1789760794.991643:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18451 00000100:00100000:1.0:1789760794.991656:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733209077220 time 733226048609 state 0x2 ref 0 00000100:00100000:0.0:1789760794.994626:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760794.995747:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591680 00000100:00100000:1.0:1789760794.995763:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591680 00000100:00100000:1.0:1789760794.995846:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733209077220 time 733226048609 state 0x0 ref 1 00000100:00100000:1.0:1789760794.995867:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733226309025 time 733226048609 state 0x1 ref 1 00000100:00100000:1.0:1789760794.995909:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733226309025 time 733256200356 state 0x0 ref 1 00000100:00100000:1.0:1789760794.995925:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591680:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760794.995988:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75534336, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24060 00010000:00010000:1.0:1789760794.995999:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.996017:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760794.996022:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.996030:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.996047:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.000828:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985749 is committed 00002000:00010000:1.0:1789760795.000953:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75534336 -> 75538432 00002000:00010000:1.0:1789760795.000959:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147552 -> 147560 00010000:00010000:1.0:1789760795.000978:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.000992:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.001002:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.001015:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.001020:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.001029:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.001054:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.001065:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f74f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75534336->75538431] (req 75534336->75538431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.001192:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591680:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5263us (6582us total) trans 4294985749 rc 0/0 00000100:00100000:1.0:1789760795.001205:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18452 00000100:00100000:1.0:1789760795.001217:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733226309025 time 733256200356 state 0x2 ref 0 00000100:00100000:0.0:1789760795.006171:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.006287:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591808 00000100:00100000:2.0:1789760795.006303:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591808 00000100:00100000:2.0:1789760795.006377:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733226309025 time 733256200356 state 0x0 ref 1 00000100:00100000:2.0:1789760795.006396:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733256460772 time 733256200356 state 0x1 ref 1 00000100:00100000:2.0:1789760795.006428:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733256460772 time 733266719636 state 0x0 ref 1 00000100:00100000:2.0:1789760795.006445:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.006521:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75538432, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24068 00010000:00010000:2.0:1789760795.006532:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.006551:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.006556:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.006564:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.006579:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.027862:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985750 is committed 00002000:00010000:0.0:1789760795.028116:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75538432 -> 75542528 00002000:00010000:0.0:1789760795.028122:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147560 -> 147568 00010000:00010000:0.0:1789760795.028334:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028349:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028359:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028368:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.028373:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028383:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028411:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.028420:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea45f8/0x721975f94674f756 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75538432->75542527] (req 75538432->75542527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.029163:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565591808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 22709us (22997us total) trans 4294985750 rc 0/0 00000100:00100000:0.0:1789760795.029178:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18453 00000100:00100000:0.0:1789760795.029190:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733256460772 time 733266719636 state 0x2 ref 0 00000100:00100000:0.0:1789760795.047887:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.047991:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565591936 00000100:00100000:1.0:1789760795.048004:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565591936 00000100:00100000:1.0:1789760795.048078:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733256460772 time 733266719636 state 0x0 ref 1 00000100:00100000:1.0:1789760795.048098:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733266980052 time 733266719636 state 0x1 ref 1 00000100:00100000:1.0:1789760795.048139:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733266980052 time 733308429611 state 0x0 ref 1 00000100:00100000:1.0:1789760795.048158:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.048222:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75542528, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24070 00010000:00010000:1.0:1789760795.048234:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.048254:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.048259:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.048268:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.048284:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.065780:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985751 is committed 00002000:00010000:1.0:1789760795.066020:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75542528 -> 75546624 00002000:00010000:1.0:1789760795.066026:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147568 -> 147576 00010000:00010000:1.0:1789760795.066045:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066060:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066071:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066080:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.066087:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066099:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066125:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.066133:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f75d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75542528->75546623] (req 75542528->75546623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.066261:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565591936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18100us (18384us total) trans 4294985751 rc 0/0 00000100:00100000:1.0:1789760795.066275:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18454 00000100:00100000:1.0:1789760795.066286:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733266980052 time 733308429611 state 0x2 ref 0 00000100:00100000:2.0:1789760795.070926:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.071072:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592064 00000100:00100000:1.0:1789760795.071086:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592064 00000100:00100000:1.0:1789760795.071162:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733266980052 time 733308429611 state 0x0 ref 1 00000100:00100000:1.0:1789760795.071182:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733308690027 time 733308429611 state 0x1 ref 1 00000100:00100000:1.0:1789760795.071219:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733308690027 time 733331509951 state 0x0 ref 1 00000100:00100000:1.0:1789760795.071233:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.071302:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75546624, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24078 00010000:00010000:1.0:1789760795.071316:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.071336:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.071342:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.071351:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.071370:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.081452:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985752 is committed 00002000:00010000:1.0:1789760795.081678:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75546624 -> 75550720 00002000:00010000:1.0:1789760795.081684:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147576 -> 147584 00010000:00010000:1.0:1789760795.082011:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082027:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082037:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082044:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.082050:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082060:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082086:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.082094:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75546624->75550719] (req 75546624->75550719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.082268:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11030us (11574us total) trans 4294985752 rc 0/0 00000100:00100000:1.0:1789760795.082281:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18455 00000100:00100000:1.0:1789760795.082293:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733308690027 time 733331509951 state 0x2 ref 0 00000100:00100000:0.0:1789760795.089142:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.092853:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592192 00000100:00100000:2.0:1789760795.092876:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592192 00000100:00100000:2.0:1789760795.093128:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733308690027 time 733331509951 state 0x0 ref 1 00000100:00100000:2.0:1789760795.093149:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733331770367 time 733331509951 state 0x1 ref 1 00000100:00100000:2.0:1789760795.093261:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733331770367 time 733353551715 state 0x0 ref 1 00000100:00100000:2.0:1789760795.093278:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.093349:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75550720, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24080 00010000:00010000:2.0:1789760795.093361:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.093381:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.093387:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.093394:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.093410:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.102121:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985753 is committed 00002000:00010000:2.0:1789760795.103190:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75550720 -> 75554816 00002000:00010000:2.0:1789760795.103199:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147584 -> 147592 00010000:00010000:2.0:1789760795.103218:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103234:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103244:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103253:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.103258:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103274:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103298:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.103307:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f76b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75550720->75554815] (req 75550720->75554815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.103514:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10231us (14379us total) trans 4294985753 rc 0/0 00000100:00100000:2.0:1789760795.103528:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18456 00000100:00100000:2.0:1789760795.103547:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733331770367 time 733353551715 state 0x2 ref 0 00000100:00100000:0.0:1789760795.113767:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.113932:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592320 00000100:00100000:1.0:1789760795.113953:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592320 00000100:00100000:1.0:1789760795.114034:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733331770367 time 733353551715 state 0x0 ref 1 00000100:00100000:1.0:1789760795.114053:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733353812131 time 733353551715 state 0x1 ref 1 00000100:00100000:1.0:1789760795.114088:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733353812131 time 733374379796 state 0x0 ref 1 00000100:00100000:1.0:1789760795.114101:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.114164:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75554816, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24088 00010000:00010000:1.0:1789760795.114175:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.114200:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.114205:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.114213:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.114231:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.120685:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985754 is committed 00002000:00010000:1.0:1789760795.121239:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75554816 -> 75558912 00002000:00010000:1.0:1789760795.121245:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147592 -> 147600 00010000:00010000:1.0:1789760795.121263:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121279:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121290:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121298:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.121304:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121314:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121344:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.121352:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f772 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75554816->75558911] (req 75554816->75558911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.121517:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7410us (7809us total) trans 4294985754 rc 0/0 00000100:00100000:1.0:1789760795.121530:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18457 00000100:00100000:1.0:1789760795.121552:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733353812131 time 733374379796 state 0x2 ref 0 00000100:00100000:0.0:1789760795.125471:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.126333:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592448 00000100:00100000:1.0:1789760795.126350:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592448 00000100:00100000:1.0:1789760795.126429:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733353812131 time 733374379796 state 0x0 ref 1 00000100:00100000:1.0:1789760795.126450:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733374640212 time 733374379796 state 0x1 ref 1 00000100:00100000:1.0:1789760795.126534:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733374640212 time 733386825564 state 0x0 ref 1 00000100:00100000:1.0:1789760795.126562:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.126636:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75558912, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24090 00010000:00010000:1.0:1789760795.126647:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.126668:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.126674:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.126682:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.126698:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.140523:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985755 is committed 00002000:00010000:1.0:1789760795.141028:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75558912 -> 75563008 00002000:00010000:1.0:1789760795.141034:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147600 -> 147608 00010000:00010000:1.0:1789760795.141052:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141067:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141077:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141086:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.141091:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141102:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141127:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.141140:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f779 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75558912->75563007] (req 75558912->75563007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.141258:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565592448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14693us (15795us total) trans 4294985755 rc 0/0 00000100:00100000:1.0:1789760795.141338:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18458 00000100:00100000:1.0:1789760795.141350:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733374640212 time 733386825564 state 0x2 ref 0 00000100:00100000:0.0:1789760795.145025:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.145187:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592576 00000100:00100000:2.0:1789760795.145201:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592576 00000100:00100000:2.0:1789760795.145274:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733374640212 time 733386825564 state 0x0 ref 1 00000100:00100000:2.0:1789760795.145293:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733387085980 time 733386825564 state 0x1 ref 1 00000100:00100000:2.0:1789760795.145368:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733387085980 time 733405659078 state 0x0 ref 1 00000100:00100000:2.0:1789760795.145385:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.145451:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75563008, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24098 00010000:00010000:2.0:1789760795.145462:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.145482:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.145487:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.145495:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.145510:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.152884:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985756 is committed 00002000:00010000:2.0:1789760795.153234:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75563008 -> 75567104 00002000:00010000:2.0:1789760795.153240:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147608 -> 147616 00010000:00010000:2.0:1789760795.153256:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153271:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153282:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153291:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.153296:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153313:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153338:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.153345:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f780 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75563008->75567103] (req 75563008->75567103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.153461:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8074us (8443us total) trans 4294985756 rc 0/0 00000100:00100000:2.0:1789760795.153472:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18459 00000100:00100000:2.0:1789760795.155200:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733387085980 time 733405659078 state 0x2 ref 0 00000100:00100000:0.0:1789760795.156770:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.156853:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592704 00000100:00100000:1.0:1789760795.156864:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592704 00000100:00100000:1.0:1789760795.156927:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733387085980 time 733405659078 state 0x0 ref 1 00000100:00100000:1.0:1789760795.157007:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733405919494 time 733405659078 state 0x1 ref 1 00000100:00100000:1.0:1789760795.157078:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733405919494 time 733417367966 state 0x0 ref 1 00000100:00100000:1.0:1789760795.157093:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.157152:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75567104, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240a0 00010000:00010000:1.0:1789760795.157161:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.157181:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.157186:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.157193:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.157210:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.166362:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985757 is committed 00002000:00010000:1.0:1789760795.166637:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75567104 -> 75571200 00002000:00010000:1.0:1789760795.166643:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147616 -> 147624 00010000:00010000:1.0:1789760795.166661:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166676:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166686:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166693:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.166699:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166819:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166846:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.166855:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f787 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75567104->75571199] (req 75567104->75571199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.167232:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10134us (10464us total) trans 4294985757 rc 0/0 00000100:00100000:1.0:1789760795.167246:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18460 00000100:00100000:1.0:1789760795.167259:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733405919494 time 733417367966 state 0x2 ref 0 00000100:00100000:0.0:1789760795.171626:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.174349:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592832 00000100:00100000:1.0:1789760795.174372:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592832 00000100:00100000:1.0:1789760795.174462:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733405919494 time 733417367966 state 0x0 ref 1 00000100:00100000:1.0:1789760795.174483:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733417628382 time 733417367966 state 0x1 ref 1 00000100:00100000:1.0:1789760795.174518:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733417628382 time 733434810096 state 0x0 ref 1 00000100:00100000:1.0:1789760795.174533:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.174617:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75571200, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240a8 00010000:00010000:1.0:1789760795.174629:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.174649:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.174654:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.174662:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.174678:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.181560:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985758 is committed 00002000:00010000:1.0:1789760795.181688:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75571200 -> 75575296 00002000:00010000:1.0:1789760795.181695:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147624 -> 147632 00010000:00010000:1.0:1789760795.181750:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181766:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181776:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181785:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.181790:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181800:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181834:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.181842:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f78e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75571200->75575295] (req 75571200->75575295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.181962:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7416us (10333us total) trans 4294985758 rc 0/0 00000100:00100000:1.0:1789760795.181976:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18461 00000100:00100000:1.0:1789760795.181987:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733417628382 time 733434810096 state 0x2 ref 0 00000100:00100000:0.0:1789760795.184384:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.184476:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565592960 00000100:00100000:2.0:1789760795.184489:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565592960 00000100:00100000:2.0:1789760795.184561:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733417628382 time 733434810096 state 0x0 ref 1 00000100:00100000:2.0:1789760795.184581:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733435070512 time 733434810096 state 0x1 ref 1 00000100:00100000:2.0:1789760795.184628:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733435070512 time 733444919005 state 0x0 ref 1 00000100:00100000:2.0:1789760795.184643:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.184826:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75575296, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240b0 00010000:00010000:2.0:1789760795.184837:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.184857:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.184862:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.184868:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.184880:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.190522:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985759 is committed 00002000:00010000:2.0:1789760795.190719:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75575296 -> 75579392 00002000:00010000:2.0:1789760795.190723:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147632 -> 147640 00010000:00010000:2.0:1789760795.190739:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190754:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190764:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190774:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.190780:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190790:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190816:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.190822:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f795 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75575296->75579391] (req 75575296->75579391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.190928:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565592960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6282us (6550us total) trans 4294985759 rc 0/0 00000100:00100000:2.0:1789760795.190936:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18462 00000100:00100000:2.0:1789760795.190952:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733435070512 time 733444919005 state 0x2 ref 0 00000100:00100000:0.0:1789760795.193551:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.193686:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593088 00000100:00100000:1.0:1789760795.193698:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593088 00000100:00100000:1.0:1789760795.193803:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733435070512 time 733444919005 state 0x0 ref 1 00000100:00100000:1.0:1789760795.193822:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733445179421 time 733444919005 state 0x1 ref 1 00000100:00100000:1.0:1789760795.193858:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733445179421 time 733454149124 state 0x0 ref 1 00000100:00100000:1.0:1789760795.193872:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565593088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.194092:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75579392, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240b8 00010000:00010000:0.0:1789760795.194104:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.194123:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.194129:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.194137:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.194154:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.199466:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985760 is committed 00002000:00010000:0.0:1789760795.199645:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75579392 -> 75583488 00002000:00010000:0.0:1789760795.199652:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147640 -> 147648 00010000:00010000:0.0:1789760795.199669:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199684:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199694:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199790:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.199797:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199808:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199835:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.199848:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a253b28/0x721975f94674f79c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75579392->75583487] (req 75579392->75583487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.200113:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565593088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6235us (6566us total) trans 4294985760 rc 0/0 00000100:00100000:0.0:1789760795.200127:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18463 00000100:00100000:0.0:1789760795.200139:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733445179421 time 733454149124 state 0x2 ref 0 00000100:00100000:0.0:1789760795.203582:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.203821:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593216 00000100:00100000:1.0:1789760795.203834:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593216 00000100:00100000:1.0:1789760795.203905:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733445179421 time 733454149124 state 0x0 ref 1 00000100:00100000:1.0:1789760795.203924:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733454409540 time 733454149124 state 0x1 ref 1 00000100:00100000:1.0:1789760795.203974:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733454409540 time 733464266443 state 0x0 ref 1 00000100:00100000:1.0:1789760795.203989:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.204056:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75583488, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240c0 00010000:00010000:1.0:1789760795.204068:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.204095:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.204099:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.204108:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.204124:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.209154:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985761 is committed 00002000:00010000:1.0:1789760795.209414:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75583488 -> 75587584 00002000:00010000:1.0:1789760795.209420:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147648 -> 147656 00010000:00010000:1.0:1789760795.209441:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209456:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209467:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209476:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.209482:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209493:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209525:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.209535:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75583488->75587583] (req 75583488->75587583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.210362:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6367us (6786us total) trans 4294985761 rc 0/0 00000100:00100000:1.0:1789760795.210384:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18464 00000100:00100000:1.0:1789760795.210396:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733454409540 time 733464266443 state 0x2 ref 0 00000100:00100000:2.0:1789760795.215163:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.217246:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593344 00000100:00100000:0.0:1789760795.217264:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593344 00000100:00100000:0.0:1789760795.217382:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733454409540 time 733464266443 state 0x0 ref 1 00000100:00100000:0.0:1789760795.217401:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733464526859 time 733464266443 state 0x1 ref 1 00000100:00100000:0.0:1789760795.217489:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733464526859 time 733477781033 state 0x0 ref 1 00000100:00100000:0.0:1789760795.217505:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565593344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.217585:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75587584, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240c8 00010000:00010000:0.0:1789760795.217597:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.217626:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.217631:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.217638:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.217659:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.229425:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985762 is committed 00002000:00010000:0.0:1789760795.230658:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75587584 -> 75591680 00002000:00010000:0.0:1789760795.230669:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147656 -> 147664 00010000:00010000:0.0:1789760795.230688:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.230720:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.233225:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.233252:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.233258:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.233271:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.233302:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.233311:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f7aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75587584->75591679] (req 75587584->75591679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.233851:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565593344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16340us (18694us total) trans 4294985762 rc 0/0 00000100:00100000:0.0:1789760795.233866:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18465 00000100:00100000:0.0:1789760795.233877:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733464526859 time 733477781033 state 0x2 ref 0 00000100:00100000:0.0:1789760795.238295:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.238803:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593472 00000100:00100000:2.0:1789760795.238819:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593472 00000100:00100000:2.0:1789760795.238888:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733464526859 time 733477781033 state 0x0 ref 1 00000100:00100000:2.0:1789760795.238906:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733478041449 time 733477781033 state 0x1 ref 1 00000100:00100000:2.0:1789760795.238944:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733478041449 time 733499236090 state 0x0 ref 1 00000100:00100000:2.0:1789760795.239020:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.239080:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75591680, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240d0 00010000:00010000:2.0:1789760795.239090:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.239118:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.239123:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.239130:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.239147:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.252639:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985763 is committed 00002000:00010000:0.0:1789760795.252859:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75591680 -> 75595776 00002000:00010000:0.0:1789760795.253027:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147664 -> 147672 00010000:00010000:0.0:1789760795.253046:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253273:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253287:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253295:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.253300:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253311:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253409:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.253421:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f7b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75591680->75595775] (req 75591680->75595775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.253681:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14655us (15391us total) trans 4294985763 rc 0/0 00000100:00100000:0.0:1789760795.253694:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18466 00000100:00100000:0.0:1789760795.255926:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733478041449 time 733499236090 state 0x2 ref 0 00000100:00100000:2.0:1789760795.259509:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.260144:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593600 00000100:00100000:1.0:1789760795.260159:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593600 00000100:00100000:1.0:1789760795.260237:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733478041449 time 733499236090 state 0x0 ref 1 00000100:00100000:1.0:1789760795.260255:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733499496506 time 733499236090 state 0x1 ref 1 00000100:00100000:1.0:1789760795.260489:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733499496506 time 733520778944 state 0x0 ref 1 00000100:00100000:1.0:1789760795.260505:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.260570:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75595776, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240d8 00010000:00010000:1.0:1789760795.260583:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.260614:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.260620:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.260627:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.260645:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.268633:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985764 is committed 00002000:00010000:1.0:1789760795.268780:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75595776 -> 75599872 00002000:00010000:1.0:1789760795.268786:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147672 -> 147680 00010000:00010000:1.0:1789760795.268804:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268819:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268829:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268837:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.268843:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268854:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268882:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.268896:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75595776->75599871] (req 75595776->75599871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.269038:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8527us (9534us total) trans 4294985764 rc 0/0 00000100:00100000:1.0:1789760795.269053:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18467 00000100:00100000:1.0:1789760795.269078:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733499496506 time 733520778944 state 0x2 ref 0 00000100:00100000:2.0:1789760795.272864:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.273045:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593728 00000100:00100000:0.0:1789760795.273060:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593728 00000100:00100000:0.0:1789760795.273203:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733499496506 time 733520778944 state 0x0 ref 1 00000100:00100000:0.0:1789760795.273223:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733521039360 time 733520778944 state 0x1 ref 1 00000100:00100000:0.0:1789760795.273304:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733521039360 time 733533595055 state 0x0 ref 1 00000100:00100000:0.0:1789760795.273320:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.273395:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75599872, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240e0 00010000:00010000:0.0:1789760795.273406:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.273427:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.273433:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.273441:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.273464:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.283888:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985765 is committed 00002000:00010000:0.0:1789760795.284192:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75599872 -> 75603968 00002000:00010000:0.0:1789760795.284199:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147680 -> 147688 00010000:00010000:0.0:1789760795.284217:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284233:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284243:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284251:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.284257:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284268:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284294:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.284303:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f7bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75599872->75603967] (req 75599872->75603967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.284533:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11209us (11675us total) trans 4294985765 rc 0/0 00000100:00100000:0.0:1789760795.284556:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18468 00000100:00100000:0.0:1789760795.284568:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733521039360 time 733533595055 state 0x2 ref 0 00000100:00100000:0.0:1789760795.293041:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.293164:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593856 00000100:00100000:2.0:1789760795.293178:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593856 00000100:00100000:2.0:1789760795.293261:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733521039360 time 733533595055 state 0x0 ref 1 00000100:00100000:2.0:1789760795.293281:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733533855471 time 733533595055 state 0x1 ref 1 00000100:00100000:2.0:1789760795.293368:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733533855471 time 733553657930 state 0x0 ref 1 00000100:00100000:2.0:1789760795.293383:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565593856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.293447:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75603968, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240e8 00010000:00010000:2.0:1789760795.293459:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.293479:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.293486:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.293494:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.293511:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.302895:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985766 is committed 00002000:00010000:2.0:1789760795.303435:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75603968 -> 75608064 00002000:00010000:2.0:1789760795.303441:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147688 -> 147696 00010000:00010000:2.0:1789760795.303460:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303477:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303488:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303497:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.303502:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303513:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303538:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.303552:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75603968->75608063] (req 75603968->75608063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.303931:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565593856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10543us (10898us total) trans 4294985766 rc 0/0 00000100:00100000:2.0:1789760795.304162:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18469 00000100:00100000:2.0:1789760795.304175:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733533855471 time 733553657930 state 0x2 ref 0 00000100:00100000:2.0:1789760795.308919:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.309189:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565593984 00000100:00100000:1.0:1789760795.309201:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565593984 00000100:00100000:1.0:1789760795.309273:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733533855471 time 733553657930 state 0x0 ref 1 00000100:00100000:1.0:1789760795.309290:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733553918346 time 733553657930 state 0x1 ref 1 00000100:00100000:1.0:1789760795.309365:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733553918346 time 733569656162 state 0x0 ref 1 00000100:00100000:1.0:1789760795.309379:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.309452:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75608064, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240f0 00010000:00010000:1.0:1789760795.309464:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.309484:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.309489:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.309497:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.309515:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.316925:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985767 is committed 00002000:00010000:0.0:1789760795.317347:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75608064 -> 75612160 00002000:00010000:0.0:1789760795.317354:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147696 -> 147704 00010000:00010000:0.0:1789760795.317373:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317389:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317400:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317409:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.317415:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317427:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317453:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.317463:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dbfa6/0x721975f94674f7cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75608064->75612159] (req 75608064->75612159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.317612:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565593984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8218us (8689us total) trans 4294985767 rc 0/0 00000100:00100000:0.0:1789760795.317626:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18470 00000100:00100000:0.0:1789760795.317639:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733553918346 time 733569656162 state 0x2 ref 0 00000100:00100000:0.0:1789760795.322050:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.322283:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594112 00000100:00100000:2.0:1789760795.322296:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594112 00000100:00100000:2.0:1789760795.322364:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733553918346 time 733569656162 state 0x0 ref 1 00000100:00100000:2.0:1789760795.322383:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733569916578 time 733569656162 state 0x1 ref 1 00000100:00100000:2.0:1789760795.322412:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733569916578 time 733582704328 state 0x0 ref 1 00000100:00100000:2.0:1789760795.322426:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.322489:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75612160, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x240f8 00010000:00010000:2.0:1789760795.322501:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322520:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.322525:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.322533:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322551:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.329202:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985768 is committed 00002000:00010000:2.0:1789760795.329379:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75612160 -> 75616256 00002000:00010000:2.0:1789760795.329389:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147704 -> 147712 00010000:00010000:2.0:1789760795.329407:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329422:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329432:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329441:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.329447:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329457:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329484:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.329492:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75612160->75616255] (req 75612160->75616255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.330793:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8356us (8746us total) trans 4294985768 rc 0/0 00000100:00100000:2.0:1789760795.330811:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18471 00000100:00100000:2.0:1789760795.330824:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733569916578 time 733582704328 state 0x2 ref 0 00000100:00100000:3.0:1789760795.337249:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.337884:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594240 00000100:00100000:2.0:1789760795.337903:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594240 00000100:00100000:2.0:1789760795.338041:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733569916578 time 733582704328 state 0x0 ref 1 00000100:00100000:2.0:1789760795.338061:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733582964744 time 733582704328 state 0x1 ref 1 00000100:00100000:2.0:1789760795.338105:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733582964744 time 733598395733 state 0x0 ref 1 00000100:00100000:2.0:1789760795.338119:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565594240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.338224:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75616256, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24100 00010000:00010000:2.0:1789760795.338236:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.338256:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.338261:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.338268:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.338286:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.344809:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985769 is committed 00002000:00010000:2.0:1789760795.345093:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75616256 -> 75620352 00002000:00010000:2.0:1789760795.345099:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147712 -> 147720 00010000:00010000:2.0:1789760795.345117:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345132:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345143:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345150:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.345156:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345166:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345190:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.345199:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75616256->75620351] (req 75616256->75620351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.345519:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565594240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7395us (8270us total) trans 4294985769 rc 0/0 00000100:00100000:2.0:1789760795.345533:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18472 00000100:00100000:2.0:1789760795.345545:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733582964744 time 733598395733 state 0x2 ref 0 00000100:00100000:0.0:1789760795.358802:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.358988:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594368 00000100:00100000:1.0:1789760795.358999:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594368 00000100:00100000:1.0:1789760795.359066:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733582964744 time 733598395733 state 0x0 ref 1 00000100:00100000:1.0:1789760795.359084:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733598656149 time 733598395733 state 0x1 ref 1 00000100:00100000:1.0:1789760795.359119:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733598656149 time 733619410380 state 0x0 ref 1 00000100:00100000:1.0:1789760795.359131:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565594368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.359193:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75620352, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24108 00010000:00010000:1.0:1789760795.359205:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.359223:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.359229:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.359236:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.359251:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.365268:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985770 is committed 00002000:00010000:1.0:1789760795.365493:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75620352 -> 75624448 00002000:00010000:1.0:1789760795.365500:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147720 -> 147728 00010000:00010000:1.0:1789760795.365518:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365533:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365543:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365551:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.365557:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365568:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365593:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.365612:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f7e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75620352->75624447] (req 75620352->75624447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.366091:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565594368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6953us (7295us total) trans 4294985770 rc 0/0 00000100:00100000:1.0:1789760795.366107:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18473 00000100:00100000:1.0:1789760795.366120:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733598656149 time 733619410380 state 0x2 ref 0 00000100:00100000:0.0:1789760795.372859:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.373036:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594496 00000100:00100000:2.0:1789760795.373047:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594496 00000100:00100000:2.0:1789760795.373118:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733598656149 time 733619410380 state 0x0 ref 1 00000100:00100000:2.0:1789760795.373136:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733619670796 time 733619410380 state 0x1 ref 1 00000100:00100000:2.0:1789760795.373240:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733619670796 time 733633462401 state 0x0 ref 1 00000100:00100000:2.0:1789760795.373256:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.373320:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75624448, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24110 00010000:00010000:2.0:1789760795.373330:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.373349:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.373354:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.373360:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.373376:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.383012:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985771 is committed 00002000:00010000:2.0:1789760795.383880:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75624448 -> 75628544 00002000:00010000:2.0:1789760795.383889:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147728 -> 147736 00010000:00010000:2.0:1789760795.383983:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.383998:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.384008:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.384016:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.384022:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.384032:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.384058:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.384066:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c2300ee/0x721975f94674f7e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75624448->75628543] (req 75624448->75628543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.386014:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12741us (13152us total) trans 4294985771 rc 0/0 00000100:00100000:2.0:1789760795.386034:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18474 00000100:00100000:2.0:1789760795.386048:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733619670796 time 733633462401 state 0x2 ref 0 00000100:00100000:3.0:1789760795.391424:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.391503:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594624 00000100:00100000:2.0:1789760795.391520:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594624 00000100:00100000:2.0:1789760795.391582:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733619670796 time 733633462401 state 0x0 ref 1 00000100:00100000:2.0:1789760795.391598:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733633722817 time 733633462401 state 0x1 ref 1 00000100:00100000:2.0:1789760795.391654:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733633722817 time 733651945162 state 0x0 ref 1 00000100:00100000:2.0:1789760795.391857:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565594624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.391964:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75628544, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24118 00010000:00010000:0.0:1789760795.391978:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.391998:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.392003:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.392010:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.392029:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.399792:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985772 is committed 00002000:00010000:0.0:1789760795.400029:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75628544 -> 75632640 00002000:00010000:0.0:1789760795.400035:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147736 -> 147744 00010000:00010000:0.0:1789760795.400055:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400070:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400079:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400087:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.400092:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400103:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400128:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.400137:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f7f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75628544->75632639] (req 75628544->75632639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.400335:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565594624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8661us (8919us total) trans 4294985772 rc 0/0 00000100:00100000:0.0:1789760795.400348:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18475 00000100:00100000:0.0:1789760795.400361:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733633722817 time 733651945162 state 0x2 ref 0 00000100:00100000:0.0:1789760795.404018:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:769fd61a-9f51-46fc-af80-467e2ca172bc:3456:1876699580069120:0@lo:400:kworker.0 00000100:00100000:0.0:1789760795.404133:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760795.404327:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3457:1876699580069248:0@lo:400:kworker.0 00000100:00100000:2.0:1789760795.404369:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760795.404548:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069248 00000100:00100000:2.0:1789760795.404557:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069248 00000100:00100000:2.0:1789760795.404632:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1789760795.404643:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1876699580069248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760795.404725:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1876699580069248:12345-0@lo:400:kworker.0 Request processed in 63us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.404733:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1789760795.404793:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3457:1876699580069248:0@lo:400:kworker.0 00000100:00100000:1.0:1789760795.405154:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069120 00000100:00100000:1.0:1789760795.405159:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069120 00000100:00100000:1.0:1789760795.405198:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789760795.405206:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3456:x1876699580069120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760795.405285:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d429c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580069376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760795.405325:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760795.405378:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069376 00000100:00100000:2.0:1789760795.405382:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069376 00000100:00100000:2.0:1789760795.405427:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789760795.405436:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580069376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760795.405466:0:6956:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789760795.405505:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1876699580069376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.405513:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1789760795.405530:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760795.405561:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d429c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3458:1876699580069376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760795.408374:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760795.408402:0:3458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3458:1876699580069504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.408497:0:3458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760795.408561:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3457:1876699580069760:0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.408590:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760795.408625:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760795.408631:0:3457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d4b54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580069632:0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.408662:0:3457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760795.408701:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069504 00000100:00100000:3.0:1789760795.408739:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069504 00000100:00100000:3.0:1789760795.408809:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069760 00000100:00100000:3.0:1789760795.408813:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069760 00000100:00100000:3.0:1789760795.408845:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1789760795.408855:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1876699580069504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.408916:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1876699580069504:12345-0@lo:400:kworker.0 Request processed in 62us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.408924:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1789760795.408943:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789760795.408950:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876699580069760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.408979:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876699580069760:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.408986:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789760795.409010:0:9029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069632 00000100:00100000:3.0:1789760795.409013:0:9029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069632 00000100:00100000:3.0:1789760795.409051:0:9029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789760795.409058:0:9029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580069632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.409091:0:9029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3457:x1876699580069632:12345-0@lo:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.409097:0:9029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1789760795.409116:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760795.409122:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760795.409164:0:3458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3458:1876699580069504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.409198:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3457:1876699580069632:0@lo:400:kworker.0 00000100:00100000:3.0:1789760795.409207:0:3457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3457:1876699580069760:0@lo:400:kworker.0 00000100:00100000:2.0:1789760795.409468:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.409699:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:769fd61a-9f51-46fc-af80-467e2ca172bc+19:3456:x1876699580069120:12345-0@lo:400:kworker.0 Request processed in 4491us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760795.409723:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789760795.409908:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594752 00000100:00100000:3.0:1789760795.409914:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594752 00000100:00100000:3.0:1789760795.410045:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733633722817 time 733651945162 state 0x0 ref 1 00000100:00100000:3.0:1789760795.410066:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733652205578 time 733651945162 state 0x1 ref 1 00000100:00100000:3.0:1789760795.410145:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733652205578 time 733670434889 state 0x0 ref 1 00000100:00100000:3.0:1789760795.410160:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760795.410226:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75632640, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24120 00010000:00010000:3.0:1789760795.410240:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.410262:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:3.0:1789760795.410267:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.410276:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.410295:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.411362:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d4b41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:769fd61a-9f51-46fc-af80-467e2ca172bc:3456:1876699580069120:0@lo:400:kworker.0 00000001:00080000:0.0:1789760795.417295:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985773 is committed 00002000:00010000:3.0:1789760795.417634:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75632640 -> 75636736 00002000:00010000:3.0:1789760795.417728:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147744 -> 147752 00010000:00010000:3.0:1789760795.417746:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417761:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417771:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417780:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760795.417786:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417797:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417830:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.417838:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f7f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75632640->75636735] (req 75632640->75636735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.418068:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7903us (8595us total) trans 4294985773 rc 0/0 00000100:00100000:3.0:1789760795.418081:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18476 00000100:00100000:3.0:1789760795.418094:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733652205578 time 733670434889 state 0x2 ref 0 00000100:00100000:2.0:1789760795.428327:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.428436:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565594880 00000100:00100000:0.0:1789760795.428448:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565594880 00000100:00100000:0.0:1789760795.428526:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733652205578 time 733670434889 state 0x0 ref 1 00000100:00100000:0.0:1789760795.428558:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733670695305 time 733670434889 state 0x1 ref 1 00000100:00100000:0.0:1789760795.428594:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733670695305 time 733688885579 state 0x0 ref 1 00000100:00100000:0.0:1789760795.428617:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.428697:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75636736, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24128 00010000:00010000:0.0:1789760795.428918:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.428939:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.428945:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.428954:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.428972:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.444847:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985774 is committed 00002000:00010000:1.0:1789760795.446094:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75636736 -> 75640832 00002000:00010000:1.0:1789760795.446104:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147752 -> 147760 00010000:00010000:1.0:1789760795.446120:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446136:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446146:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446154:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.446160:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446176:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446202:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.446210:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001380a535/0x721975f94674f7fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75636736->75640831] (req 75636736->75640831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.446394:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565594880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17773us (18077us total) trans 4294985774 rc 0/0 00000100:00100000:1.0:1789760795.446407:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18477 00000100:00100000:1.0:1789760795.446420:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733670695305 time 733688885579 state 0x2 ref 0 00000100:00100000:0.0:1789760795.452819:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.454938:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595008 00000100:00100000:2.0:1789760795.454953:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595008 00000100:00100000:2.0:1789760795.455013:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733670695305 time 733688885579 state 0x0 ref 1 00000100:00100000:2.0:1789760795.455029:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733689145995 time 733688885579 state 0x1 ref 1 00000100:00100000:2.0:1789760795.455078:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733689145995 time 733715369682 state 0x0 ref 1 00000100:00100000:2.0:1789760795.455092:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.455323:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75640832, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24130 00010000:00010000:2.0:1789760795.455334:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.455349:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.455354:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.455360:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.455380:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.460979:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985775 is committed 00002000:00010000:2.0:1789760795.461097:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75640832 -> 75644928 00002000:00010000:2.0:1789760795.461102:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147760 -> 147768 00010000:00010000:2.0:1789760795.461124:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461137:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461147:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461155:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.461160:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461170:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461190:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.461197:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75640832->75644927] (req 75640832->75644927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.461300:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6206us (8485us total) trans 4294985775 rc 0/0 00000100:00100000:2.0:1789760795.461309:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18478 00000100:00100000:2.0:1789760795.461319:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733689145995 time 733715369682 state 0x2 ref 0 00000100:00100000:2.0:1789760795.464493:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760795.464578:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595136 00000100:00100000:3.0:1789760795.464594:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595136 00000100:00100000:3.0:1789760795.464680:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733689145995 time 733715369682 state 0x0 ref 1 00000100:00100000:3.0:1789760795.464701:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733715630098 time 733715369682 state 0x1 ref 1 00000100:00100000:3.0:1789760795.464775:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733715630098 time 733725066917 state 0x0 ref 1 00000100:00100000:3.0:1789760795.464790:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760795.464864:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75644928, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24138 00010000:00010000:3.0:1789760795.464876:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.464896:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:3.0:1789760795.464901:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.464908:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.464923:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.472223:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985776 is committed 00002000:00010000:2.0:1789760795.472385:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75644928 -> 75649024 00002000:00010000:2.0:1789760795.472392:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147768 -> 147776 00010000:00010000:2.0:1789760795.472410:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472424:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472435:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472444:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.472450:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472461:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472489:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.472498:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674f80c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75644928->75649023] (req 75644928->75649023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.472692:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7897us (8201us total) trans 4294985776 rc 0/0 00000100:00100000:2.0:1789760795.472805:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18479 00000100:00100000:2.0:1789760795.472819:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733715630098 time 733725066917 state 0x2 ref 0 00000100:00100000:0.0:1789760795.478560:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.478762:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595264 00000100:00100000:1.0:1789760795.478777:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595264 00000100:00100000:1.0:1789760795.478856:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733715630098 time 733725066917 state 0x0 ref 1 00000100:00100000:1.0:1789760795.478876:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733725327333 time 733725066917 state 0x1 ref 1 00000100:00100000:1.0:1789760795.478909:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733725327333 time 733739201235 state 0x0 ref 1 00000100:00100000:1.0:1789760795.478924:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.479021:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75649024, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24140 00010000:00010000:1.0:1789760795.479033:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.479305:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.479311:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.479318:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.479335:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.488903:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985777 is committed 00002000:00010000:0.0:1789760795.489051:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75649024 -> 75653120 00002000:00010000:0.0:1789760795.489058:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147776 -> 147784 00010000:00010000:0.0:1789760795.489076:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489091:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489101:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489109:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.489115:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489126:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489152:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.489165:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d5e107/0x721975f94674f813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75649024->75653119] (req 75649024->75653119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.489285:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10356us (10744us total) trans 4294985777 rc 0/0 00000100:00100000:0.0:1789760795.489296:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18480 00000100:00100000:0.0:1789760795.489308:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733725327333 time 733739201235 state 0x2 ref 0 00000100:00100000:0.0:1789760795.493073:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.493181:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595392 00000100:00100000:2.0:1789760795.493196:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595392 00000100:00100000:2.0:1789760795.493272:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733725327333 time 733739201235 state 0x0 ref 1 00000100:00100000:2.0:1789760795.493292:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733739461651 time 733739201235 state 0x1 ref 1 00000100:00100000:2.0:1789760795.493328:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733739461651 time 733753620058 state 0x0 ref 1 00000100:00100000:2.0:1789760795.493342:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.493407:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75653120, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24148 00010000:00010000:2.0:1789760795.493419:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.493438:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.493444:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.493451:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.493471:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.498358:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985778 is committed 00002000:00010000:0.0:1789760795.498538:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75653120 -> 75657216 00002000:00010000:0.0:1789760795.498545:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147784 -> 147792 00010000:00010000:0.0:1789760795.498564:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498578:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498588:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498632:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.498640:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498652:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498677:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.498686:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f81a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75653120->75657215] (req 75653120->75657215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.499037:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5688us (5969us total) trans 4294985778 rc 0/0 00000100:00100000:0.0:1789760795.499050:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18481 00000100:00100000:0.0:1789760795.499064:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733739461651 time 733753620058 state 0x2 ref 0 00000100:00100000:2.0:1789760795.504860:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.504984:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595520 00000100:00100000:1.0:1789760795.504999:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595520 00000100:00100000:1.0:1789760795.505084:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733739461651 time 733753620058 state 0x0 ref 1 00000100:00100000:1.0:1789760795.505106:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733753880474 time 733753620058 state 0x1 ref 1 00000100:00100000:1.0:1789760795.505142:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733753880474 time 733765433794 state 0x0 ref 1 00000100:00100000:1.0:1789760795.505156:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.505239:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75657216, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24150 00010000:00010000:1.0:1789760795.505250:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.505271:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.505276:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.505286:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.505310:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.510552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985779 is committed 00002000:00010000:1.0:1789760795.510747:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75657216 -> 75661312 00002000:00010000:1.0:1789760795.510754:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147792 -> 147800 00010000:00010000:1.0:1789760795.510772:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510786:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510796:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510805:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.510811:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510821:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510849:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.510857:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75657216->75661311] (req 75657216->75661311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.510994:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565595520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5833us (6146us total) trans 4294985779 rc 0/0 00000100:00100000:1.0:1789760795.511007:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18482 00000100:00100000:1.0:1789760795.511020:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733753880474 time 733765433794 state 0x2 ref 0 00000100:00100000:2.0:1789760795.516293:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.516843:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595648 00000100:00100000:0.0:1789760795.516857:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595648 00000100:00100000:0.0:1789760795.516937:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733753880474 time 733765433794 state 0x0 ref 1 00000100:00100000:0.0:1789760795.516970:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733765694210 time 733765433794 state 0x1 ref 1 00000100:00100000:0.0:1789760795.517002:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733765694210 time 733777292889 state 0x0 ref 1 00000100:00100000:0.0:1789760795.517017:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.517082:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75661312, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24158 00010000:00010000:0.0:1789760795.517093:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.517115:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.517120:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.517128:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.517146:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.523773:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985780 is committed 00002000:00010000:0.0:1789760795.523929:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75661312 -> 75665408 00002000:00010000:0.0:1789760795.523936:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147800 -> 147808 00010000:00010000:0.0:1789760795.524001:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524016:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524026:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524034:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.524039:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524049:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524073:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.524087:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc8bb81/0x721975f94674f828 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75661312->75665407] (req 75661312->75665407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.524294:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7273us (8010us total) trans 4294985780 rc 0/0 00000100:00100000:0.0:1789760795.524306:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18483 00000100:00100000:0.0:1789760795.524317:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733765694210 time 733777292889 state 0x2 ref 0 00000100:00100000:0.0:1789760795.528884:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.529079:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595776 00000100:00100000:2.0:1789760795.529093:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595776 00000100:00100000:2.0:1789760795.529186:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733765694210 time 733777292889 state 0x0 ref 1 00000100:00100000:2.0:1789760795.529206:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733777553305 time 733777292889 state 0x1 ref 1 00000100:00100000:2.0:1789760795.529235:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733777553305 time 733789526728 state 0x0 ref 1 00000100:00100000:2.0:1789760795.529250:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.529314:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75665408, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24160 00010000:00010000:2.0:1789760795.529324:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.529350:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.529356:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.529364:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.529388:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.534582:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985781 is committed 00002000:00010000:2.0:1789760795.534780:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75665408 -> 75669504 00002000:00010000:2.0:1789760795.534786:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147808 -> 147816 00010000:00010000:2.0:1789760795.534804:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534819:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534828:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534835:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.534841:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534852:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534878:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.534886:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f82f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75665408->75669503] (req 75665408->75669503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.535064:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5810us (6186us total) trans 4294985781 rc 0/0 00000100:00100000:2.0:1789760795.535078:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18484 00000100:00100000:2.0:1789760795.535091:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733777553305 time 733789526728 state 0x2 ref 0 00000100:00100000:2.0:1789760795.540261:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.540468:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565595904 00000100:00100000:1.0:1789760795.540481:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565595904 00000100:00100000:1.0:1789760795.540563:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733777553305 time 733789526728 state 0x0 ref 1 00000100:00100000:1.0:1789760795.540581:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733789787144 time 733789526728 state 0x1 ref 1 00000100:00100000:1.0:1789760795.540679:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733789787144 time 733800969634 state 0x0 ref 1 00000100:00100000:1.0:1789760795.540696:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.540838:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75669504, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24168 00010000:00010000:1.0:1789760795.540849:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.540869:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.540874:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.540882:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.540899:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.547354:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985782 is committed 00002000:00010000:1.0:1789760795.547794:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75669504 -> 75673600 00002000:00010000:1.0:1789760795.547801:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147816 -> 147824 00010000:00010000:1.0:1789760795.547819:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.547835:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.547846:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.547855:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.547861:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.547871:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.548416:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.548430:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75669504->75673599] (req 75669504->75673599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.548574:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565595904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7874us (8323us total) trans 4294985782 rc 0/0 00000100:00100000:1.0:1789760795.548588:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18485 00000100:00100000:1.0:1789760795.548612:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733789787144 time 733800969634 state 0x2 ref 0 00000100:00100000:0.0:1789760795.553009:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.553105:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596032 00000100:00100000:2.0:1789760795.553118:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596032 00000100:00100000:2.0:1789760795.553196:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733789787144 time 733800969634 state 0x0 ref 1 00000100:00100000:2.0:1789760795.553215:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733801230050 time 733800969634 state 0x1 ref 1 00000100:00100000:2.0:1789760795.553251:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733801230050 time 733813542278 state 0x0 ref 1 00000100:00100000:2.0:1789760795.553266:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.553333:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75673600, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24170 00010000:00010000:2.0:1789760795.553345:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.553365:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.553369:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.553378:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.553396:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.563095:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985783 is committed 00002000:00010000:0.0:1789760795.563288:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75673600 -> 75677696 00002000:00010000:0.0:1789760795.563295:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147824 -> 147832 00010000:00010000:0.0:1789760795.563312:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563327:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563336:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563344:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.563349:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563359:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563384:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.563392:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f83d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75673600->75677695] (req 75673600->75677695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.563914:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10641us (10970us total) trans 4294985783 rc 0/0 00000100:00100000:0.0:1789760795.563928:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18486 00000100:00100000:0.0:1789760795.563940:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733801230050 time 733813542278 state 0x2 ref 0 00000100:00100000:3.0:1789760795.570471:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.570845:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596160 00000100:00100000:2.0:1789760795.570869:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596160 00000100:00100000:2.0:1789760795.571155:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733801230050 time 733813542278 state 0x0 ref 1 00000100:00100000:2.0:1789760795.571443:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733813802694 time 733813542278 state 0x1 ref 1 00000100:00100000:2.0:1789760795.571482:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733813802694 time 733831773966 state 0x0 ref 1 00000100:00100000:2.0:1789760795.571500:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.571572:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75677696, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24178 00010000:00010000:2.0:1789760795.571585:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.571689:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.572093:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.572105:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.572248:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.581856:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985784 is committed 00002000:00010000:2.0:1789760795.582237:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75677696 -> 75681792 00002000:00010000:2.0:1789760795.582244:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147832 -> 147840 00010000:00010000:2.0:1789760795.582262:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582277:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582288:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582296:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.582302:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582313:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582805:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.582816:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75677696->75681791] (req 75677696->75681791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.582953:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11451us (12491us total) trans 4294985784 rc 0/0 00000100:00100000:2.0:1789760795.582968:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18487 00000100:00100000:2.0:1789760795.582980:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733813802694 time 733831773966 state 0x2 ref 0 00000100:00100000:2.0:1789760795.585607:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.585799:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596288 00000100:00100000:1.0:1789760795.585813:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596288 00000100:00100000:1.0:1789760795.585888:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733813802694 time 733831773966 state 0x0 ref 1 00000100:00100000:1.0:1789760795.585907:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733832034382 time 733831773966 state 0x1 ref 1 00000100:00100000:1.0:1789760795.585941:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733832034382 time 733846232475 state 0x0 ref 1 00000100:00100000:1.0:1789760795.585954:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.586024:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75681792, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24180 00010000:00010000:1.0:1789760795.586036:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.586056:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.586062:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.586070:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.586087:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.595024:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985785 is committed 00002000:00010000:1.0:1789760795.596110:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75681792 -> 75685888 00002000:00010000:1.0:1789760795.596119:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147840 -> 147848 00010000:00010000:1.0:1789760795.596138:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596153:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596162:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596171:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.596177:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596188:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596212:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.596221:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f84b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75681792->75685887] (req 75681792->75685887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.596487:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10528us (10899us total) trans 4294985785 rc 0/0 00000100:00100000:1.0:1789760795.596501:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18488 00000100:00100000:1.0:1789760795.596512:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733832034382 time 733846232475 state 0x2 ref 0 00000100:00100000:0.0:1789760795.608762:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.609009:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596416 00000100:00100000:2.0:1789760795.609022:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596416 00000100:00100000:2.0:1789760795.609097:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733832034382 time 733846232475 state 0x0 ref 1 00000100:00100000:2.0:1789760795.609116:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733846492891 time 733846232475 state 0x1 ref 1 00000100:00100000:2.0:1789760795.609203:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733846492891 time 733869494477 state 0x0 ref 1 00000100:00100000:2.0:1789760795.609215:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565596416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.609299:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75685888, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24188 00010000:00010000:2.0:1789760795.609311:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.609339:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.609345:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.609353:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.609373:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.616005:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985786 is committed 00002000:00010000:2.0:1789760795.616189:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75685888 -> 75689984 00002000:00010000:2.0:1789760795.616195:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147848 -> 147856 00010000:00010000:2.0:1789760795.616214:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616230:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616253:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616263:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.616268:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616834:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616866:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.616875:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674f852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75685888->75689983] (req 75685888->75689983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.617059:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565596416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7838us (8305us total) trans 4294985786 rc 0/0 00000100:00100000:2.0:1789760795.617072:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18489 00000100:00100000:2.0:1789760795.617084:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733846492891 time 733869494477 state 0x2 ref 0 00000100:00100000:3.0:1789760795.621779:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.621929:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596544 00000100:00100000:2.0:1789760795.621950:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596544 00000100:00100000:2.0:1789760795.622024:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733846492891 time 733869494477 state 0x0 ref 1 00000100:00100000:2.0:1789760795.622043:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733869754893 time 733869494477 state 0x1 ref 1 00000100:00100000:2.0:1789760795.622076:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733869754893 time 733882367637 state 0x0 ref 1 00000100:00100000:2.0:1789760795.622090:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.622151:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75689984, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24190 00010000:00010000:2.0:1789760795.622163:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.622181:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789760795.622186:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.622194:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.622212:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.630433:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985787 is committed 00002000:00010000:0.0:1789760795.632541:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75689984 -> 75694080 00002000:00010000:0.0:1789760795.632555:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147856 -> 147864 00010000:00010000:0.0:1789760795.632573:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632588:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632607:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632622:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.632628:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632638:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632795:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.632806:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f859 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75689984->75694079] (req 75689984->75694079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.633010:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10911us (11235us total) trans 4294985787 rc 0/0 00000100:00100000:0.0:1789760795.633024:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18490 00000100:00100000:0.0:1789760795.633036:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733869754893 time 733882367637 state 0x2 ref 0 00000100:00100000:0.0:1789760795.639895:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.640001:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596672 00000100:00100000:1.0:1789760795.640013:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596672 00000100:00100000:1.0:1789760795.640088:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733869754893 time 733882367637 state 0x0 ref 1 00000100:00100000:1.0:1789760795.640109:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733882628053 time 733882367637 state 0x1 ref 1 00000100:00100000:1.0:1789760795.640149:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733882628053 time 733900441599 state 0x0 ref 1 00000100:00100000:1.0:1789760795.640164:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.640230:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75694080, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24198 00010000:00010000:1.0:1789760795.640242:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.640263:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.640269:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.640276:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.640291:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.650037:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985788 is committed 00002000:00010000:1.0:1789760795.650184:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75694080 -> 75698176 00002000:00010000:1.0:1789760795.650189:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147864 -> 147872 00010000:00010000:1.0:1789760795.650206:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650227:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650238:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650247:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.650252:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650262:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650285:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.650294:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75694080->75698175] (req 75694080->75698175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.650417:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10249us (10532us total) trans 4294985788 rc 0/0 00000100:00100000:1.0:1789760795.650429:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18491 00000100:00100000:1.0:1789760795.650440:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733882628053 time 733900441599 state 0x2 ref 0 00000100:00100000:2.0:1789760795.655215:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.657444:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596800 00000100:00100000:0.0:1789760795.657468:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596800 00000100:00100000:0.0:1789760795.657559:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733882628053 time 733900441599 state 0x0 ref 1 00000100:00100000:0.0:1789760795.657581:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733900702015 time 733900441599 state 0x1 ref 1 00000100:00100000:0.0:1789760795.657632:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733900702015 time 733917923910 state 0x0 ref 1 00000100:00100000:0.0:1789760795.657648:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.657735:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75698176, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241a0 00010000:00010000:0.0:1789760795.657747:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.657769:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.657774:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.657782:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.657799:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.664117:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985789 is committed 00002000:00010000:0.0:1789760795.664524:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75698176 -> 75702272 00002000:00010000:0.0:1789760795.664531:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147872 -> 147880 00010000:00010000:0.0:1789760795.664548:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664564:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664575:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664584:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.664590:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664861:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664891:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.664900:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75698176->75702271] (req 75698176->75702271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.665211:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565596800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7557us (10004us total) trans 4294985789 rc 0/0 00000100:00100000:0.0:1789760795.665225:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18492 00000100:00100000:0.0:1789760795.665237:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733900702015 time 733917923910 state 0x2 ref 0 00000100:00100000:1.0:1789760795.669781:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.669898:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565596928 00000100:00100000:0.0:1789760795.669914:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565596928 00000100:00100000:0.0:1789760795.670001:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733900702015 time 733917923910 state 0x0 ref 1 00000100:00100000:0.0:1789760795.670020:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733918184326 time 733917923910 state 0x1 ref 1 00000100:00100000:0.0:1789760795.670059:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733918184326 time 733930350812 state 0x0 ref 1 00000100:00100000:0.0:1789760795.670075:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.670147:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75702272, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241a8 00010000:00010000:0.0:1789760795.670159:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.670180:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.670185:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.670193:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.670211:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.675831:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985790 is committed 00002000:00010000:0.0:1789760795.676121:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75702272 -> 75706368 00002000:00010000:0.0:1789760795.676128:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147880 -> 147888 00010000:00010000:0.0:1789760795.676149:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676166:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676186:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676197:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.676203:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676215:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676244:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.676253:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f86e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75702272->75706367] (req 75702272->75706367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.676495:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565596928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6415us (6722us total) trans 4294985790 rc 0/0 00000100:00100000:0.0:1789760795.676508:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18493 00000100:00100000:0.0:1789760795.676520:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733918184326 time 733930350812 state 0x2 ref 0 00000100:00100000:2.0:1789760795.685142:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.685319:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597056 00000100:00100000:1.0:1789760795.685341:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597056 00000100:00100000:1.0:1789760795.685424:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733918184326 time 733930350812 state 0x0 ref 1 00000100:00100000:1.0:1789760795.685444:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733930611228 time 733930350812 state 0x1 ref 1 00000100:00100000:1.0:1789760795.685478:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733930611228 time 733945769663 state 0x0 ref 1 00000100:00100000:1.0:1789760795.685492:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565597056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.685561:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75706368, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241b0 00010000:00010000:1.0:1789760795.685574:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.685610:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.685616:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.685625:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.685644:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.695755:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985791 is committed 00002000:00010000:1.0:1789760795.695990:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75706368 -> 75710464 00002000:00010000:1.0:1789760795.695997:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147888 -> 147896 00010000:00010000:1.0:1789760795.696017:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696033:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696045:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696053:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.696060:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696071:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696096:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.696106:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75706368->75710463] (req 75706368->75710463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.696275:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565597056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10778us (11143us total) trans 4294985791 rc 0/0 00000100:00100000:1.0:1789760795.696288:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18494 00000100:00100000:1.0:1789760795.696300:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733930611228 time 733945769663 state 0x2 ref 0 00000100:00100000:2.0:1789760795.707055:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.709016:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597184 00000100:00100000:0.0:1789760795.709036:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597184 00000100:00100000:0.0:1789760795.709124:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733930611228 time 733945769663 state 0x0 ref 1 00000100:00100000:0.0:1789760795.709144:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733946030079 time 733945769663 state 0x1 ref 1 00000100:00100000:0.0:1789760795.709185:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733946030079 time 733969476118 state 0x0 ref 1 00000100:00100000:0.0:1789760795.709201:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565597184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.709267:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75710464, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241b8 00010000:00010000:0.0:1789760795.709279:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.709299:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.709305:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.709313:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.709537:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.715611:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985792 is committed 00002000:00010000:0.0:1789760795.715892:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75710464 -> 75714560 00002000:00010000:0.0:1789760795.715899:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147896 -> 147904 00010000:00010000:0.0:1789760795.715916:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.715931:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.715994:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.716004:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.716009:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.716020:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.716051:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.716065:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674f87c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75710464->75714559] (req 75710464->75714559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.716226:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565597184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7021us (9178us total) trans 4294985792 rc 0/0 00000100:00100000:0.0:1789760795.716238:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18495 00000100:00100000:0.0:1789760795.716251:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733946030079 time 733969476118 state 0x2 ref 0 00000100:00100000:2.0:1789760795.719038:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.719488:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597312 00000100:00100000:0.0:1789760795.719507:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597312 00000100:00100000:0.0:1789760795.719586:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733946030079 time 733969476118 state 0x0 ref 1 00000100:00100000:0.0:1789760795.719615:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733969736534 time 733969476118 state 0x1 ref 1 00000100:00100000:0.0:1789760795.719658:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733969736534 time 733979949798 state 0x0 ref 1 00000100:00100000:0.0:1789760795.719672:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565597312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.720860:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75714560, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241c0 00010000:00010000:0.0:1789760795.720876:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.720894:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1789760795.720898:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.720905:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.720925:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.726898:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985793 is committed 00002000:00010000:0.0:1789760795.727150:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75714560 -> 75718656 00002000:00010000:0.0:1789760795.727156:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147904 -> 147912 00010000:00010000:0.0:1789760795.727175:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727190:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727201:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727209:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.727214:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727224:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727249:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.727257:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75714560->75718655] (req 75714560->75718655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.727433:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565597312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7757us (8402us total) trans 4294985793 rc 0/0 00000100:00100000:0.0:1789760795.727445:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18496 00000100:00100000:0.0:1789760795.727458:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733969736534 time 733979949798 state 0x2 ref 0 00000100:00100000:2.0:1789760795.733251:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.733382:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597440 00000100:00100000:1.0:1789760795.733396:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597440 00000100:00100000:1.0:1789760795.733475:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733969736534 time 733979949798 state 0x0 ref 1 00000100:00100000:1.0:1789760795.733493:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733980210214 time 733979949798 state 0x1 ref 1 00000100:00100000:1.0:1789760795.733981:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733980210214 time 733994268848 state 0x0 ref 1 00000100:00100000:1.0:1789760795.733999:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760795.734062:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75718656, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241c8 00010000:00010000:1.0:1789760795.734072:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.734093:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1789760795.734098:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.734106:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.734122:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.744849:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985794 is committed 00002000:00010000:1.0:1789760795.745049:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75718656 -> 75722752 00002000:00010000:1.0:1789760795.745110:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147912 -> 147920 00010000:00010000:1.0:1789760795.745131:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745149:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745159:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745172:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760795.745177:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745187:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745214:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.745223:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c91450/0x721975f94674f88a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75718656->75722751] (req 75718656->75722751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.745388:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11386us (12146us total) trans 4294985794 rc 0/0 00000100:00100000:1.0:1789760795.745401:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18497 00000100:00100000:1.0:1789760795.745414:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733980210214 time 733994268848 state 0x2 ref 0 00000100:00100000:2.0:1789760795.757151:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.757260:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597568 00000100:00100000:0.0:1789760795.757270:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597568 00000100:00100000:0.0:1789760795.757325:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733980210214 time 733994268848 state 0x0 ref 1 00000100:00100000:0.0:1789760795.757342:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733994529264 time 733994268848 state 0x1 ref 1 00000100:00100000:0.0:1789760795.757373:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733994529264 time 734017664736 state 0x0 ref 1 00000100:00100000:0.0:1789760795.757388:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565597568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.757440:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75722752, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241d0 00010000:00010000:0.0:1789760795.757449:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.757465:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.757470:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.757476:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.757491:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.764198:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985795 is committed 00002000:00010000:0.0:1789760795.764360:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75722752 -> 75726848 00002000:00010000:0.0:1789760795.764369:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147920 -> 147928 00010000:00010000:0.0:1789760795.764383:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764398:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764408:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764415:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.764420:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764429:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764449:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.764458:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f891 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75722752->75726847] (req 75722752->75726847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.764616:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565597568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7226us (7470us total) trans 4294985795 rc 0/0 00000100:00100000:0.0:1789760795.764628:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18498 00000100:00100000:0.0:1789760795.764637:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733994529264 time 734017664736 state 0x2 ref 0 00000100:00100000:2.0:1789760795.773088:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.773978:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597696 00000100:00100000:0.0:1789760795.773989:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597696 00000100:00100000:0.0:1789760795.774049:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 733994529264 time 734017664736 state 0x0 ref 1 00000100:00100000:0.0:1789760795.774064:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734017925152 time 734017664736 state 0x1 ref 1 00000100:00100000:0.0:1789760795.774155:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734017925152 time 734034445718 state 0x0 ref 1 00000100:00100000:0.0:1789760795.774168:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.774220:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75726848, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241d8 00010000:00010000:0.0:1789760795.774230:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.774244:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.774249:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.774255:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.774269:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.779213:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985796 is committed 00002000:00010000:0.0:1789760795.779328:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75726848 -> 75730944 00002000:00010000:0.0:1789760795.779333:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147928 -> 147936 00010000:00010000:0.0:1789760795.779347:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779359:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779368:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779375:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.779380:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779389:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779406:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.779413:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75726848->75730943] (req 75726848->75730943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.779502:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5333us (6419us total) trans 4294985796 rc 0/0 00000100:00100000:0.0:1789760795.779512:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18499 00000100:00100000:0.0:1789760795.779521:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734017925152 time 734034445718 state 0x2 ref 0 00000100:00100000:2.0:1789760795.789451:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760795.789573:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597824 00000100:00100000:1.0:1789760795.789585:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597824 00000100:00100000:1.0:1789760795.789666:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734017925152 time 734034445718 state 0x0 ref 1 00000100:00100000:1.0:1789760795.789685:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734034706134 time 734034445718 state 0x1 ref 1 00000100:00100000:3.0:1789760795.789863:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734034706134 time 734050151657 state 0x0 ref 1 00000100:00100000:2.0:1789760795.790143:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565597824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.790214:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75730944, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241e0 00010000:00010000:2.0:1789760795.790227:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.790246:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760795.790250:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.790258:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.790274:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.801780:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985797 is committed 00002000:00010000:2.0:1789760795.801979:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75730944 -> 75735040 00002000:00010000:2.0:1789760795.801984:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147936 -> 147944 00010000:00010000:2.0:1789760795.802001:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802015:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802024:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802032:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.802038:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802048:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802073:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.802082:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674f89f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75730944->75735039] (req 75730944->75735039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.802206:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565597824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12152us (12763us total) trans 4294985797 rc 0/0 00000100:00100000:2.0:1789760795.802219:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18500 00000100:00100000:2.0:1789760795.802230:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734034706134 time 734050151657 state 0x2 ref 0 00000100:00100000:2.0:1789760795.809311:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.809735:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565597952 00000100:00100000:0.0:1789760795.809749:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565597952 00000100:00100000:0.0:1789760795.809830:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734034706134 time 734050151657 state 0x0 ref 1 00000100:00100000:0.0:1789760795.809852:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734050412073 time 734050151657 state 0x1 ref 1 00000100:00100000:0.0:1789760795.809898:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734050412073 time 734070188498 state 0x0 ref 1 00000100:00100000:0.0:1789760795.809914:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.809992:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75735040, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241e8 00010000:00010000:0.0:1789760795.810005:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.810026:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.810032:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.810039:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.810055:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.818956:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985798 is committed 00002000:00010000:0.0:1789760795.819200:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75735040 -> 75739136 00002000:00010000:0.0:1789760795.819205:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147944 -> 147952 00010000:00010000:0.0:1789760795.819220:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819239:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819247:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819253:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.819258:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819328:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819353:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.819361:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75735040->75739135] (req 75735040->75739135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.819466:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565597952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9550us (10163us total) trans 4294985798 rc 0/0 00000100:00100000:0.0:1789760795.819478:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18501 00000100:00100000:0.0:1789760795.819487:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734050412073 time 734070188498 state 0x2 ref 0 00000100:00100000:1.0:1789760795.828417:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.828512:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598080 00000100:00100000:0.0:1789760795.828522:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598080 00000100:00100000:0.0:1789760795.828575:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734050412073 time 734070188498 state 0x0 ref 1 00000100:00100000:0.0:1789760795.828590:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734070448914 time 734070188498 state 0x1 ref 1 00000100:00100000:0.0:1789760795.828630:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734070448914 time 734088922053 state 0x0 ref 1 00000100:00100000:0.0:1789760795.828654:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565598080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.828701:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75739136, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241f0 00010000:00010000:0.0:1789760795.828753:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.828769:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.828773:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.828779:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.828793:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.839432:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985799 is committed 00002000:00010000:2.0:1789760795.839754:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75739136 -> 75743232 00002000:00010000:2.0:1789760795.839761:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147952 -> 147960 00010000:00010000:2.0:1789760795.839779:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839795:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839805:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839820:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760795.839825:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839836:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839860:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.839868:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674f8ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75739136->75743231] (req 75739136->75743231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.840160:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565598080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11501us (11745us total) trans 4294985799 rc 0/0 00000100:00100000:2.0:1789760795.840174:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18502 00000100:00100000:2.0:1789760795.840187:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734070448914 time 734088922053 state 0x2 ref 0 00000100:00100000:2.0:1789760795.844871:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.845234:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598208 00000100:00100000:0.0:1789760795.845248:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598208 00000100:00100000:0.0:1789760795.845335:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734070448914 time 734088922053 state 0x0 ref 1 00000100:00100000:0.0:1789760795.845354:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734089182469 time 734088922053 state 0x1 ref 1 00000100:00100000:0.0:1789760795.845629:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734089182469 time 734105918986 state 0x0 ref 1 00000100:00100000:0.0:1789760795.845741:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565598208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.845807:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75743232, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x241f8 00010000:00010000:0.0:1789760795.845819:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.845838:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.845843:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.845853:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.845868:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.852865:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760795.855094:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985800 is committed 00002000:00010000:0.0:1789760795.855270:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75743232 -> 75747328 00002000:00010000:0.0:1789760795.855277:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147960 -> 147968 00010000:00010000:0.0:1789760795.855296:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855312:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855609:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855622:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.855628:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855638:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855664:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.855672:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75743232->75747327] (req 75743232->75747327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.857839:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565598208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12086us (12964us total) trans 4294985800 rc 0/0 00000100:00100000:0.0:1789760795.857857:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18503 00000100:00100000:0.0:1789760795.857870:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734089182469 time 734105918986 state 0x2 ref 0 00000100:00100000:0.0:1789760795.868359:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760795.868458:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598336 00000100:00100000:2.0:1789760795.868472:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598336 00000100:00100000:2.0:1789760795.868537:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734089182469 time 734105918986 state 0x0 ref 1 00000100:00100000:2.0:1789760795.868553:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734106179402 time 734105918986 state 0x1 ref 1 00000100:00100000:2.0:1789760795.868588:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734106179402 time 734128879574 state 0x0 ref 1 00000100:00100000:2.0:1789760795.868612:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565598336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760795.868680:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75747328, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24200 00010000:00010000:2.0:1789760795.868690:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.868745:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760795.868751:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.868758:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.868775:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.878925:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985801 is committed 00002000:00010000:0.0:1789760795.883889:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75747328 -> 75751424 00002000:00010000:0.0:1789760795.883903:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147968 -> 147976 00010000:00010000:0.0:1789760795.883920:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.883937:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.884018:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.884028:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.884033:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.884044:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.884069:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.884078:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce18690/0x721975f94674f8bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75747328->75751423] (req 75747328->75751423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.884217:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565598336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15600us (15866us total) trans 4294985801 rc 0/0 00000100:00100000:0.0:1789760795.884229:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18504 00000100:00100000:0.0:1789760795.884242:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734106179402 time 734128879574 state 0x2 ref 0 00000100:00100000:2.0:1789760795.896613:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.896760:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598464 00000100:00100000:0.0:1789760795.896774:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598464 00000100:00100000:0.0:1789760795.896856:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734106179402 time 734128879574 state 0x0 ref 1 00000100:00100000:0.0:1789760795.896875:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734129139990 time 734128879574 state 0x1 ref 1 00000100:00100000:0.0:1789760795.896913:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734129139990 time 734157204887 state 0x0 ref 1 00000100:00100000:0.0:1789760795.896931:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565598464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.897007:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75751424, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24208 00010000:00010000:0.0:1789760795.897020:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.897040:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.897046:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.897053:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.897071:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.903231:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985802 is committed 00002000:00010000:0.0:1789760795.903369:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75751424 -> 75755520 00002000:00010000:0.0:1789760795.903375:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147976 -> 147984 00010000:00010000:0.0:1789760795.903393:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903407:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903418:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903425:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.903432:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903441:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903466:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.903473:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75751424->75755519] (req 75751424->75755519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.903609:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565598464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6662us (7012us total) trans 4294985802 rc 0/0 00000100:00100000:0.0:1789760795.903622:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18505 00000100:00100000:0.0:1789760795.903634:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734129139990 time 734157204887 state 0x2 ref 0 00000100:00100000:2.0:1789760795.908657:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.908777:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598592 00000100:00100000:0.0:1789760795.908791:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598592 00000100:00100000:0.0:1789760795.908868:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734129139990 time 734157204887 state 0x0 ref 1 00000100:00100000:0.0:1789760795.908888:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734157465303 time 734157204887 state 0x1 ref 1 00000100:00100000:0.0:1789760795.908915:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734157465303 time 734169207864 state 0x0 ref 1 00000100:00100000:0.0:1789760795.908928:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565598592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.909011:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75755520, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24210 00010000:00010000:0.0:1789760795.909024:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.909045:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.909050:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.909057:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.909074:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.915289:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985803 is committed 00002000:00010000:0.0:1789760795.915445:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75755520 -> 75759616 00002000:00010000:0.0:1789760795.915452:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147984 -> 147992 00010000:00010000:0.0:1789760795.915470:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.915485:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.915495:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.915504:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.915509:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.915520:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.917858:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.917884:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75755520->75759615] (req 75755520->75759615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.918685:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565598592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9747us (10030us total) trans 4294985803 rc 0/0 00000100:00100000:0.0:1789760795.918701:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18506 00000100:00100000:0.0:1789760795.918756:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734157465303 time 734169207864 state 0x2 ref 0 00000100:00100000:2.0:1789760795.941821:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.942768:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598720 00000100:00100000:0.0:1789760795.942785:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598720 00000100:00100000:0.0:1789760795.942879:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734157465303 time 734169207864 state 0x0 ref 1 00000100:00100000:0.0:1789760795.942899:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734169468280 time 734169207864 state 0x1 ref 1 00000100:00100000:0.0:1789760795.942942:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734169468280 time 734203233699 state 0x0 ref 1 00000100:00100000:0.0:1789760795.942958:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565598720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.943045:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75759616, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x24218 00010000:00010000:0.0:1789760795.943057:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.943077:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.943084:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.943092:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.943110:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.951241:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985804 is committed 00002000:00010000:0.0:1789760795.952268:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75759616 -> 75763712 00002000:00010000:0.0:1789760795.952275:0:6957:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760795 -> 1789760796 00002000:00010000:0.0:1789760795.952277:0:6957:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760795 -> 1789760796 00002000:00010000:0.0:1789760795.952280:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147992 -> 148000 00010000:00010000:0.0:1789760795.952294:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952307:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952315:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952322:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.952327:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952335:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952360:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.952367:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75759616->75763711] (req 75759616->75763711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.952508:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565598720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9549us (10700us total) trans 4294985804 rc 0/0 00000100:00100000:0.0:1789760795.952527:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18507 00000100:00100000:0.0:1789760795.952537:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734169468280 time 734203233699 state 0x2 ref 0 00000100:00100000:2.0:1789760795.959917:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.962118:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598848 00000100:00100000:0.0:1789760795.962133:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598848 00000100:00100000:0.0:1789760795.962196:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734169468280 time 734203233699 state 0x0 ref 1 00000100:00100000:0.0:1789760795.962212:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734203494115 time 734203233699 state 0x1 ref 1 00000100:00100000:0.0:1789760795.962237:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734203494115 time 734222529139 state 0x0 ref 1 00000100:00100000:0.0:1789760795.962251:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565598848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.962299:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75763712, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24220 00010000:00010000:0.0:1789760795.962308:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.962324:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.962330:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.962335:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.962349:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.971135:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985805 is committed 00002000:00010000:0.0:1789760795.971293:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75763712 -> 75767808 00002000:00010000:0.0:1789760795.971300:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148000 -> 148008 00010000:00010000:0.0:1789760795.971319:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971335:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971345:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971353:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.971359:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971470:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971501:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.971514:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75763712->75767807] (req 75763712->75767807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.971878:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565598848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9622us (11962us total) trans 4294985805 rc 0/0 00000100:00100000:0.0:1789760795.971891:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18508 00000100:00100000:0.0:1789760795.971902:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734203494115 time 734222529139 state 0x2 ref 0 00000100:00100000:2.0:1789760795.980727:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.980993:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565598976 00000100:00100000:0.0:1789760795.981009:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565598976 00000100:00100000:0.0:1789760795.981094:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734203494115 time 734222529139 state 0x0 ref 1 00000100:00100000:0.0:1789760795.981113:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734222789555 time 734222529139 state 0x1 ref 1 00000100:00100000:0.0:1789760795.981197:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734222789555 time 734241487675 state 0x0 ref 1 00000100:00100000:0.0:1789760795.981213:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565598976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.981278:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75767808, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24228 00010000:00010000:0.0:1789760795.981289:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.981308:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.981313:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.981321:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.981343:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760795.987035:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985806 is committed 00002000:00010000:0.0:1789760795.989909:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75767808 -> 75771904 00002000:00010000:0.0:1789760795.989922:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148008 -> 148016 00010000:00010000:0.0:1789760795.989941:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.989956:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.989966:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.989973:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760795.990176:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.990188:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.990214:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.990223:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75767808->75771903] (req 75767808->75771903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.990356:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565598976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9139us (9654us total) trans 4294985806 rc 0/0 00000100:00100000:0.0:1789760795.990370:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18509 00000100:00100000:0.0:1789760795.990381:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734222789555 time 734241487675 state 0x2 ref 0 00000100:00100000:3.0:1789760795.993933:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760795.994203:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599104 00000100:00100000:0.0:1789760795.994215:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599104 00000100:00100000:0.0:1789760795.994397:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734222789555 time 734241487675 state 0x0 ref 1 00000100:00100000:0.0:1789760795.994415:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734241748091 time 734241487675 state 0x1 ref 1 00000100:00100000:0.0:1789760795.994447:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734241748091 time 734254738404 state 0x0 ref 1 00000100:00100000:0.0:1789760795.994461:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760795.994520:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75771904, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24230 00010000:00010000:0.0:1789760795.994531:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.994548:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760795.994552:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.994559:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.994574:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.002280:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985807 is committed 00002000:00010000:0.0:1789760796.003082:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75771904 -> 75776000 00002000:00010000:0.0:1789760796.003090:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148016 -> 148024 00010000:00010000:0.0:1789760796.003107:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003124:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003134:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003143:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.003157:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003169:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003194:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.003203:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75771904->75775999] (req 75771904->75775999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.003333:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8867us (9405us total) trans 4294985807 rc 0/0 00000100:00100000:0.0:1789760796.003347:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18510 00000100:00100000:0.0:1789760796.003359:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734241748091 time 734254738404 state 0x2 ref 0 00000100:00100000:3.0:1789760796.016819:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.017011:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599232 00000100:00100000:0.0:1789760796.017026:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599232 00000100:00100000:0.0:1789760796.017126:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734241748091 time 734254738404 state 0x0 ref 1 00000100:00100000:0.0:1789760796.017156:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734254998820 time 734254738404 state 0x1 ref 1 00000100:00100000:0.0:1789760796.017195:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734254998820 time 734277487265 state 0x0 ref 1 00000100:00100000:0.0:1789760796.017213:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.017301:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75776000, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24238 00010000:00010000:0.0:1789760796.017315:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.017339:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.017345:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.017358:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.017377:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760796.018240:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789760796.034787:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985808 is committed 00002000:00010000:0.0:1789760796.034932:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75776000 -> 75780096 00002000:00010000:0.0:1789760796.034949:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148024 -> 148032 00010000:00010000:0.0:1789760796.034971:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.034986:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.034995:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.035003:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.035008:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.035018:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.035042:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.035051:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75776000->75780095] (req 75776000->75780095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.035177:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599232:12345-192.168.203.47@tcp:4:dd.0 Request processed in 17963us (18375us total) trans 4294985808 rc 0/0 00000100:00100000:0.0:1789760796.035190:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18511 00000100:00100000:0.0:1789760796.035202:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734254998820 time 734277487265 state 0x2 ref 0 00000100:00100000:2.0:1789760796.038480:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.038680:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599360 00000100:00100000:0.0:1789760796.038693:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599360 00000100:00100000:0.0:1789760796.038796:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734254998820 time 734277487265 state 0x0 ref 1 00000100:00100000:0.0:1789760796.038816:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734277747681 time 734277487265 state 0x1 ref 1 00000100:00100000:0.0:1789760796.038854:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734277747681 time 734299145860 state 0x0 ref 1 00000100:00100000:0.0:1789760796.038868:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565599360:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.038931:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75780096, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24240 00010000:00010000:0.0:1789760796.038942:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.038961:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.038966:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.038974:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.039518:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.046587:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985809 is committed 00002000:00010000:2.0:1789760796.046753:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75780096 -> 75784192 00002000:00010000:2.0:1789760796.046759:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148032 -> 148040 00010000:00010000:2.0:1789760796.046776:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046791:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046802:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046810:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.046816:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046826:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046851:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.046861:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674f8f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75780096->75784191] (req 75780096->75784191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.049230:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565599360:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10348us (10749us total) trans 4294985809 rc 0/0 00000100:00100000:2.0:1789760796.049254:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18512 00000100:00100000:2.0:1789760796.049267:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734277747681 time 734299145860 state 0x2 ref 0 00000100:00100000:2.0:1789760796.053362:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.053459:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599488 00000100:00100000:0.0:1789760796.053474:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599488 00000100:00100000:0.0:1789760796.053552:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734277747681 time 734299145860 state 0x0 ref 1 00000100:00100000:0.0:1789760796.053572:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734299406276 time 734299145860 state 0x1 ref 1 00000100:00100000:0.0:1789760796.053610:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734299406276 time 734313901719 state 0x0 ref 1 00000100:00100000:0.0:1789760796.053623:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565599488:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.053688:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75784192, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24248 00010000:00010000:0.0:1789760796.053700:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.053807:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.053812:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.053819:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.053834:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.063723:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985810 is committed 00002000:00010000:1.0:1789760796.063859:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75784192 -> 75788288 00002000:00010000:1.0:1789760796.063866:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148040 -> 148048 00010000:00010000:1.0:1789760796.063884:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063899:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063909:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063917:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.063923:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063933:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063959:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.063968:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e388d601/0x721975f94674f8fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75784192->75788287] (req 75784192->75788287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.064240:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565599488:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10612us (10883us total) trans 4294985810 rc 0/0 00000100:00100000:1.0:1789760796.064254:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18513 00000100:00100000:1.0:1789760796.064266:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734299406276 time 734313901719 state 0x2 ref 0 00000100:00100000:3.0:1789760796.069500:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.069623:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599616 00000100:00100000:0.0:1789760796.069636:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599616 00000100:00100000:0.0:1789760796.069753:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734299406276 time 734313901719 state 0x0 ref 1 00000100:00100000:0.0:1789760796.069773:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734314162135 time 734313901719 state 0x1 ref 1 00000100:00100000:0.0:1789760796.069810:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734314162135 time 734330101073 state 0x0 ref 1 00000100:00100000:0.0:1789760796.069826:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599616:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.069899:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75788288, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24250 00010000:00010000:0.0:1789760796.069910:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.069931:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.069936:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.069944:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.069961:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.076920:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985811 is committed 00002000:00010000:0.0:1789760796.077105:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75788288 -> 75792384 00002000:00010000:0.0:1789760796.077111:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148048 -> 148056 00010000:00010000:0.0:1789760796.077126:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077140:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077150:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077158:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.077164:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077181:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077205:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.077213:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f901 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75788288->75792383] (req 75788288->75792383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.077327:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599616:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7499us (7836us total) trans 4294985811 rc 0/0 00000100:00100000:0.0:1789760796.077338:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18514 00000100:00100000:0.0:1789760796.077350:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734314162135 time 734330101073 state 0x2 ref 0 00000100:00100000:2.0:1789760796.081343:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.081497:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599744 00000100:00100000:0.0:1789760796.081509:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599744 00000100:00100000:0.0:1789760796.081656:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734314162135 time 734330101073 state 0x0 ref 1 00000100:00100000:0.0:1789760796.081677:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734330361489 time 734330101073 state 0x1 ref 1 00000100:00100000:0.0:1789760796.081872:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734330361489 time 734342162264 state 0x0 ref 1 00000100:00100000:0.0:1789760796.081887:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599744:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.082109:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75792384, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24258 00010000:00010000:0.0:1789760796.082121:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.082141:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.082147:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.082155:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.082171:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.088218:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985812 is committed 00002000:00010000:1.0:1789760796.088362:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75792384 -> 75796480 00002000:00010000:1.0:1789760796.088367:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148056 -> 148064 00010000:00010000:1.0:1789760796.088385:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088401:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088411:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088419:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.088424:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088435:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088460:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.088468:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674f908 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75792384->75796479] (req 75792384->75796479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.088648:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565599744:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6757us (7310us total) trans 4294985812 rc 0/0 00000100:00100000:1.0:1789760796.088661:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18515 00000100:00100000:1.0:1789760796.088673:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734330361489 time 734342162264 state 0x2 ref 0 00000100:00100000:2.0:1789760796.096330:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.096434:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565599872 00000100:00100000:1.0:1789760796.096446:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565599872 00000100:00100000:1.0:1789760796.096525:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734330361489 time 734342162264 state 0x0 ref 1 00000100:00100000:1.0:1789760796.096544:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734342422680 time 734342162264 state 0x1 ref 1 00000100:00100000:1.0:1789760796.096585:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734342422680 time 734356876599 state 0x0 ref 1 00000100:00100000:1.0:1789760796.096609:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565599872:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.096683:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75796480, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24260 00010000:00010000:1.0:1789760796.096694:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.096757:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.096768:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.096776:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.096797:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.103212:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985813 is committed 00002000:00010000:1.0:1789760796.103349:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75796480 -> 75800576 00002000:00010000:1.0:1789760796.103355:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148064 -> 148072 00010000:00010000:1.0:1789760796.103372:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103386:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103395:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103403:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.103408:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103418:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103441:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.103448:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f90f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75796480->75800575] (req 75796480->75800575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.103620:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565599872:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7017us (7297us total) trans 4294985813 rc 0/0 00000100:00100000:1.0:1789760796.103633:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18516 00000100:00100000:1.0:1789760796.103644:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734342422680 time 734356876599 state 0x2 ref 0 00000100:00100000:1.0:1789760796.112819:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.114672:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600000 00000100:00100000:0.0:1789760796.114692:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600000 00000100:00100000:0.0:1789760796.114896:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734342422680 time 734356876599 state 0x0 ref 1 00000100:00100000:0.0:1789760796.114917:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734357137015 time 734356876599 state 0x1 ref 1 00000100:00100000:0.0:1789760796.115000:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734357137015 time 734375291014 state 0x0 ref 1 00000100:00100000:0.0:1789760796.115016:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600000:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.115081:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75800576, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24268 00010000:00010000:0.0:1789760796.115092:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.115112:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.115117:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.115125:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.115143:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.120145:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985814 is committed 00002000:00010000:0.0:1789760796.120289:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75800576 -> 75804672 00002000:00010000:0.0:1789760796.120295:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148072 -> 148080 00010000:00010000:0.0:1789760796.120313:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120330:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120340:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120349:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.120355:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120366:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120392:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.120401:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674f916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75800576->75804671] (req 75800576->75804671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.120583:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600000:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5563us (7773us total) trans 4294985814 rc 0/0 00000100:00100000:0.0:1789760796.120606:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18517 00000100:00100000:0.0:1789760796.120618:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734357137015 time 734375291014 state 0x2 ref 0 00000100:00100000:2.0:1789760796.127367:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.127819:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600128 00000100:00100000:1.0:1789760796.127835:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600128 00000100:00100000:1.0:1789760796.127913:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734357137015 time 734375291014 state 0x0 ref 1 00000100:00100000:1.0:1789760796.127933:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734375551430 time 734375291014 state 0x1 ref 1 00000100:00100000:1.0:1789760796.128015:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734375551430 time 734388305218 state 0x0 ref 1 00000100:00100000:1.0:1789760796.128029:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600128:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.128093:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75804672, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24270 00010000:00010000:1.0:1789760796.128104:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.128123:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.128128:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.128136:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.128151:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.138246:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985815 is committed 00002000:00010000:0.0:1789760796.138582:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75804672 -> 75808768 00002000:00010000:0.0:1789760796.138589:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148080 -> 148088 00010000:00010000:0.0:1789760796.138616:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138633:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138643:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138652:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.138659:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138669:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138695:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.138728:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d05a5f/0x721975f94674f91d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75804672->75808767] (req 75804672->75808767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.138853:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600128:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10818us (11493us total) trans 4294985815 rc 0/0 00000100:00100000:0.0:1789760796.138867:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18518 00000100:00100000:0.0:1789760796.138880:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734375551430 time 734388305218 state 0x2 ref 0 00000100:00100000:2.0:1789760796.142201:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.142266:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600256 00000100:00100000:1.0:1789760796.142278:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600256 00000100:00100000:1.0:1789760796.142339:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734375551430 time 734388305218 state 0x0 ref 1 00000100:00100000:1.0:1789760796.142353:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734388565634 time 734388305218 state 0x1 ref 1 00000100:00100000:1.0:1789760796.142449:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734388565634 time 734402738838 state 0x0 ref 1 00000100:00100000:1.0:1789760796.142464:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600256:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.142534:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75808768, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24278 00010000:00010000:1.0:1789760796.142546:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.142566:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.142572:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.142580:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.142608:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.148482:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985816 is committed 00002000:00010000:1.0:1789760796.152302:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75808768 -> 75812864 00002000:00010000:1.0:1789760796.152318:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148088 -> 148096 00010000:00010000:1.0:1789760796.152337:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152353:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152371:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152380:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.152386:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152398:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152423:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.152432:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75808768->75812863] (req 75808768->75812863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.152566:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600256:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10098us (10374us total) trans 4294985816 rc 0/0 00000100:00100000:1.0:1789760796.152579:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18519 00000100:00100000:1.0:1789760796.152603:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734388565634 time 734402738838 state 0x2 ref 0 00000100:00100000:0.0:1789760796.158225:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.162232:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600384 00000100:00100000:2.0:1789760796.162252:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600384 00000100:00100000:2.0:1789760796.162342:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734388565634 time 734402738838 state 0x0 ref 1 00000100:00100000:2.0:1789760796.162377:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734402999254 time 734402738838 state 0x1 ref 1 00000100:00100000:1.0:1789760796.162487:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734402999254 time 734422774567 state 0x0 ref 1 00000100:00100000:1.0:1789760796.162506:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600384:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.162572:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75812864, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24280 00010000:00010000:1.0:1789760796.162583:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.162613:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.162619:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.162627:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.162644:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.176374:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985817 is committed 00002000:00010000:0.0:1789760796.181582:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75812864 -> 75816960 00002000:00010000:0.0:1789760796.181605:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148096 -> 148104 00010000:00010000:0.0:1789760796.181625:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181649:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181659:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181667:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.181673:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181683:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181743:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.181753:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a4b0b0/0x721975f94674f92b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75812864->75816959] (req 75812864->75816959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.182259:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600384:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19381us (23743us total) trans 4294985817 rc 0/0 00000100:00100000:0.0:1789760796.182273:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18520 00000100:00100000:0.0:1789760796.182285:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734402999254 time 734422774567 state 0x2 ref 0 00000100:00100000:0.0:1789760796.185419:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.185504:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600512 00000100:00100000:2.0:1789760796.185517:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600512 00000100:00100000:2.0:1789760796.185608:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734402999254 time 734422774567 state 0x0 ref 1 00000100:00100000:2.0:1789760796.185628:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734423034983 time 734422774567 state 0x1 ref 1 00000100:00100000:2.0:1789760796.185657:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734423034983 time 734445948922 state 0x0 ref 1 00000100:00100000:2.0:1789760796.185682:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600512:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.185780:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75816960, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24288 00010000:00010000:2.0:1789760796.185791:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.185812:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.185818:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.185827:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.185844:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.201133:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985818 is committed 00002000:00010000:2.0:1789760796.201850:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75816960 -> 75821056 00002000:00010000:2.0:1789760796.201857:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148104 -> 148112 00010000:00010000:2.0:1789760796.201875:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.201956:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.201967:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.201974:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.201980:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.202089:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.202121:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.202129:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75816960->75821055] (req 75816960->75821055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.205866:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600512:12345-192.168.203.47@tcp:4:dd.0 Request processed in 20167us (20440us total) trans 4294985818 rc 0/0 00000100:00100000:2.0:1789760796.205885:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18521 00000100:00100000:2.0:1789760796.205897:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734423034983 time 734445948922 state 0x2 ref 0 00000100:00100000:2.0:1789760796.213822:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.214113:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600640 00000100:00100000:3.0:1789760796.214125:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600640 00000100:00100000:3.0:1789760796.214208:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734423034983 time 734445948922 state 0x0 ref 1 00000100:00100000:3.0:1789760796.214226:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734446209338 time 734445948922 state 0x1 ref 1 00000100:00100000:3.0:1789760796.214258:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734446209338 time 734474549748 state 0x0 ref 1 00000100:00100000:3.0:1789760796.214271:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600640:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.214333:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75821056, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24290 00010000:00010000:3.0:1789760796.214345:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.214364:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.214369:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.214376:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.214392:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.224379:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985819 is committed 00002000:00010000:3.0:1789760796.224753:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75821056 -> 75825152 00002000:00010000:3.0:1789760796.224759:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148112 -> 148120 00010000:00010000:3.0:1789760796.224777:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224791:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224807:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224815:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.224821:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224831:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224857:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.224866:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f939 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75821056->75825151] (req 75821056->75825151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.225147:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600640:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10715us (11178us total) trans 4294985819 rc 0/0 00000100:00100000:3.0:1789760796.225223:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18522 00000100:00100000:3.0:1789760796.225236:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734446209338 time 734474549748 state 0x2 ref 0 00000100:00100000:0.0:1789760796.230225:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.230331:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600768 00000100:00100000:2.0:1789760796.230344:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600768 00000100:00100000:2.0:1789760796.230414:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734446209338 time 734474549748 state 0x0 ref 1 00000100:00100000:2.0:1789760796.230432:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734474810164 time 734474549748 state 0x1 ref 1 00000100:00100000:2.0:1789760796.230465:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734474810164 time 734490757493 state 0x0 ref 1 00000100:00100000:2.0:1789760796.230478:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600768:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.230552:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75825152, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24298 00010000:00010000:2.0:1789760796.230562:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.230586:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.230590:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.230607:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.230822:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.241148:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985820 is committed 00002000:00010000:2.0:1789760796.241338:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75825152 -> 75829248 00002000:00010000:2.0:1789760796.241344:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148120 -> 148128 00010000:00010000:2.0:1789760796.241362:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241378:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241388:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241397:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.241402:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241411:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241441:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.241450:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f940 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75825152->75829247] (req 75825152->75829247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.241616:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565600768:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11132us (11397us total) trans 4294985820 rc 0/0 00000100:00100000:2.0:1789760796.241629:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18523 00000100:00100000:2.0:1789760796.241641:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734474810164 time 734490757493 state 0x2 ref 0 00000100:00100000:0.0:1789760796.245223:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.245345:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565600896 00000100:00100000:2.0:1789760796.245359:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565600896 00000100:00100000:2.0:1789760796.245431:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734474810164 time 734490757493 state 0x0 ref 1 00000100:00100000:2.0:1789760796.245451:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734491017909 time 734490757493 state 0x1 ref 1 00000100:00100000:2.0:1789760796.245476:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734491017909 time 734505768139 state 0x0 ref 1 00000100:00100000:2.0:1789760796.245490:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600896:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.245568:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75829248, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242a0 00010000:00010000:2.0:1789760796.245579:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.245607:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.245613:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.245621:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.245638:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.252961:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985821 is committed 00002000:00010000:3.0:1789760796.253256:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75829248 -> 75833344 00002000:00010000:3.0:1789760796.253262:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148128 -> 148136 00010000:00010000:3.0:1789760796.253280:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253300:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253310:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253319:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.253324:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253334:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253358:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.253366:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674f947 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75829248->75833343] (req 75829248->75833343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.253540:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565600896:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8036us (8317us total) trans 4294985821 rc 0/0 00000100:00100000:3.0:1789760796.253553:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18524 00000100:00100000:3.0:1789760796.253565:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734491017909 time 734505768139 state 0x2 ref 0 00000100:00100000:0.0:1789760796.257432:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.257538:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601024 00000100:00100000:3.0:1789760796.257553:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601024 00000100:00100000:3.0:1789760796.257636:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734491017909 time 734505768139 state 0x0 ref 1 00000100:00100000:3.0:1789760796.257655:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734506028555 time 734505768139 state 0x1 ref 1 00000100:00100000:3.0:1789760796.257694:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734506028555 time 734517985336 state 0x0 ref 1 00000100:00100000:3.0:1789760796.257751:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565601024:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.257818:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75833344, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242a8 00010000:00010000:3.0:1789760796.257830:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.257849:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.257854:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.257862:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.257879:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.265289:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985822 is committed 00002000:00010000:3.0:1789760796.265504:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75833344 -> 75837440 00002000:00010000:3.0:1789760796.265511:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148136 -> 148144 00010000:00010000:3.0:1789760796.265604:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265621:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265638:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265646:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.265652:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265662:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265688:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.265696:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f94e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75833344->75837439] (req 75833344->75837439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.266133:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565601024:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8378us (8707us total) trans 4294985822 rc 0/0 00000100:00100000:3.0:1789760796.266145:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18525 00000100:00100000:3.0:1789760796.266157:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734506028555 time 734517985336 state 0x2 ref 0 00000100:00100000:0.0:1789760796.270307:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.270454:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601152 00000100:00100000:2.0:1789760796.270468:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601152 00000100:00100000:2.0:1789760796.270549:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734506028555 time 734517985336 state 0x0 ref 1 00000100:00100000:2.0:1789760796.270569:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734518245752 time 734517985336 state 0x1 ref 1 00000100:00100000:2.0:1789760796.270611:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734518245752 time 734530903142 state 0x0 ref 1 00000100:00100000:2.0:1789760796.270626:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565601152:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.270692:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75837440, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242b0 00010000:00010000:2.0:1789760796.270744:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.270767:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.270773:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.270781:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.270798:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.276696:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985823 is committed 00002000:00010000:2.0:1789760796.276914:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75837440 -> 75841536 00002000:00010000:2.0:1789760796.276920:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148144 -> 148152 00010000:00010000:2.0:1789760796.277152:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277171:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277182:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277191:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.277197:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277209:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277235:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.277244:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75837440->75841535] (req 75837440->75841535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.277555:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565601152:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6923us (7255us total) trans 4294985823 rc 0/0 00000100:00100000:2.0:1789760796.277569:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18526 00000100:00100000:2.0:1789760796.277582:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734518245752 time 734530903142 state 0x2 ref 0 00000100:00100000:0.0:1789760796.282198:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.282249:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601280 00000100:00100000:3.0:1789760796.282335:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601280 00000100:00100000:3.0:1789760796.282414:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734518245752 time 734530903142 state 0x0 ref 1 00000100:00100000:3.0:1789760796.282434:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734531163558 time 734530903142 state 0x1 ref 1 00000100:00100000:3.0:1789760796.282474:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734531163558 time 734542764847 state 0x0 ref 1 00000100:00100000:3.0:1789760796.282488:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601280:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.283210:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75841536, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242b8 00010000:00010000:3.0:1789760796.283226:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.283246:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.283251:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.284621:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.284663:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.295900:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985824 is committed 00002000:00010000:3.0:1789760796.296094:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75841536 -> 75845632 00002000:00010000:3.0:1789760796.296101:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148152 -> 148160 00010000:00010000:3.0:1789760796.296119:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296134:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296145:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296159:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.296165:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296175:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296202:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.296211:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f95c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75841536->75845631] (req 75841536->75845631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.296435:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601280:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13944us (14246us total) trans 4294985824 rc 0/0 00000100:00100000:3.0:1789760796.296448:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18527 00000100:00100000:3.0:1789760796.296460:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734531163558 time 734542764847 state 0x2 ref 0 00000100:00100000:0.0:1789760796.305388:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.306833:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601408 00000100:00100000:3.0:1789760796.306852:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601408 00000100:00100000:2.0:1789760796.307082:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734531163558 time 734542764847 state 0x0 ref 1 00000100:00100000:2.0:1789760796.307101:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734543025263 time 734542764847 state 0x1 ref 1 00000100:00100000:2.0:1789760796.307177:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734543025263 time 734567468155 state 0x0 ref 1 00000100:00100000:2.0:1789760796.307205:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565601408:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.307271:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75845632, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242c0 00010000:00010000:2.0:1789760796.307283:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.307313:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.307319:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.307327:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.307343:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.313447:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985825 is committed 00002000:00010000:2.0:1789760796.313605:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75845632 -> 75849728 00002000:00010000:2.0:1789760796.313611:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148160 -> 148168 00010000:00010000:2.0:1789760796.313629:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.313645:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.313656:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.313664:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.313669:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.313679:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.314043:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.314054:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f963 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75845632->75849727] (req 75845632->75849727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.314234:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565601408:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7036us (8849us total) trans 4294985825 rc 0/0 00000100:00100000:2.0:1789760796.314246:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18528 00000100:00100000:2.0:1789760796.314260:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734543025263 time 734567468155 state 0x2 ref 0 00000100:00100000:0.0:1789760796.320243:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.320419:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601536 00000100:00100000:2.0:1789760796.320436:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601536 00000100:00100000:2.0:1789760796.320513:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734543025263 time 734567468155 state 0x0 ref 1 00000100:00100000:2.0:1789760796.320533:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734567728571 time 734567468155 state 0x1 ref 1 00000100:00100000:2.0:1789760796.320572:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734567728571 time 734580863491 state 0x0 ref 1 00000100:00100000:2.0:1789760796.320586:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601536:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.320661:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75849728, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242c8 00010000:00010000:2.0:1789760796.320673:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.320692:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.320698:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.320743:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.320762:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.326808:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985826 is committed 00002000:00010000:2.0:1789760796.326987:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75849728 -> 75853824 00002000:00010000:2.0:1789760796.326994:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148168 -> 148176 00010000:00010000:2.0:1789760796.327012:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327026:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327040:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327049:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.327055:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327065:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327090:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.327097:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f96a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75849728->75853823] (req 75849728->75853823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.327223:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601536:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6632us (6990us total) trans 4294985826 rc 0/0 00000100:00100000:2.0:1789760796.327235:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18529 00000100:00100000:2.0:1789760796.327246:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734567728571 time 734580863491 state 0x2 ref 0 00000100:00100000:0.0:1789760796.330633:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.330849:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601664 00000100:00100000:3.0:1789760796.330863:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601664 00000100:00100000:0.0:1789760796.331022:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734567728571 time 734580863491 state 0x0 ref 1 00000100:00100000:0.0:1789760796.331041:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734581123907 time 734580863491 state 0x1 ref 1 00000100:00100000:0.0:1789760796.331120:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734581123907 time 734591411438 state 0x0 ref 1 00000100:00100000:0.0:1789760796.331135:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601664:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.331198:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75853824, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242d0 00010000:00010000:0.0:1789760796.331209:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.331228:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789760796.331233:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.331240:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.331255:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.337178:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985827 is committed 00002000:00010000:0.0:1789760796.337428:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75853824 -> 75857920 00002000:00010000:0.0:1789760796.337434:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148176 -> 148184 00010000:00010000:0.0:1789760796.337452:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337467:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337476:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337490:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.337497:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337508:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337533:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.337542:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf6112/0x721975f94674f971 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75853824->75857919] (req 75853824->75857919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.337683:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601664:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6543us (7057us total) trans 4294985827 rc 0/0 00000100:00100000:0.0:1789760796.337696:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18530 00000100:00100000:0.0:1789760796.338247:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734581123907 time 734591411438 state 0x2 ref 0 00000100:00100000:0.0:1789760796.345487:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.345662:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601792 00000100:00100000:2.0:1789760796.345676:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601792 00000100:00100000:2.0:1789760796.345783:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734581123907 time 734591411438 state 0x0 ref 1 00000100:00100000:2.0:1789760796.345801:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734591671854 time 734591411438 state 0x1 ref 1 00000100:00100000:2.0:1789760796.345924:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734591671854 time 734606215001 state 0x0 ref 1 00000100:00100000:2.0:1789760796.345949:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601792:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.346010:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75857920, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242d8 00010000:00010000:2.0:1789760796.346021:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.346041:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.346046:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.346055:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.346071:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.352506:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985828 is committed 00002000:00010000:2.0:1789760796.352686:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75857920 -> 75862016 00002000:00010000:2.0:1789760796.352692:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148184 -> 148192 00010000:00010000:2.0:1789760796.352728:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352743:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352752:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352767:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.352773:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352783:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352808:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.352817:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f978 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75857920->75862015] (req 75857920->75862015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.352995:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601792:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7050us (7517us total) trans 4294985828 rc 0/0 00000100:00100000:2.0:1789760796.353008:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18531 00000100:00100000:2.0:1789760796.353019:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734591671854 time 734606215001 state 0x2 ref 0 00000100:00100000:3.0:1789760796.355363:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.355441:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565601920 00000100:00100000:2.0:1789760796.355453:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565601920 00000100:00100000:2.0:1789760796.355520:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734591671854 time 734606215001 state 0x0 ref 1 00000100:00100000:2.0:1789760796.355536:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734606475417 time 734606215001 state 0x1 ref 1 00000100:00100000:2.0:1789760796.355569:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734606475417 time 734615861173 state 0x0 ref 1 00000100:00100000:2.0:1789760796.355585:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601920:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.355652:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75862016, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242e0 00010000:00010000:2.0:1789760796.355663:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.355681:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.355686:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.355692:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.355743:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.361486:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985829 is committed 00002000:00010000:2.0:1789760796.362003:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75862016 -> 75866112 00002000:00010000:2.0:1789760796.362010:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148192 -> 148200 00010000:00010000:2.0:1789760796.362029:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362045:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362055:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362064:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.362070:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362081:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362106:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.362115:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f97f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75862016->75866111] (req 75862016->75866111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.362292:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565601920:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6702us (6934us total) trans 4294985829 rc 0/0 00000100:00100000:2.0:1789760796.362305:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18532 00000100:00100000:2.0:1789760796.362320:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734606475417 time 734615861173 state 0x2 ref 0 00000100:00100000:0.0:1789760796.365620:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.365996:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602048 00000100:00100000:2.0:1789760796.366010:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602048 00000100:00100000:2.0:1789760796.366088:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734606475417 time 734615861173 state 0x0 ref 1 00000100:00100000:2.0:1789760796.366108:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734616121589 time 734615861173 state 0x1 ref 1 00000100:00100000:2.0:1789760796.366190:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734616121589 time 734626480222 state 0x0 ref 1 00000100:00100000:2.0:1789760796.366205:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602048:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.366284:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75866112, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242e8 00010000:00010000:2.0:1789760796.366300:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.366321:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.366327:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.366335:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.366354:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.373759:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985830 is committed 00002000:00010000:2.0:1789760796.373914:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75866112 -> 75870208 00002000:00010000:2.0:1789760796.373921:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148200 -> 148208 00010000:00010000:2.0:1789760796.373940:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.373954:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.373964:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.373973:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.373978:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.373988:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.374015:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.374024:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75866112->75870207] (req 75866112->75870207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.374151:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602048:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7942us (8549us total) trans 4294985830 rc 0/0 00000100:00100000:2.0:1789760796.374163:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18533 00000100:00100000:2.0:1789760796.374175:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734616121589 time 734626480222 state 0x2 ref 0 00000100:00100000:0.0:1789760796.378165:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.378223:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602176 00000100:00100000:2.0:1789760796.378237:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602176 00000100:00100000:2.0:1789760796.378311:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734616121589 time 734626480222 state 0x0 ref 1 00000100:00100000:2.0:1789760796.378331:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734626740638 time 734626480222 state 0x1 ref 1 00000100:00100000:2.0:1789760796.378423:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734626740638 time 734638713527 state 0x0 ref 1 00000100:00100000:2.0:1789760796.378439:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602176:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.378509:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75870208, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242f0 00010000:00010000:2.0:1789760796.378521:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.378540:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.378545:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.378553:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.378569:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.386023:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985831 is committed 00002000:00010000:2.0:1789760796.391188:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75870208 -> 75874304 00002000:00010000:2.0:1789760796.391202:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148208 -> 148216 00010000:00010000:2.0:1789760796.391220:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391238:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391249:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391257:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.391263:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391273:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391299:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.391314:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f98d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75870208->75874303] (req 75870208->75874303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.391444:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602176:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13002us (13286us total) trans 4294985831 rc 0/0 00000100:00100000:2.0:1789760796.391456:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18534 00000100:00100000:2.0:1789760796.391467:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734626740638 time 734638713527 state 0x2 ref 0 00000100:00100000:3.0:1789760796.394163:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.395426:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602304 00000100:00100000:2.0:1789760796.395445:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602304 00000100:00100000:2.0:1789760796.395521:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734626740638 time 734638713527 state 0x0 ref 1 00000100:00100000:2.0:1789760796.395540:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734638973943 time 734638713527 state 0x1 ref 1 00000100:00100000:2.0:1789760796.395581:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734638973943 time 734655872581 state 0x0 ref 1 00000100:00100000:2.0:1789760796.395608:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602304:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.395674:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75874304, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x242f8 00010000:00010000:2.0:1789760796.395686:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.395736:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.395741:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.395749:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.395773:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.401492:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985832 is committed 00002000:00010000:2.0:1789760796.401632:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75874304 -> 75878400 00002000:00010000:2.0:1789760796.401639:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148216 -> 148224 00010000:00010000:2.0:1789760796.401655:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.401670:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.401680:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.401687:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.401693:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.403484:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.403519:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.403529:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f994 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75874304->75878399] (req 75874304->75878399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.403674:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565602304:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8072us (9516us total) trans 4294985832 rc 0/0 00000100:00100000:2.0:1789760796.403687:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18535 00000100:00100000:2.0:1789760796.403756:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734638973943 time 734655872581 state 0x2 ref 0 00000100:00100000:0.0:1789760796.411823:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.412558:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602432 00000100:00100000:2.0:1789760796.412574:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602432 00000100:00100000:3.0:1789760796.412789:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734638973943 time 734655872581 state 0x0 ref 1 00000100:00100000:3.0:1789760796.412815:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734656132997 time 734655872581 state 0x1 ref 1 00000100:00100000:3.0:1789760796.412907:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734656132997 time 734673196736 state 0x0 ref 1 00000100:00100000:3.0:1789760796.412923:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602432:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.412999:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75878400, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24300 00010000:00010000:3.0:1789760796.413011:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.413042:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.413048:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.413057:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.413074:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.420260:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985833 is committed 00002000:00010000:3.0:1789760796.420421:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75878400 -> 75882496 00002000:00010000:3.0:1789760796.420427:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148224 -> 148232 00010000:00010000:3.0:1789760796.420446:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420461:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420471:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420481:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.420486:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420497:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420536:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.420545:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f99b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75878400->75882495] (req 75878400->75882495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.420690:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602432:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7764us (8875us total) trans 4294985833 rc 0/0 00000100:00100000:3.0:1789760796.420805:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18536 00000100:00100000:3.0:1789760796.420819:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734656132997 time 734673196736 state 0x2 ref 0 00000100:00100000:0.0:1789760796.429696:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.430016:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602560 00000100:00100000:2.0:1789760796.430031:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602560 00000100:00100000:2.0:1789760796.430437:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734656132997 time 734673196736 state 0x0 ref 1 00000100:00100000:2.0:1789760796.430460:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734673457152 time 734673196736 state 0x1 ref 1 00000100:00100000:2.0:1789760796.431687:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734673457152 time 734691970740 state 0x0 ref 1 00000100:00100000:2.0:1789760796.431729:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565602560:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.431804:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75882496, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24308 00010000:00010000:2.0:1789760796.431816:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.431837:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.431843:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.431851:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.431868:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.438830:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985834 is committed 00002000:00010000:1.0:1789760796.439054:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75882496 -> 75886592 00002000:00010000:1.0:1789760796.439060:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148232 -> 148240 00010000:00010000:1.0:1789760796.439078:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439093:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439182:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439192:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.439198:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439209:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439235:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.439243:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0bb18/0x721975f94674f9a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75882496->75886591] (req 75882496->75886591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.440235:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565602560:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8500us (10540us total) trans 4294985834 rc 0/0 00000100:00100000:1.0:1789760796.440253:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18537 00000100:00100000:1.0:1789760796.440266:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734673457152 time 734691970740 state 0x2 ref 0 00000100:00100000:0.0:1789760796.446170:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.446210:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602688 00000100:00100000:2.0:1789760796.446225:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602688 00000100:00100000:2.0:1789760796.446303:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734673457152 time 734691970740 state 0x0 ref 1 00000100:00100000:2.0:1789760796.446322:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734692231156 time 734691970740 state 0x1 ref 1 00000100:00100000:2.0:1789760796.446359:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734692231156 time 734706650246 state 0x0 ref 1 00000100:00100000:2.0:1789760796.446374:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602688:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.446440:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75886592, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24310 00010000:00010000:2.0:1789760796.446452:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.446473:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.446479:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.446487:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.446506:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.454915:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985835 is committed 00002000:00010000:2.0:1789760796.455179:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75886592 -> 75890688 00002000:00010000:2.0:1789760796.455185:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148240 -> 148248 00010000:00010000:2.0:1789760796.455203:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455218:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455228:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455236:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.455242:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455253:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455278:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.455286:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75886592->75890687] (req 75886592->75890687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.455461:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602688:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9081us (10581us total) trans 4294985835 rc 0/0 00000100:00100000:2.0:1789760796.455474:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18538 00000100:00100000:2.0:1789760796.455487:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734692231156 time 734706650246 state 0x2 ref 0 00000100:00100000:0.0:1789760796.459292:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.459458:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602816 00000100:00100000:3.0:1789760796.459472:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602816 00000100:00100000:3.0:1789760796.459637:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734692231156 time 734706650246 state 0x0 ref 1 00000100:00100000:3.0:1789760796.459657:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734706910662 time 734706650246 state 0x1 ref 1 00000100:00100000:3.0:1789760796.459837:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734706910662 time 734720127748 state 0x0 ref 1 00000100:00100000:3.0:1789760796.459858:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565602816:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.459924:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75890688, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24318 00010000:00010000:3.0:1789760796.459947:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.459971:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.459977:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.459985:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.460004:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.465675:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985836 is committed 00002000:00010000:3.0:1789760796.468442:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75890688 -> 75894784 00002000:00010000:3.0:1789760796.468456:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148248 -> 148256 00010000:00010000:3.0:1789760796.468476:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468493:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468504:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468512:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.468519:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468529:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468638:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.468647:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75890688->75894783] (req 75890688->75894783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.468908:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565602816:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9045us (9621us total) trans 4294985836 rc 0/0 00000100:00100000:3.0:1789760796.468920:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18539 00000100:00100000:3.0:1789760796.468932:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734706910662 time 734720127748 state 0x2 ref 0 00000100:00100000:0.0:1789760796.474196:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.474324:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565602944 00000100:00100000:1.0:1789760796.474337:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565602944 00000100:00100000:1.0:1789760796.474411:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734706910662 time 734720127748 state 0x0 ref 1 00000100:00100000:1.0:1789760796.474433:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734720388164 time 734720127748 state 0x1 ref 1 00000100:00100000:1.0:1789760796.474472:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734720388164 time 734734763465 state 0x0 ref 1 00000100:00100000:1.0:1789760796.474486:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602944:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.474563:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75894784, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24320 00010000:00010000:1.0:1789760796.474575:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.474606:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.474611:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.474621:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.474639:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.482288:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985837 is committed 00002000:00010000:1.0:1789760796.482431:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75894784 -> 75898880 00002000:00010000:1.0:1789760796.482438:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148256 -> 148264 00010000:00010000:1.0:1789760796.482457:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482471:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482481:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482490:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.482496:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482505:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482604:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.482614:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75894784->75898879] (req 75894784->75898879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.482823:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565602944:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8332us (8635us total) trans 4294985837 rc 0/0 00000100:00100000:1.0:1789760796.482836:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18540 00000100:00100000:1.0:1789760796.482848:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734720388164 time 734734763465 state 0x2 ref 0 00000100:00100000:0.0:1789760796.489991:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.490481:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603072 00000100:00100000:2.0:1789760796.490497:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603072 00000100:00100000:2.0:1789760796.490588:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734720388164 time 734734763465 state 0x0 ref 1 00000100:00100000:2.0:1789760796.490619:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734735023881 time 734734763465 state 0x1 ref 1 00000100:00100000:2.0:1789760796.490778:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734735023881 time 734750947502 state 0x0 ref 1 00000100:00100000:2.0:1789760796.490802:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565603072:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.490872:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75898880, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24328 00010000:00010000:2.0:1789760796.490884:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.490905:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.490910:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.490930:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.490958:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.496205:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985838 is committed 00002000:00010000:0.0:1789760796.496642:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75898880 -> 75902976 00002000:00010000:0.0:1789760796.496649:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148264 -> 148272 00010000:00010000:0.0:1789760796.496774:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496791:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496801:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496810:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.496817:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496827:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496851:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.496860:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674f9be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75898880->75902975] (req 75898880->75902975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.497220:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565603072:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6416us (7516us total) trans 4294985838 rc 0/0 00000100:00100000:0.0:1789760796.497234:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18541 00000100:00100000:0.0:1789760796.497248:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734735023881 time 734750947502 state 0x2 ref 0 00000100:00100000:0.0:1789760796.504259:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.504391:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603200 00000100:00100000:3.0:1789760796.504404:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603200 00000100:00100000:3.0:1789760796.504480:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734735023881 time 734750947502 state 0x0 ref 1 00000100:00100000:3.0:1789760796.504500:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734751207918 time 734750947502 state 0x1 ref 1 00000100:00100000:3.0:1789760796.504569:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734751207918 time 734764859927 state 0x0 ref 1 00000100:00100000:3.0:1789760796.504585:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603200:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.504680:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75902976, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24330 00010000:00010000:3.0:1789760796.504692:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.504758:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.504764:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.504772:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.504789:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.513141:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985839 is committed 00002000:00010000:3.0:1789760796.513847:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75902976 -> 75907072 00002000:00010000:3.0:1789760796.513857:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148272 -> 148280 00010000:00010000:3.0:1789760796.513876:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513892:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513901:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513910:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.513916:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513933:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513974:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.513983:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75902976->75907071] (req 75902976->75907071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.514128:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603200:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9537us (9874us total) trans 4294985839 rc 0/0 00000100:00100000:3.0:1789760796.514142:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18542 00000100:00100000:3.0:1789760796.514156:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734751207918 time 734764859927 state 0x2 ref 0 00000100:00100000:2.0:1789760796.522266:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.522493:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603328 00000100:00100000:1.0:1789760796.522508:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603328 00000100:00100000:1.0:1789760796.522604:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734751207918 time 734764859927 state 0x0 ref 1 00000100:00100000:1.0:1789760796.522627:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734765120343 time 734764859927 state 0x1 ref 1 00000100:00100000:1.0:1789760796.522791:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734765120343 time 734783080787 state 0x0 ref 1 00000100:00100000:1.0:1789760796.522810:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603328:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.522879:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75907072, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24338 00010000:00010000:1.0:1789760796.522890:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.522910:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.522916:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.522925:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.522951:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.535347:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985840 is committed 00002000:00010000:1.0:1789760796.535845:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75907072 -> 75911168 00002000:00010000:1.0:1789760796.535852:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148280 -> 148288 00010000:00010000:1.0:1789760796.535870:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.535886:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.535896:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.535905:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.535911:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.535923:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.537999:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.538024:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674f9cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75907072->75911167] (req 75907072->75911167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.538160:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603328:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15345us (15901us total) trans 4294985840 rc 0/0 00000100:00100000:1.0:1789760796.538174:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18543 00000100:00100000:1.0:1789760796.538186:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734765120343 time 734783080787 state 0x2 ref 0 00000100:00100000:0.0:1789760796.547062:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.547223:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603456 00000100:00100000:2.0:1789760796.547237:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603456 00000100:00100000:2.0:1789760796.547313:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734765120343 time 734783080787 state 0x0 ref 1 00000100:00100000:2.0:1789760796.547333:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734783341203 time 734783080787 state 0x1 ref 1 00000100:00100000:2.0:1789760796.547373:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734783341203 time 734807664235 state 0x0 ref 1 00000100:00100000:2.0:1789760796.547386:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565603456:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.547452:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75911168, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24340 00010000:00010000:2.0:1789760796.547464:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.547483:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.547488:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.547497:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.547514:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.553026:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985841 is committed 00002000:00010000:2.0:1789760796.553221:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75911168 -> 75915264 00002000:00010000:2.0:1789760796.553228:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148288 -> 148296 00010000:00010000:2.0:1789760796.553246:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553261:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553271:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553286:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.553292:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553304:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553328:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.553336:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75911168->75915263] (req 75911168->75915263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.553528:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565603456:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6136us (6474us total) trans 4294985841 rc 0/0 00000100:00100000:2.0:1789760796.553541:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18544 00000100:00100000:2.0:1789760796.553554:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734783341203 time 734807664235 state 0x2 ref 0 00000100:00100000:0.0:1789760796.559027:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.559382:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603584 00000100:00100000:3.0:1789760796.559397:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603584 00000100:00100000:3.0:1789760796.559482:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734783341203 time 734807664235 state 0x0 ref 1 00000100:00100000:3.0:1789760796.559502:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734807924651 time 734807664235 state 0x1 ref 1 00000100:00100000:3.0:1789760796.559754:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734807924651 time 734820044560 state 0x0 ref 1 00000100:00100000:3.0:1789760796.559770:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603584:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.559838:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75915264, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24348 00010000:00010000:3.0:1789760796.559850:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.559872:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.559876:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.559884:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.559900:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.565869:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985842 is committed 00002000:00010000:3.0:1789760796.566124:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75915264 -> 75919360 00002000:00010000:3.0:1789760796.566131:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148296 -> 148304 00010000:00010000:3.0:1789760796.566150:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566166:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566177:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566187:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.566192:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566202:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566234:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.566242:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75915264->75919359] (req 75915264->75919359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.566799:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603584:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7023us (7777us total) trans 4294985842 rc 0/0 00000100:00100000:3.0:1789760796.566813:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18545 00000100:00100000:3.0:1789760796.566825:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734807924651 time 734820044560 state 0x2 ref 0 00000100:00100000:0.0:1789760796.572128:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.572296:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603712 00000100:00100000:2.0:1789760796.572309:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603712 00000100:00100000:2.0:1789760796.572382:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734807924651 time 734820044560 state 0x0 ref 1 00000100:00100000:2.0:1789760796.572402:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734820304976 time 734820044560 state 0x1 ref 1 00000100:00100000:2.0:1789760796.572437:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734820304976 time 734832728938 state 0x0 ref 1 00000100:00100000:2.0:1789760796.572452:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603712:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.572523:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75919360, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24350 00010000:00010000:2.0:1789760796.572534:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.572555:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.572560:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.572568:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.572584:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.579921:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985843 is committed 00002000:00010000:2.0:1789760796.580211:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75919360 -> 75923456 00002000:00010000:2.0:1789760796.580218:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148304 -> 148312 00010000:00010000:2.0:1789760796.580235:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580250:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580261:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580269:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.580275:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580284:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580308:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.580317:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75919360->75923455] (req 75919360->75923455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.580486:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603712:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8029us (8365us total) trans 4294985843 rc 0/0 00000100:00100000:2.0:1789760796.580499:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18546 00000100:00100000:2.0:1789760796.580638:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734820304976 time 734832728938 state 0x2 ref 0 00000100:00100000:0.0:1789760796.585635:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.586220:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603840 00000100:00100000:2.0:1789760796.586233:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603840 00000100:00100000:2.0:1789760796.586360:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734820304976 time 734832728938 state 0x0 ref 1 00000100:00100000:2.0:1789760796.586380:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734832989354 time 734832728938 state 0x1 ref 1 00000100:00100000:2.0:1789760796.586463:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734832989354 time 734846753632 state 0x0 ref 1 00000100:00100000:2.0:1789760796.586478:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603840:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.586567:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75923456, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24358 00010000:00010000:2.0:1789760796.586580:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.586612:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.586617:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.586625:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.586641:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.591675:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985844 is committed 00002000:00010000:2.0:1789760796.592117:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75923456 -> 75927552 00002000:00010000:2.0:1789760796.592124:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148312 -> 148320 00010000:00010000:2.0:1789760796.592141:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592157:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592167:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592176:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.592181:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592190:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592216:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.592225:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75923456->75927551] (req 75923456->75927551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.592455:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565603840:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5974us (6829us total) trans 4294985844 rc 0/0 00000100:00100000:2.0:1789760796.592468:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18547 00000100:00100000:2.0:1789760796.592479:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734832989354 time 734846753632 state 0x2 ref 0 00000100:00100000:0.0:1789760796.596812:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.596897:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565603968 00000100:00100000:3.0:1789760796.596909:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565603968 00000100:00100000:3.0:1789760796.596988:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734832989354 time 734846753632 state 0x0 ref 1 00000100:00100000:3.0:1789760796.597007:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734847014048 time 734846753632 state 0x1 ref 1 00000100:00100000:3.0:1789760796.597035:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734847014048 time 734857326868 state 0x0 ref 1 00000100:00100000:3.0:1789760796.597047:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603968:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.597110:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75927552, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24360 00010000:00010000:3.0:1789760796.597122:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.597141:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.597147:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.597155:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.597173:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.602492:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985845 is committed 00002000:00010000:3.0:1789760796.602814:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75927552 -> 75931648 00002000:00010000:3.0:1789760796.602822:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148320 -> 148328 00010000:00010000:3.0:1789760796.602841:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.602857:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.602869:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.602878:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.603114:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603128:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603155:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603169:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674f9ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75927552->75931647] (req 75927552->75931647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.603414:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565603968:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6360us (6608us total) trans 4294985845 rc 0/0 00000100:00100000:3.0:1789760796.603428:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18548 00000100:00100000:3.0:1789760796.603441:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734847014048 time 734857326868 state 0x2 ref 0 00000100:00100000:0.0:1789760796.614100:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.614247:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604096 00000100:00100000:2.0:1789760796.614262:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604096 00000100:00100000:2.0:1789760796.614333:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734847014048 time 734857326868 state 0x0 ref 1 00000100:00100000:2.0:1789760796.614350:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734857587284 time 734857326868 state 0x1 ref 1 00000100:00100000:2.0:1789760796.614431:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734857587284 time 734874722732 state 0x0 ref 1 00000100:00100000:2.0:1789760796.614445:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565604096:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.614509:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75931648, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24368 00010000:00010000:2.0:1789760796.614519:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.614539:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.614545:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.614552:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.614570:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.624634:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985846 is committed 00002000:00010000:2.0:1789760796.624898:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75931648 -> 75935744 00002000:00010000:2.0:1789760796.624905:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148328 -> 148336 00010000:00010000:2.0:1789760796.624923:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.624949:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.624960:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.624968:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.624974:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.624984:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.625011:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.625026:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75931648->75935743] (req 75931648->75935743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.625212:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565604096:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10762us (11118us total) trans 4294985846 rc 0/0 00000100:00100000:2.0:1789760796.625226:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18549 00000100:00100000:2.0:1789760796.625238:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734857587284 time 734874722732 state 0x2 ref 0 00000100:00100000:0.0:1789760796.636247:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.640499:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604224 00000100:00100000:2.0:1789760796.640518:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604224 00000100:00100000:2.0:1789760796.640890:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734857587284 time 734874722732 state 0x0 ref 1 00000100:00100000:2.0:1789760796.640911:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734874983148 time 734874722732 state 0x1 ref 1 00000100:00100000:2.0:1789760796.641077:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734874983148 time 734901365877 state 0x0 ref 1 00000100:00100000:2.0:1789760796.641094:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604224:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.641158:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75935744, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24370 00010000:00010000:2.0:1789760796.641169:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.641189:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.641194:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.641201:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.641222:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.648482:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985847 is committed 00002000:00010000:0.0:1789760796.648698:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75935744 -> 75939840 00002000:00010000:0.0:1789760796.648798:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148336 -> 148344 00010000:00010000:0.0:1789760796.648816:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648832:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648842:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648856:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.648862:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648875:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648899:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.648908:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674f9fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75935744->75939839] (req 75935744->75939839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.649488:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604224:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8390us (13248us total) trans 4294985847 rc 0/0 00000100:00100000:1.0:1789760796.649503:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18550 00000100:00100000:1.0:1789760796.649515:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734874983148 time 734901365877 state 0x2 ref 0 00000100:00100000:0.0:1789760796.653861:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.654499:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604352 00000100:00100000:3.0:1789760796.654515:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604352 00000100:00100000:3.0:1789760796.654680:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734874983148 time 734901365877 state 0x0 ref 1 00000100:00100000:3.0:1789760796.654701:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734901626293 time 734901365877 state 0x1 ref 1 00000100:00100000:3.0:1789760796.655199:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734901626293 time 734915489360 state 0x0 ref 1 00000100:00100000:3.0:1789760796.655217:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604352:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.655281:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75939840, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24378 00010000:00010000:3.0:1789760796.655292:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.655817:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.655826:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.655834:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.655858:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.665552:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985848 is committed 00002000:00010000:3.0:1789760796.666466:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75939840 -> 75943936 00002000:00010000:3.0:1789760796.666474:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148344 -> 148352 00010000:00010000:3.0:1789760796.666493:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.666508:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.666519:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.666527:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.666533:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.666543:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.666568:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.667167:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75939840->75943935] (req 75939840->75943935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.668074:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604352:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12089us (13454us total) trans 4294985848 rc 0/0 00000100:00100000:3.0:1789760796.668090:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18551 00000100:00100000:3.0:1789760796.668103:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734901626293 time 734915489360 state 0x2 ref 0 00000100:00100000:0.0:1789760796.673660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.674020:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604480 00000100:00100000:2.0:1789760796.674033:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604480 00000100:00100000:2.0:1789760796.674210:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734901626293 time 734915489360 state 0x0 ref 1 00000100:00100000:2.0:1789760796.674228:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734915749776 time 734915489360 state 0x1 ref 1 00000100:00100000:2.0:1789760796.674294:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734915749776 time 734934585588 state 0x0 ref 1 00000100:00100000:2.0:1789760796.674308:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604480:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.674370:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75943936, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24380 00010000:00010000:2.0:1789760796.674380:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.674401:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.674406:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.674413:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.674430:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.680466:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985849 is committed 00002000:00010000:2.0:1789760796.681165:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75943936 -> 75948032 00002000:00010000:2.0:1789760796.681174:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148352 -> 148360 00010000:00010000:2.0:1789760796.681192:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681206:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681215:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681225:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.681230:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681240:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681265:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.681272:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75943936->75948031] (req 75943936->75948031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.681555:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604480:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7241us (7899us total) trans 4294985849 rc 0/0 00000100:00100000:2.0:1789760796.681569:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18552 00000100:00100000:2.0:1789760796.681975:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734915749776 time 734934585588 state 0x2 ref 0 00000100:00100000:0.0:1789760796.686509:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.687837:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604608 00000100:00100000:1.0:1789760796.687855:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604608 00000100:00100000:1.0:1789760796.687944:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734915749776 time 734934585588 state 0x0 ref 1 00000100:00100000:1.0:1789760796.687965:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734934846004 time 734934585588 state 0x1 ref 1 00000100:00100000:1.0:1789760796.688000:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734934846004 time 734948291391 state 0x0 ref 1 00000100:00100000:1.0:1789760796.688016:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604608:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.688241:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75948032, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24388 00010000:00010000:1.0:1789760796.688254:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.688273:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.688278:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.688286:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.688303:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.697443:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985850 is committed 00002000:00010000:1.0:1789760796.698214:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75948032 -> 75952128 00002000:00010000:1.0:1789760796.698223:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148360 -> 148368 00010000:00010000:1.0:1789760796.698240:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698256:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698273:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698282:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.698287:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698297:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698322:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.698331:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75948032->75952127] (req 75948032->75952127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.698465:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565604608:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10445us (11965us total) trans 4294985850 rc 0/0 00000100:00100000:1.0:1789760796.698478:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18553 00000100:00100000:1.0:1789760796.698489:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734934846004 time 734948291391 state 0x2 ref 0 00000100:00100000:0.0:1789760796.703154:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.703269:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604736 00000100:00100000:3.0:1789760796.703284:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604736 00000100:00100000:3.0:1789760796.703360:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734934846004 time 734948291391 state 0x0 ref 1 00000100:00100000:3.0:1789760796.703377:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734948551807 time 734948291391 state 0x1 ref 1 00000100:00100000:3.0:1789760796.703446:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734948551807 time 734963737775 state 0x0 ref 1 00000100:00100000:3.0:1789760796.703461:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604736:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.703522:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75952128, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24390 00010000:00010000:3.0:1789760796.703541:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.703561:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1789760796.703566:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.703573:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.703605:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.712606:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985851 is committed 00002000:00010000:2.0:1789760796.712914:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75952128 -> 75956224 00002000:00010000:2.0:1789760796.712920:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148368 -> 148376 00010000:00010000:2.0:1789760796.712949:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713186:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713198:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713207:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5efc00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.713212:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713222:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713247:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.713260:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61046ff/0x721975f94674fa19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75952128->75956223] (req 75952128->75956223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.713391:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604736:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9926us (10245us total) trans 4294985851 rc 0/0 00000100:00100000:2.0:1789760796.713404:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18554 00000100:00100000:2.0:1789760796.713417:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734948551807 time 734963737775 state 0x2 ref 0 00000100:00100000:0.0:1789760796.722393:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.722860:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604864 00000100:00100000:2.0:1789760796.722875:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604864 00000100:00100000:2.0:1789760796.723016:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734948551807 time 734963737775 state 0x0 ref 1 00000100:00100000:2.0:1789760796.723036:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734963998191 time 734963737775 state 0x1 ref 1 00000100:00100000:2.0:1789760796.723113:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734963998191 time 734983403784 state 0x0 ref 1 00000100:00100000:2.0:1789760796.723128:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604864:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.723197:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75956224, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x24398 00010000:00010000:2.0:1789760796.723209:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.723229:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789760796.723235:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.723242:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.723265:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.732430:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985852 is committed 00002000:00010000:2.0:1789760796.732596:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75956224 -> 75960320 00002000:00010000:2.0:1789760796.732602:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148376 -> 148384 00010000:00010000:2.0:1789760796.732626:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732641:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732655:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732666:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.732672:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732685:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732735:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.732744:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75956224->75960319] (req 75956224->75960319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.733906:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604864:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9730us (10551us total) trans 4294985852 rc 0/0 00000100:00100000:2.0:1789760796.733923:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18555 00000100:00100000:2.0:1789760796.733945:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734963998191 time 734983403784 state 0x2 ref 0 00000100:00100000:0.0:1789760796.736005:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.736110:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565604992 00000100:00100000:1.0:1789760796.736122:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565604992 00000100:00100000:1.0:1789760796.736192:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734963998191 time 734983403784 state 0x0 ref 1 00000100:00100000:1.0:1789760796.736214:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734983664200 time 734983403784 state 0x1 ref 1 00000100:00100000:1.0:1789760796.736249:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734983664200 time 734996540747 state 0x0 ref 1 00000100:00100000:1.0:1789760796.736263:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604992:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.736325:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75960320, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243a0 00010000:00010000:1.0:1789760796.736336:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.736356:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1789760796.736361:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.736369:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.736385:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.742840:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985853 is committed 00002000:00010000:1.0:1789760796.743150:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75960320 -> 75964416 00002000:00010000:1.0:1789760796.743158:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148384 -> 148392 00010000:00010000:1.0:1789760796.743178:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743195:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743205:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743212:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.743218:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743228:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743256:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.743264:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75960320->75964415] (req 75960320->75964415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.743431:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565604992:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7163us (7431us total) trans 4294985853 rc 0/0 00000100:00100000:1.0:1789760796.743443:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18556 00000100:00100000:1.0:1789760796.743455:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734983664200 time 734996540747 state 0x2 ref 0 00000100:00100000:0.0:1789760796.747962:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.748085:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605120 00000100:00100000:2.0:1789760796.748098:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605120 00000100:00100000:2.0:1789760796.748167:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734983664200 time 734996540747 state 0x0 ref 1 00000100:00100000:2.0:1789760796.748187:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734996801163 time 734996540747 state 0x1 ref 1 00000100:00100000:2.0:1789760796.748221:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734996801163 time 735008512719 state 0x0 ref 1 00000100:00100000:2.0:1789760796.748235:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605120:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.748302:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75964416, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243a8 00010000:00010000:2.0:1789760796.748314:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.748333:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.748339:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.748347:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.748363:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.758098:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985854 is committed 00002000:00010000:3.0:1789760796.760828:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75964416 -> 75968512 00002000:00010000:3.0:1789760796.760841:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148392 -> 148400 00010000:00010000:3.0:1789760796.760857:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760872:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760883:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760891:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760796.760897:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760908:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760934:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.760942:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff009c7/0x721975f94674fa2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75964416->75968511] (req 75964416->75968511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.761064:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605120:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12823us (13112us total) trans 4294985854 rc 0/0 00000100:00100000:3.0:1789760796.761078:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18557 00000100:00100000:3.0:1789760796.761090:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734996801163 time 735008512719 state 0x2 ref 0 00000100:00100000:0.0:1789760796.767607:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.767752:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605248 00000100:00100000:2.0:1789760796.767766:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605248 00000100:00100000:2.0:1789760796.767836:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 734996801163 time 735008512719 state 0x0 ref 1 00000100:00100000:2.0:1789760796.767855:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735008773135 time 735008512719 state 0x1 ref 1 00000100:00100000:2.0:1789760796.767880:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735008773135 time 735028171915 state 0x0 ref 1 00000100:00100000:2.0:1789760796.767893:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565605248:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.767956:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75968512, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243b0 00010000:00010000:2.0:1789760796.767967:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.767985:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.767990:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.767998:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.768014:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.774465:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985855 is committed 00002000:00010000:2.0:1789760796.780831:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75968512 -> 75972608 00002000:00010000:2.0:1789760796.780843:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148400 -> 148408 00010000:00010000:2.0:1789760796.780862:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780882:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780892:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780900:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.780905:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780916:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780940:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.780949:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75968512->75972607] (req 75968512->75972607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.781373:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565605248:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13474us (13838us total) trans 4294985855 rc 0/0 00000100:00100000:2.0:1789760796.781386:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18558 00000100:00100000:2.0:1789760796.781398:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735008773135 time 735028171915 state 0x2 ref 0 00000100:00100000:0.0:1789760796.784842:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.786414:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605376 00000100:00100000:1.0:1789760796.786436:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605376 00000100:00100000:1.0:1789760796.786517:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735008773135 time 735028171915 state 0x0 ref 1 00000100:00100000:1.0:1789760796.786536:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735028432331 time 735028171915 state 0x1 ref 1 00000100:00100000:1.0:1789760796.786567:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735028432331 time 735046858993 state 0x0 ref 1 00000100:00100000:1.0:1789760796.786581:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605376:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.786658:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75972608, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243b8 00010000:00010000:1.0:1789760796.786671:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.786691:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760796.786696:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.786722:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.786741:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.793621:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985856 is committed 00002000:00010000:1.0:1789760796.793872:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75972608 -> 75976704 00002000:00010000:1.0:1789760796.793879:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148408 -> 148416 00010000:00010000:1.0:1789760796.794274:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794290:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794301:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794314:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.794319:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794330:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794357:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.794365:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a53355f/0x721975f94674fa3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75972608->75976703] (req 75972608->75976703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.794596:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605376:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7993us (9744us total) trans 4294985856 rc 0/0 00000100:00100000:1.0:1789760796.794610:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18559 00000100:00100000:1.0:1789760796.794623:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735028432331 time 735046858993 state 0x2 ref 0 00000100:00100000:0.0:1789760796.804205:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760796.804327:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605504 00000100:00100000:3.0:1789760796.804339:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605504 00000100:00100000:3.0:1789760796.804415:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735028432331 time 735046858993 state 0x0 ref 1 00000100:00100000:3.0:1789760796.804434:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735047119409 time 735046858993 state 0x1 ref 1 00000100:00100000:3.0:1789760796.804476:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735047119409 time 735064767867 state 0x0 ref 1 00000100:00100000:3.0:1789760796.804491:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565605504:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760796.804551:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75976704, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243c0 00010000:00010000:3.0:1789760796.804563:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.804583:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760796.804599:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.804608:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.804625:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.814624:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985857 is committed 00002000:00010000:0.0:1789760796.815576:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75976704 -> 75980800 00002000:00010000:0.0:1789760796.815587:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148416 -> 148424 00010000:00010000:0.0:1789760796.815623:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815640:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815649:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815658:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.815664:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815673:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815698:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.815741:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda38898/0x721975f94674fa43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75976704->75980799] (req 75976704->75980799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.816192:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565605504:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11694us (11992us total) trans 4294985857 rc 0/0 00000100:00100000:0.0:1789760796.816205:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18560 00000100:00100000:0.0:1789760796.816218:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735047119409 time 735064767867 state 0x2 ref 0 00000100:00100000:0.0:1789760796.827222:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.827892:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605632 00000100:00100000:2.0:1789760796.827907:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605632 00000100:00100000:2.0:1789760796.828060:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735047119409 time 735064767867 state 0x0 ref 1 00000100:00100000:2.0:1789760796.828130:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735065028283 time 735064767867 state 0x1 ref 1 00000100:00100000:2.0:1789760796.828206:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735065028283 time 735088497160 state 0x0 ref 1 00000100:00100000:2.0:1789760796.828221:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605632:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.828283:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75980800, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243c8 00010000:00010000:2.0:1789760796.828294:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.828314:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.828319:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.828328:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.828345:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.834955:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985858 is committed 00002000:00010000:2.0:1789760796.835218:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75980800 -> 75984896 00002000:00010000:2.0:1789760796.835224:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148424 -> 148432 00010000:00010000:2.0:1789760796.835241:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835256:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835266:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835275:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.835280:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835290:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835313:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.835321:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75980800->75984895] (req 75980800->75984895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.835445:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565605632:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7219us (8230us total) trans 4294985858 rc 0/0 00000100:00100000:2.0:1789760796.835458:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18561 00000100:00100000:2.0:1789760796.835469:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735065028283 time 735088497160 state 0x2 ref 0 00000100:00100000:1.0:1789760796.840540:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.840636:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605760 00000100:00100000:2.0:1789760796.840649:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605760 00000100:00100000:2.0:1789760796.840787:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735065028283 time 735088497160 state 0x0 ref 1 00000100:00100000:2.0:1789760796.840808:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735088757576 time 735088497160 state 0x1 ref 1 00000100:00100000:2.0:1789760796.840844:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735088757576 time 735101135303 state 0x0 ref 1 00000100:00100000:2.0:1789760796.840860:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565605760:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.840927:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75984896, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243d0 00010000:00010000:2.0:1789760796.840939:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.840974:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.840980:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.840987:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.841005:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.847345:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985859 is committed 00002000:00010000:2.0:1789760796.847493:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75984896 -> 75988992 00002000:00010000:2.0:1789760796.847500:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148432 -> 148440 00010000:00010000:2.0:1789760796.847517:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847532:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847541:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847556:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.847562:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847572:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847605:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.847614:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75984896->75988991] (req 75984896->75988991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.847787:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565605760:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6924us (7254us total) trans 4294985859 rc 0/0 00000100:00100000:2.0:1789760796.847799:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18562 00000100:00100000:2.0:1789760796.847811:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735088757576 time 735101135303 state 0x2 ref 0 00000100:00100000:1.0:1789760796.858806:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.858911:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565605888 00000100:00100000:0.0:1789760796.858925:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565605888 00000100:00100000:0.0:1789760796.859111:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735088757576 time 735101135303 state 0x0 ref 1 00000100:00100000:0.0:1789760796.859131:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735101395719 time 735101135303 state 0x1 ref 1 00000100:00100000:0.0:1789760796.859211:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735101395719 time 735119502047 state 0x0 ref 1 00000100:00100000:0.0:1789760796.859228:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565605888:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.859291:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75988992, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243d8 00010000:00010000:0.0:1789760796.859304:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.859323:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760796.859329:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.859337:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.859355:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.866147:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985860 is committed 00002000:00010000:0.0:1789760796.866782:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75988992 -> 75993088 00002000:00010000:0.0:1789760796.866789:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148440 -> 148448 00010000:00010000:0.0:1789760796.866809:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.866828:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.866838:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.866847:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760796.866853:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.867029:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.867056:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.867064:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75988992->75993087] (req 75988992->75993087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.867188:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565605888:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7958us (8391us total) trans 4294985860 rc 0/0 00000100:00100000:0.0:1789760796.867202:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18563 00000100:00100000:0.0:1789760796.867214:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735101395719 time 735119502047 state 0x2 ref 0 00010000:00010000:0.0:1789760796.876025:0:5954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760796.878538:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.878634:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606016 00000100:00100000:2.0:1789760796.878650:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606016 00000100:00100000:2.0:1789760796.878772:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735101395719 time 735119502047 state 0x0 ref 1 00000100:00100000:2.0:1789760796.878791:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735119762463 time 735119502047 state 0x1 ref 1 00000100:00100000:2.0:1789760796.878825:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735119762463 time 735139117115 state 0x0 ref 1 00000100:00100000:2.0:1789760796.878839:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606016:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.878906:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75993088, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243e0 00010000:00010000:2.0:1789760796.878918:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.878938:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.878943:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.878950:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.878968:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.887451:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985861 is committed 00002000:00010000:2.0:1789760796.887751:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75993088 -> 75997184 00002000:00010000:2.0:1789760796.887758:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148448 -> 148456 00010000:00010000:2.0:1789760796.887775:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.887791:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.887802:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.887810:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.887817:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.887827:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.887854:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.888036:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75993088->75997183] (req 75993088->75997183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.888167:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606016:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9322us (9638us total) trans 4294985861 rc 0/0 00000100:00100000:2.0:1789760796.888178:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18564 00000100:00100000:2.0:1789760796.888191:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735119762463 time 735139117115 state 0x2 ref 0 00000100:00100000:1.0:1789760796.891383:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.891835:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606144 00000100:00100000:2.0:1789760796.891849:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606144 00000100:00100000:2.0:1789760796.891946:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735119762463 time 735139117115 state 0x0 ref 1 00000100:00100000:2.0:1789760796.891966:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735139377531 time 735139117115 state 0x1 ref 1 00000100:00100000:2.0:1789760796.892005:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735139377531 time 735152295196 state 0x0 ref 1 00000100:00100000:2.0:1789760796.892017:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565606144:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.892083:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75997184, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243e8 00010000:00010000:2.0:1789760796.892094:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.892114:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.892119:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.892127:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.892145:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.899094:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985862 is committed 00002000:00010000:2.0:1789760796.899227:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75997184 -> 76001280 00002000:00010000:2.0:1789760796.899234:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148456 -> 148464 00010000:00010000:2.0:1789760796.899252:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899267:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899278:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899286:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760796.899292:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899302:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899327:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.899335:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309c9b8e/0x721975f94674fa66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75997184->76001279] (req 75997184->76001279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.899519:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565606144:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7494us (8140us total) trans 4294985862 rc 0/0 00000100:00100000:2.0:1789760796.899542:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18565 00000100:00100000:2.0:1789760796.899554:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735139377531 time 735152295196 state 0x2 ref 0 00000100:00100000:1.0:1789760796.916042:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760796.916267:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606272 00000100:00100000:0.0:1789760796.916280:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606272 00000100:00100000:0.0:1789760796.916370:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735139377531 time 735152295196 state 0x0 ref 1 00000100:00100000:0.0:1789760796.916391:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735152555612 time 735152295196 state 0x1 ref 1 00000100:00100000:0.0:1789760796.916427:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735152555612 time 735176718718 state 0x0 ref 1 00000100:00100000:0.0:1789760796.916441:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606272:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760796.916505:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76001280, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243f0 00010000:00010000:0.0:1789760796.916517:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.916536:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760796.916542:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.916551:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.916568:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.926092:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985863 is committed 00002000:00010000:1.0:1789760796.926471:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76001280 -> 76005376 00002000:00010000:1.0:1789760796.926478:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148464 -> 148472 00010000:00010000:1.0:1789760796.926498:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926513:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926523:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926531:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.926537:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926548:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926575:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.926583:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c75d9b/0x721975f94674fa6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76001280->76005375] (req 76001280->76005375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.926790:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606272:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10344us (10755us total) trans 4294985863 rc 0/0 00000100:00100000:1.0:1789760796.926804:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18566 00000100:00100000:1.0:1789760796.926816:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735152555612 time 735176718718 state 0x2 ref 0 00000100:00100000:1.0:1789760796.932405:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760796.932737:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606400 00000100:00100000:2.0:1789760796.932750:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606400 00000100:00100000:2.0:1789760796.932835:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735152555612 time 735176718718 state 0x0 ref 1 00000100:00100000:2.0:1789760796.932861:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735176979134 time 735176718718 state 0x1 ref 1 00000100:00100000:2.0:1789760796.932896:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735176979134 time 735193187973 state 0x0 ref 1 00000100:00100000:2.0:1789760796.932910:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606400:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.932989:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76005376, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x243f8 00010000:00010000:2.0:1789760796.932999:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.933023:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.933028:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.933035:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.933052:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.942086:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985864 is committed 00002000:00010000:1.0:1789760796.942226:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76005376 -> 76009472 00002000:00010000:1.0:1789760796.942232:0:6957:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760796 -> 1789760797 00002000:00010000:1.0:1789760796.942235:0:6957:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760796 -> 1789760797 00002000:00010000:1.0:1789760796.942238:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148472 -> 148480 00010000:00010000:1.0:1789760796.942256:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942271:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942281:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942291:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.942406:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942420:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942457:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.942467:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fa74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76005376->76009471] (req 76005376->76009471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.942607:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606400:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9692us (10210us total) trans 4294985864 rc 0/0 00000100:00100000:1.0:1789760796.942620:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18567 00000100:00100000:1.0:1789760796.942632:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735176979134 time 735193187973 state 0x2 ref 0 00000100:00100000:2.0:1789760796.955612:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.955769:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606528 00000100:00100000:1.0:1789760796.955783:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606528 00000100:00100000:1.0:1789760796.955858:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735176979134 time 735193187973 state 0x0 ref 1 00000100:00100000:1.0:1789760796.956015:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735193448389 time 735193187973 state 0x1 ref 1 00000100:00100000:1.0:1789760796.956053:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735193448389 time 735216344637 state 0x0 ref 1 00000100:00100000:1.0:1789760796.956069:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565606528:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.956134:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76009472, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24400 00010000:00010000:1.0:1789760796.956147:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.956168:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760796.956174:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.956182:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.956199:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.961797:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985865 is committed 00002000:00010000:1.0:1789760796.969752:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76009472 -> 76013568 00002000:00010000:1.0:1789760796.969765:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148480 -> 148488 00010000:00010000:1.0:1789760796.969782:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969798:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969808:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969815:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.969821:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969833:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969856:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.969874:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fa7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76009472->76013567] (req 76009472->76013567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.970018:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565606528:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13945us (14423us total) trans 4294985865 rc 0/0 00000100:00100000:1.0:1789760796.970033:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18568 00000100:00100000:1.0:1789760796.970045:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735193448389 time 735216344637 state 0x2 ref 0 00000100:00100000:3.0:1789760796.977424:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.977558:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606656 00000100:00100000:1.0:1789760796.977571:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606656 00000100:00100000:1.0:1789760796.977653:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735193448389 time 735216344637 state 0x0 ref 1 00000100:00100000:1.0:1789760796.977672:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735216605053 time 735216344637 state 0x1 ref 1 00000100:00100000:1.0:1789760796.977754:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735216605053 time 735238044947 state 0x0 ref 1 00000100:00100000:1.0:1789760796.977769:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606656:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760796.977834:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76013568, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24408 00010000:00010000:1.0:1789760796.977847:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.977867:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760796.977873:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.977881:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.977898:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.982893:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985866 is committed 00002000:00010000:1.0:1789760796.984861:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76013568 -> 76017664 00002000:00010000:1.0:1789760796.984875:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148488 -> 148496 00010000:00010000:1.0:1789760796.984895:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984910:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984921:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984930:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760796.984936:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984946:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984973:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.984980:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76013568->76017663] (req 76013568->76017663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.985109:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606656:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7337us (7695us total) trans 4294985866 rc 0/0 00000100:00100000:1.0:1789760796.985122:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18569 00000100:00100000:1.0:1789760796.985137:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735216605053 time 735238044947 state 0x2 ref 0 00000100:00100000:2.0:1789760796.990520:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760796.991547:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606784 00000100:00100000:1.0:1789760796.991567:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606784 00000100:00100000:2.0:1789760796.991915:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735216605053 time 735238044947 state 0x0 ref 1 00000100:00100000:2.0:1789760796.991936:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735238305363 time 735238044947 state 0x1 ref 1 00000100:00100000:2.0:1789760796.991978:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735238305363 time 735252269350 state 0x0 ref 1 00000100:00100000:2.0:1789760796.991992:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565606784:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760796.992059:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76017664, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24410 00010000:00010000:2.0:1789760796.992072:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.992094:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760796.992099:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.992107:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.992130:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.999777:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985867 is committed 00002000:00010000:2.0:1789760797.000086:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76017664 -> 76021760 00002000:00010000:2.0:1789760797.000094:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148496 -> 148504 00010000:00010000:2.0:1789760797.000112:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000127:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000138:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000147:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.000153:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000165:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000191:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.000200:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e6e1c0/0x721975f94674fa89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76017664->76021759] (req 76017664->76021759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.000475:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565606784:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8478us (9961us total) trans 4294985867 rc 0/0 00000100:00100000:2.0:1789760797.000489:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18570 00000100:00100000:2.0:1789760797.000501:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735238305363 time 735252269350 state 0x2 ref 0 00000100:00100000:2.0:1789760797.007084:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.010118:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565606912 00000100:00100000:1.0:1789760797.010139:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565606912 00000100:00100000:1.0:1789760797.010301:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735238305363 time 735252269350 state 0x0 ref 1 00000100:00100000:1.0:1789760797.010325:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735252529766 time 735252269350 state 0x1 ref 1 00000100:00100000:1.0:1789760797.010450:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735252529766 time 735270740501 state 0x0 ref 1 00000100:00100000:1.0:1789760797.010468:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606912:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.010555:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76021760, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24418 00010000:00010000:1.0:1789760797.010568:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.010600:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.010606:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.010615:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.010632:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.018807:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985868 is committed 00002000:00010000:1.0:1789760797.019877:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76021760 -> 76025856 00002000:00010000:1.0:1789760797.019888:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148504 -> 148512 00010000:00010000:1.0:1789760797.019907:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.019924:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.019999:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.020011:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.020017:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.020030:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.020058:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.020067:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fa90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76021760->76025855] (req 76021760->76025855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.020256:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565606912:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9785us (13178us total) trans 4294985868 rc 0/0 00000100:00100000:1.0:1789760797.020269:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18571 00000100:00100000:1.0:1789760797.020281:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735252529766 time 735270740501 state 0x2 ref 0 00000100:00100000:2.0:1789760797.027452:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.030372:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607040 00000100:00100000:3.0:1789760797.030393:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607040 00000100:00100000:3.0:1789760797.030489:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735252529766 time 735270740501 state 0x0 ref 1 00000100:00100000:3.0:1789760797.030512:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735271000917 time 735270740501 state 0x1 ref 1 00000100:00100000:3.0:1789760797.030627:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735271000917 time 735290917989 state 0x0 ref 1 00000100:00100000:3.0:1789760797.030645:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565607040:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.030740:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76025856, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24420 00010000:00010000:3.0:1789760797.030753:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.030779:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.030785:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.030793:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.030813:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.039113:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985869 is committed 00002000:00010000:0.0:1789760797.049355:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76025856 -> 76029952 00002000:00010000:0.0:1789760797.049368:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148512 -> 148520 00010000:00010000:0.0:1789760797.049388:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049410:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049541:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049551:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.049557:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049569:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049609:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.049619:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de85964d/0x721975f94674fa97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76025856->76029951] (req 76025856->76029951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.049807:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d41f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565607040:12345-192.168.203.47@tcp:4:dd.0 Request processed in 19159us (22366us total) trans 4294985869 rc 0/0 00000100:00100000:0.0:1789760797.049821:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18572 00000100:00100000:0.0:1789760797.049834:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735271000917 time 735290917989 state 0x2 ref 0 00000100:00100000:2.0:1789760797.056886:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.057009:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607168 00000100:00100000:3.0:1789760797.057023:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607168 00000100:00100000:3.0:1789760797.057100:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735271000917 time 735290917989 state 0x0 ref 1 00000100:00100000:3.0:1789760797.057120:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735291178405 time 735290917989 state 0x1 ref 1 00000100:00100000:3.0:1789760797.057190:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735291178405 time 735317481477 state 0x0 ref 1 00000100:00100000:3.0:1789760797.057205:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607168:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.057271:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76029952, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24428 00010000:00010000:3.0:1789760797.057284:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.057319:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.057325:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.057333:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.057349:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.063843:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985870 is committed 00002000:00010000:2.0:1789760797.064098:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76029952 -> 76034048 00002000:00010000:2.0:1789760797.064105:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148520 -> 148528 00010000:00010000:2.0:1789760797.064123:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064137:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064147:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064155:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5eee00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.064161:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064170:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064197:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.064206:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000297668f1/0x721975f94674fa9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76029952->76034047] (req 76029952->76034047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.064378:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607168:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7168us (7500us total) trans 4294985870 rc 0/0 00000100:00100000:2.0:1789760797.064391:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18573 00000100:00100000:2.0:1789760797.064403:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735291178405 time 735317481477 state 0x2 ref 0 00000100:00100000:0.0:1789760797.070608:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.073487:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607296 00000100:00100000:1.0:1789760797.074795:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607296 00000100:00100000:1.0:1789760797.074897:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735291178405 time 735317481477 state 0x0 ref 1 00000100:00100000:1.0:1789760797.074918:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735317741893 time 735317481477 state 0x1 ref 1 00000100:00100000:0.0:1789760797.075187:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735317741893 time 735335473597 state 0x0 ref 1 00000100:00100000:0.0:1789760797.075211:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565607296:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.075287:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76034048, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24430 00010000:00010000:0.0:1789760797.075299:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.075334:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.075339:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.075347:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.075364:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.075810:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.075849:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.075901:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.075935:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607552 00000100:00100000:2.0:1789760797.075943:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607552 00000100:00100000:2.0:1789760797.075997:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607680 00000100:00100000:2.0:1789760797.076001:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607680 00000100:00100000:2.0:1789760797.076029:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 482 00000100:00100000:2.0:1789760797.076038:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2359:x1876699565607552:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760797.076230:0:5966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 483 00000100:00100000:1.0:1789760797.076240:0:5966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2359:x1876699565607680:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1789760797.076294:0:5966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a301392-4ca2-4c43-8653-61d4c47997a9+5:2359:x1876699565607680:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760797.076302:0:5966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 483 00000100:00080000:1.0:1789760797.076465:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760797.077365:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607424 00000100:00100000:3.0:1789760797.077379:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607424 00000100:00100000:3.0:1789760797.077457:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 404 00000100:00100000:3.0:1789760797.077467:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e60a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af634c28-3647-4f73-bb24-40d7878858fb+13:2359:x1876699565607424:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1789760797.077654:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+8:2359:x1876699565607552:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1613us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.077665:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 482 00000100:00100000:3.0:1789760797.078189:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e60a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af634c28-3647-4f73-bb24-40d7878858fb+13:2359:x1876699565607424:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 721us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760797.078198:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 404 00000001:00080000:2.0:1789760797.085511:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985871 is committed 00002000:00010000:0.0:1789760797.086110:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76034048 -> 76038144 00002000:00010000:0.0:1789760797.086118:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148528 -> 148536 00010000:00010000:0.0:1789760797.086137:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086152:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086163:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086171:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.086178:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086188:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086214:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.086222:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81c71c/0x721975f94674faa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76034048->76038143] (req 76034048->76038143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.086392:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565607296:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11183us (15804us total) trans 4294985871 rc 0/0 00000100:00100000:0.0:1789760797.086405:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18574 00000100:00100000:0.0:1789760797.086418:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735317741893 time 735335473597 state 0x2 ref 0 00000100:00100000:0.0:1789760797.091136:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.091281:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607808 00000100:00100000:3.0:1789760797.091295:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607808 00000100:00100000:3.0:1789760797.091373:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735317741893 time 735335473597 state 0x0 ref 1 00000100:00100000:3.0:1789760797.091393:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735335734013 time 735335473597 state 0x1 ref 1 00000100:00100000:3.0:1789760797.091465:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735335734013 time 735351756464 state 0x0 ref 1 00000100:00100000:3.0:1789760797.091481:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607808:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.091622:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76038144, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24438 00010000:00010000:3.0:1789760797.091634:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.091655:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.091661:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.091669:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.091687:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.099848:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985872 is committed 00002000:00010000:0.0:1789760797.105816:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76038144 -> 76042240 00002000:00010000:0.0:1789760797.105831:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148536 -> 148544 00010000:00010000:0.0:1789760797.105850:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106146:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106157:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106166:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.106171:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106183:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106208:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.106217:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad804a2/0x721975f94674faac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76038144->76042239] (req 76038144->76042239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.106438:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607808:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14952us (15309us total) trans 4294985872 rc 0/0 00000100:00100000:0.0:1789760797.106452:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18575 00000100:00100000:0.0:1789760797.106465:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735335734013 time 735351756464 state 0x2 ref 0 00000100:00100000:2.0:1789760797.111408:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.111616:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565607936 00000100:00100000:3.0:1789760797.111629:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565607936 00000100:00100000:3.0:1789760797.111841:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735335734013 time 735351756464 state 0x0 ref 1 00000100:00100000:3.0:1789760797.111864:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735352016880 time 735351756464 state 0x1 ref 1 00000100:00100000:2.0:1789760797.112150:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735352016880 time 735372437543 state 0x0 ref 1 00000100:00100000:2.0:1789760797.112168:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607936:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.112234:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76042240, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24440 00010000:00010000:2.0:1789760797.112245:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.112264:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760797.112270:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.112277:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.112293:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.128168:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985873 is committed 00002000:00010000:1.0:1789760797.132876:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76042240 -> 76046336 00002000:00010000:1.0:1789760797.132891:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148544 -> 148552 00010000:00010000:1.0:1789760797.132910:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.132925:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.133111:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.133118:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.133124:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.133133:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.133156:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.133164:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5fa6a3/0x721975f94674fab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76042240->76046335] (req 76042240->76046335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.133300:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565607936:12345-192.168.203.47@tcp:4:dd.0 Request processed in 21129us (22416us total) trans 4294985873 rc 0/0 00000100:00100000:1.0:1789760797.133314:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18576 00000100:00100000:1.0:1789760797.133396:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735352016880 time 735372437543 state 0x2 ref 0 00000100:00100000:2.0:1789760797.143285:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.146618:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608064 00000100:00100000:0.0:1789760797.146640:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608064 00000100:00100000:2.0:1789760797.150877:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735352016880 time 735372437543 state 0x0 ref 1 00000100:00100000:2.0:1789760797.150902:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735372697959 time 735372437543 state 0x1 ref 1 00000100:00100000:2.0:1789760797.150955:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735372697959 time 735411246266 state 0x0 ref 1 00000100:00100000:2.0:1789760797.150981:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565608064:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.151116:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76046336, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24448 00010000:00010000:2.0:1789760797.151129:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.151151:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:2.0:1789760797.151157:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.151166:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.151397:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.161128:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985874 is committed 00002000:00010000:2.0:1789760797.161560:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76046336 -> 76050432 00002000:00010000:2.0:1789760797.161567:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148552 -> 148560 00010000:00010000:2.0:1789760797.161593:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161608:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161619:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161627:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42270200 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.161633:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161643:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161673:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.161681:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71a01c/0x721975f94674faba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76046336->76050431] (req 76046336->76050431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.161999:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565608064:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11023us (18719us total) trans 4294985874 rc 0/0 00000100:00100000:2.0:1789760797.162012:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18577 00000100:00100000:2.0:1789760797.162025:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735372697959 time 735411246266 state 0x2 ref 0 00000100:00100000:1.0:1789760797.170800:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.170904:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608192 00000100:00100000:0.0:1789760797.170917:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608192 00000100:00100000:0.0:1789760797.171016:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735372697959 time 735411246266 state 0x0 ref 1 00000100:00100000:0.0:1789760797.171036:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735411506682 time 735411246266 state 0x1 ref 1 00000100:00100000:0.0:1789760797.171075:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735411506682 time 735431367415 state 0x0 ref 1 00000100:00100000:0.0:1789760797.171090:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565608192:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.171158:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76050432, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24450 00010000:00010000:0.0:1789760797.171169:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.171188:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.171204:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.171211:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.171227:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.188794:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985875 is committed 00002000:00010000:0.0:1789760797.189388:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76050432 -> 76054528 00002000:00010000:0.0:1789760797.189396:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148560 -> 148568 00010000:00010000:0.0:1789760797.189413:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189428:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189439:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189454:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.189460:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189471:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189495:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.189503:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022be461d/0x721975f94674fac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76050432->76054527] (req 76050432->76054527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.189652:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d429c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565608192:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18556us (18858us total) trans 4294985875 rc 0/0 00000100:00100000:0.0:1789760797.189665:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18578 00000100:00100000:0.0:1789760797.189678:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735411506682 time 735431367415 state 0x2 ref 0 00000100:00100000:3.0:1789760797.197042:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.198063:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608320 00000100:00100000:1.0:1789760797.198079:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608320 00000100:00100000:1.0:1789760797.198155:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735411506682 time 735431367415 state 0x0 ref 1 00000100:00100000:1.0:1789760797.198175:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735431627831 time 735431367415 state 0x1 ref 1 00000100:00100000:1.0:1789760797.198227:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735431627831 time 735458518944 state 0x0 ref 1 00000100:00100000:1.0:1789760797.198243:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608320:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.198306:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76054528, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24458 00010000:00010000:1.0:1789760797.198484:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.198512:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.198517:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.198525:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.198543:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.213010:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985876 is committed 00002000:00010000:1.0:1789760797.213593:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76054528 -> 76058624 00002000:00010000:1.0:1789760797.213602:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148568 -> 148576 00010000:00010000:1.0:1789760797.213620:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213635:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213645:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213653:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.213659:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213668:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213700:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.213738:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76054528->76058623] (req 76054528->76058623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.213933:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608320:12345-192.168.203.47@tcp:4:dd.0 Request processed in 15684us (16897us total) trans 4294985876 rc 0/0 00000100:00100000:1.0:1789760797.213946:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18579 00000100:00100000:1.0:1789760797.213959:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735431627831 time 735458518944 state 0x2 ref 0 00000100:00100000:2.0:1789760797.217095:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.217325:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608448 00000100:00100000:3.0:1789760797.217341:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608448 00000100:00100000:3.0:1789760797.217418:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735431627831 time 735458518944 state 0x0 ref 1 00000100:00100000:3.0:1789760797.217438:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735458779360 time 735458518944 state 0x1 ref 1 00000100:00100000:3.0:1789760797.217477:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735458779360 time 735477768824 state 0x0 ref 1 00000100:00100000:3.0:1789760797.217493:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608448:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.217577:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76058624, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24460 00010000:00010000:3.0:1789760797.217598:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.217620:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.217625:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.217633:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.217650:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.231186:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985877 is committed 00002000:00010000:3.0:1789760797.240112:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76058624 -> 76062720 00002000:00010000:3.0:1789760797.240127:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148576 -> 148584 00010000:00010000:3.0:1789760797.240146:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240163:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240173:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240182:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.240325:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240339:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240365:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.240375:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674facf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76058624->76062719] (req 76058624->76062719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.240662:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608448:12345-192.168.203.47@tcp:4:dd.0 Request processed in 23164us (23575us total) trans 4294985877 rc 0/0 00000100:00100000:3.0:1789760797.240676:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18580 00000100:00100000:3.0:1789760797.240688:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735458779360 time 735477768824 state 0x2 ref 0 00000100:00100000:0.0:1789760797.250027:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.250419:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608576 00000100:00100000:3.0:1789760797.250432:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608576 00000100:00100000:3.0:1789760797.250506:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735458779360 time 735477768824 state 0x0 ref 1 00000100:00100000:3.0:1789760797.250536:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735478029240 time 735477768824 state 0x1 ref 1 00000100:00100000:3.0:1789760797.250573:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735478029240 time 735510864688 state 0x0 ref 1 00000100:00100000:3.0:1789760797.250597:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565608576:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.250660:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76062720, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24468 00010000:00010000:3.0:1789760797.250672:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.250692:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.250697:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.250752:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.250771:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.260440:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985878 is committed 00002000:00010000:0.0:1789760797.260650:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76062720 -> 76066816 00002000:00010000:0.0:1789760797.260657:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148584 -> 148592 00010000:00010000:0.0:1789760797.260675:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260697:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260806:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260815:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ef600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.260820:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260831:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260856:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.260864:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb73bc/0x721975f94674fad6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76062720->76066815] (req 76062720->76066815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.261877:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565608576:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11282us (11854us total) trans 4294985878 rc 0/0 00000100:00100000:1.0:1789760797.261893:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18581 00000100:00100000:1.0:1789760797.261905:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735478029240 time 735510864688 state 0x2 ref 0 00000100:00100000:2.0:1789760797.266884:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.267002:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608704 00000100:00100000:1.0:1789760797.267015:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608704 00000100:00100000:1.0:1789760797.267158:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735478029240 time 735510864688 state 0x0 ref 1 00000100:00100000:1.0:1789760797.267181:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735511125104 time 735510864688 state 0x1 ref 1 00000100:00100000:1.0:1789760797.267217:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735511125104 time 735527508643 state 0x0 ref 1 00000100:00100000:1.0:1789760797.267230:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608704:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.267297:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76066816, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24470 00010000:00010000:1.0:1789760797.267309:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.267329:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.267334:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.267342:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.267359:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.276906:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985879 is committed 00002000:00010000:1.0:1789760797.278031:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76066816 -> 76070912 00002000:00010000:1.0:1789760797.278042:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148592 -> 148600 00010000:00010000:1.0:1789760797.278063:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278081:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278091:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278100:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.278108:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278124:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278147:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.278157:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fadd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76066816->76070911] (req 76066816->76070911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.278314:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608704:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11080us (11438us total) trans 4294985879 rc 0/0 00000100:00100000:1.0:1789760797.278326:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18582 00000100:00100000:1.0:1789760797.278336:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735511125104 time 735527508643 state 0x2 ref 0 00000100:00100000:2.0:1789760797.283049:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.283627:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608832 00000100:00100000:3.0:1789760797.283643:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608832 00000100:00100000:3.0:1789760797.283781:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735511125104 time 735527508643 state 0x0 ref 1 00000100:00100000:3.0:1789760797.283802:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735527769059 time 735527508643 state 0x1 ref 1 00000100:00100000:3.0:1789760797.283844:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735527769059 time 735544134964 state 0x0 ref 1 00000100:00100000:3.0:1789760797.283861:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565608832:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.284011:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76070912, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24478 00010000:00010000:3.0:1789760797.284026:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.284048:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.284054:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.284064:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.284083:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.293040:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985880 is committed 00002000:00010000:3.0:1789760797.293216:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76070912 -> 76075008 00002000:00010000:3.0:1789760797.293222:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148600 -> 148608 00010000:00010000:3.0:1789760797.293240:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293257:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293275:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293288:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.293296:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293307:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293336:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.293343:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76070912->76075007] (req 76070912->76075007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.293509:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565608832:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9638us (10460us total) trans 4294985880 rc 0/0 00000100:00100000:3.0:1789760797.293522:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18583 00000100:00100000:3.0:1789760797.293534:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735527769059 time 735544134964 state 0x2 ref 0 00000100:00100000:0.0:1789760797.297375:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.302093:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565608960 00000100:00100000:1.0:1789760797.302115:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565608960 00000100:00100000:1.0:1789760797.302215:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735527769059 time 735544134964 state 0x0 ref 1 00000100:00100000:1.0:1789760797.302234:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735544395380 time 735544134964 state 0x1 ref 1 00000100:00100000:1.0:1789760797.302324:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735544395380 time 735562614950 state 0x0 ref 1 00000100:00100000:1.0:1789760797.302340:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608960:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.302406:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76075008, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24480 00010000:00010000:1.0:1789760797.302418:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.302438:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.302443:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.302451:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.302467:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.315279:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985881 is committed 00002000:00010000:1.0:1789760797.315436:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76075008 -> 76079104 00002000:00010000:1.0:1789760797.315442:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148608 -> 148616 00010000:00010000:1.0:1789760797.315462:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315477:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315487:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315496:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.315502:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315511:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315556:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.315564:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674faeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76075008->76079103] (req 76075008->76079103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.316066:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565608960:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13369us (18347us total) trans 4294985881 rc 0/0 00000100:00100000:1.0:1789760797.316080:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18584 00000100:00100000:1.0:1789760797.316093:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735544395380 time 735562614950 state 0x2 ref 0 00000100:00100000:2.0:1789760797.327379:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.327665:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609088 00000100:00100000:1.0:1789760797.327678:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609088 00000100:00100000:1.0:1789760797.327763:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735544395380 time 735562614950 state 0x0 ref 1 00000100:00100000:1.0:1789760797.327778:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735562875366 time 735562614950 state 0x1 ref 1 00000100:00100000:1.0:1789760797.327808:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735562875366 time 735588099517 state 0x0 ref 1 00000100:00100000:1.0:1789760797.327822:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609088:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.327886:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76079104, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24488 00010000:00010000:1.0:1789760797.327897:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.327913:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.327918:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.327924:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.327937:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.339575:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985882 is committed 00002000:00010000:1.0:1789760797.339791:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76079104 -> 76083200 00002000:00010000:1.0:1789760797.339798:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148616 -> 148624 00010000:00010000:1.0:1789760797.339815:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339831:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339841:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339849:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.339855:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339864:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339891:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.339905:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674faf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76079104->76083199] (req 76079104->76083199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.340239:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609088:12345-192.168.203.47@tcp:4:dd.0 Request processed in 12411us (12868us total) trans 4294985882 rc 0/0 00000100:00100000:1.0:1789760797.340254:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18585 00000100:00100000:1.0:1789760797.340268:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735562875366 time 735588099517 state 0x2 ref 0 00000100:00100000:2.0:1789760797.348140:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.348393:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609216 00000100:00100000:3.0:1789760797.348406:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609216 00000100:00100000:3.0:1789760797.348482:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735562875366 time 735588099517 state 0x0 ref 1 00000100:00100000:3.0:1789760797.348502:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735588359933 time 735588099517 state 0x1 ref 1 00000100:00100000:3.0:1789760797.348541:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735588359933 time 735608833017 state 0x0 ref 1 00000100:00100000:3.0:1789760797.348558:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609216:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.348644:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76083200, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24490 00010000:00010000:3.0:1789760797.348657:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.348678:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.348683:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.348692:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.348953:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.357636:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985883 is committed 00002000:00010000:3.0:1789760797.357790:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76083200 -> 76087296 00002000:00010000:3.0:1789760797.357796:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148624 -> 148632 00010000:00010000:3.0:1789760797.357813:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357828:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357838:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357853:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.357859:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357870:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357897:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.357905:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674faf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76083200->76087295] (req 76083200->76087295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.358053:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609216:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9492us (9922us total) trans 4294985883 rc 0/0 00000100:00100000:3.0:1789760797.358066:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18586 00000100:00100000:3.0:1789760797.358078:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735588359933 time 735608833017 state 0x2 ref 0 00000100:00100000:3.0:1789760797.363200:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.363304:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609344 00000100:00100000:1.0:1789760797.363317:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609344 00000100:00100000:1.0:1789760797.363392:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735588359933 time 735608833017 state 0x0 ref 1 00000100:00100000:1.0:1789760797.363410:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735609093433 time 735608833017 state 0x1 ref 1 00000100:00100000:1.0:1789760797.363446:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735609093433 time 735623737674 state 0x0 ref 1 00000100:00100000:1.0:1789760797.363460:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609344:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.363523:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76087296, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24498 00010000:00010000:1.0:1789760797.363536:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.363555:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.363560:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.363568:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.363605:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.371176:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985884 is committed 00002000:00010000:1.0:1789760797.372707:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76087296 -> 76091392 00002000:00010000:1.0:1789760797.372762:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148632 -> 148640 00010000:00010000:1.0:1789760797.372780:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372795:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372806:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372815:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.372821:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372831:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372853:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.372861:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8041a/0x721975f94674fb00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76087296->76091391] (req 76087296->76091391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.372991:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609344:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9527us (9798us total) trans 4294985884 rc 0/0 00000100:00100000:1.0:1789760797.373004:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18587 00000100:00100000:1.0:1789760797.373017:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735609093433 time 735623737674 state 0x2 ref 0 00000100:00100000:2.0:1789760797.378247:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.379266:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609472 00000100:00100000:1.0:1789760797.379288:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609472 00000100:00100000:1.0:1789760797.379382:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735609093433 time 735623737674 state 0x0 ref 1 00000100:00100000:1.0:1789760797.379402:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735623998090 time 735623737674 state 0x1 ref 1 00000100:00100000:1.0:1789760797.379446:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735623998090 time 735639735694 state 0x0 ref 1 00000100:00100000:1.0:1789760797.379460:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609472:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.379528:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76091392, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244a0 00010000:00010000:1.0:1789760797.379541:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.379562:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.379566:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.379574:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.379604:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.396663:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985885 is committed 00002000:00010000:0.0:1789760797.414856:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76091392 -> 76095488 00002000:00010000:0.0:1789760797.414870:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148640 -> 148648 00010000:00010000:0.0:1789760797.414889:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414906:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414916:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414924:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaa600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.414942:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414953:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414980:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.414990:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007752b370/0x721975f94674fb07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76091392->76095487] (req 76091392->76095487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.415137:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609472:12345-192.168.203.47@tcp:4:dd.0 Request processed in 35671us (36897us total) trans 4294985885 rc 0/0 00000100:00100000:0.0:1789760797.415150:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18588 00000100:00100000:0.0:1789760797.415162:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735623998090 time 735639735694 state 0x2 ref 0 00000100:00100000:2.0:1789760797.420470:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.420577:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609600 00000100:00100000:3.0:1789760797.420600:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609600 00000100:00100000:3.0:1789760797.420687:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735623998090 time 735639735694 state 0x0 ref 1 00000100:00100000:3.0:1789760797.420748:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735639996110 time 735639735694 state 0x1 ref 1 00000100:00100000:3.0:1789760797.420782:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735639996110 time 735681073402 state 0x0 ref 1 00000100:00100000:3.0:1789760797.420796:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565609600:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.420862:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76095488, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244a8 00010000:00010000:3.0:1789760797.420874:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.420896:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.420902:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.420910:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.420927:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.429443:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985886 is committed 00002000:00010000:3.0:1789760797.429601:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76095488 -> 76099584 00002000:00010000:3.0:1789760797.429608:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148648 -> 148656 00010000:00010000:3.0:1789760797.429682:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.429699:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.429900:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.429909:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.429916:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.429927:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.430839:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.430849:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76095488->76099583] (req 76095488->76099583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.431347:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565609600:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10543us (10887us total) trans 4294985886 rc 0/0 00000100:00100000:3.0:1789760797.431363:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18589 00000100:00100000:3.0:1789760797.431376:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735639996110 time 735681073402 state 0x2 ref 0 00000100:00100000:1.0:1789760797.443841:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.443968:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609728 00000100:00100000:0.0:1789760797.443981:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609728 00000100:00100000:0.0:1789760797.444066:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735639996110 time 735681073402 state 0x0 ref 1 00000100:00100000:0.0:1789760797.444085:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735681333818 time 735681073402 state 0x1 ref 1 00000100:00100000:0.0:1789760797.444128:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735681333818 time 735704419181 state 0x0 ref 1 00000100:00100000:0.0:1789760797.444143:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609728:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.444205:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76099584, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244b0 00010000:00010000:0.0:1789760797.444216:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.444236:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.444242:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.444249:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.444265:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.451962:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985887 is committed 00002000:00010000:0.0:1789760797.452794:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76099584 -> 76103680 00002000:00010000:0.0:1789760797.452804:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148656 -> 148664 00010000:00010000:0.0:1789760797.452823:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452840:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452850:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452864:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.452870:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452880:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452907:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.452915:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76099584->76103679] (req 76099584->76103679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.453288:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565609728:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9139us (9453us total) trans 4294985887 rc 0/0 00000100:00100000:0.0:1789760797.453691:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18590 00000100:00100000:0.0:1789760797.453754:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735681333818 time 735704419181 state 0x2 ref 0 00000100:00100000:2.0:1789760797.461639:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.463908:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609856 00000100:00100000:0.0:1789760797.463941:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609856 00000100:00100000:0.0:1789760797.464359:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735681333818 time 735704419181 state 0x0 ref 1 00000100:00100000:0.0:1789760797.464379:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735704679597 time 735704419181 state 0x1 ref 1 00000100:00100000:0.0:1789760797.464427:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735704679597 time 735724718515 state 0x0 ref 1 00000100:00100000:0.0:1789760797.464448:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6d686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565609856:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.464521:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76103680, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244b8 00010000:00010000:0.0:1789760797.464533:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.464553:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.464559:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.464567:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.464597:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.481758:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985888 is committed 00002000:00010000:0.0:1789760797.481913:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76103680 -> 76107776 00002000:00010000:0.0:1789760797.481920:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148664 -> 148672 00010000:00010000:0.0:1789760797.481948:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.481964:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.481974:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.482196:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.482203:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.482215:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.482241:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.482250:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76103680->76107775] (req 76103680->76107775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.482479:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6d686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565609856:12345-192.168.203.47@tcp:4:dd.0 Request processed in 18029us (20849us total) trans 4294985888 rc 0/0 00000100:00100000:0.0:1789760797.482492:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18591 00000100:00100000:0.0:1789760797.482505:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735704679597 time 735724718515 state 0x2 ref 0 00000100:00100000:2.0:1789760797.494633:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.494906:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565609984 00000100:00100000:3.0:1789760797.494920:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565609984 00000100:00100000:3.0:1789760797.495010:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735704679597 time 735724718515 state 0x0 ref 1 00000100:00100000:3.0:1789760797.495029:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735724978931 time 735724718515 state 0x1 ref 1 00000100:00100000:3.0:1789760797.495070:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735724978931 time 735755361642 state 0x0 ref 1 00000100:00100000:3.0:1789760797.495085:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565609984:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.495465:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76107776, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244c0 00010000:00010000:3.0:1789760797.495478:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.495497:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.495502:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.495510:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.495537:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.504509:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985889 is committed 00002000:00010000:3.0:1789760797.504819:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76107776 -> 76111872 00002000:00010000:3.0:1789760797.504825:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148672 -> 148680 00010000:00010000:3.0:1789760797.504843:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.504857:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.504867:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.504876:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.504882:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.504892:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.504919:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.505154:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76107776->76111871] (req 76107776->76111871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.505322:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565609984:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10234us (10697us total) trans 4294985889 rc 0/0 00000100:00100000:3.0:1789760797.505334:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18592 00000100:00100000:3.0:1789760797.505347:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735724978931 time 735755361642 state 0x2 ref 0 00000100:00100000:1.0:1789760797.516337:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.516486:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610112 00000100:00100000:0.0:1789760797.516500:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610112 00000100:00100000:0.0:1789760797.516594:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735724978931 time 735755361642 state 0x0 ref 1 00000100:00100000:0.0:1789760797.516613:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735755622058 time 735755361642 state 0x1 ref 1 00000100:00100000:0.0:1789760797.516648:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735755622058 time 735776940421 state 0x0 ref 1 00000100:00100000:0.0:1789760797.516661:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610112:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.516781:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76111872, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244c8 00010000:00010000:0.0:1789760797.516793:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.516812:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.516819:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.516826:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.516844:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.523975:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985890 is committed 00002000:00010000:1.0:1789760797.524311:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76111872 -> 76115968 00002000:00010000:1.0:1789760797.524318:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148680 -> 148688 00010000:00010000:1.0:1789760797.524337:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524353:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524362:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524371:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9a00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.524377:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524386:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524411:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.524419:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000045e529d/0x721975f94674fb2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76111872->76115967] (req 76111872->76115967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.524666:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610112:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7998us (8336us total) trans 4294985890 rc 0/0 00000100:00100000:1.0:1789760797.524679:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18593 00000100:00100000:1.0:1789760797.524692:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735755622058 time 735776940421 state 0x2 ref 0 00000100:00100000:2.0:1789760797.528452:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.528551:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610240 00000100:00100000:0.0:1789760797.528563:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610240 00000100:00100000:0.0:1789760797.528653:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735755622058 time 735776940421 state 0x0 ref 1 00000100:00100000:0.0:1789760797.528673:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735777200837 time 735776940421 state 0x1 ref 1 00000100:00100000:0.0:1789760797.528746:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735777200837 time 735789037556 state 0x0 ref 1 00000100:00100000:0.0:1789760797.528760:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565610240:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.528821:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76115968, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244d0 00010000:00010000:0.0:1789760797.528832:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.528853:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.528858:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.528868:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.528887:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.541669:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985891 is committed 00002000:00010000:0.0:1789760797.541918:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76115968 -> 76120064 00002000:00010000:0.0:1789760797.541926:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148688 -> 148696 00010000:00010000:0.0:1789760797.541955:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.541971:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.541982:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.541990:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.541996:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.542006:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.542032:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.542047:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76115968->76120063] (req 76115968->76120063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.542175:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565610240:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13408us (13730us total) trans 4294985891 rc 0/0 00000100:00100000:0.0:1789760797.542188:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18594 00000100:00100000:0.0:1789760797.542200:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735777200837 time 735789037556 state 0x2 ref 0 00000100:00100000:2.0:1789760797.551460:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.551559:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610368 00000100:00100000:3.0:1789760797.551572:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610368 00000100:00100000:3.0:1789760797.551661:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735777200837 time 735789037556 state 0x0 ref 1 00000100:00100000:3.0:1789760797.551679:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735789297972 time 735789037556 state 0x1 ref 1 00000100:00100000:3.0:1789760797.551750:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735789297972 time 735812040984 state 0x0 ref 1 00000100:00100000:3.0:1789760797.551765:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610368:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.551825:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76120064, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244d8 00010000:00010000:3.0:1789760797.551837:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.551862:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.551867:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.551875:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.551892:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.559439:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985892 is committed 00002000:00010000:3.0:1789760797.560818:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76120064 -> 76124160 00002000:00010000:3.0:1789760797.560831:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148696 -> 148704 00010000:00010000:3.0:1789760797.560851:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560867:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560878:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560887:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.560893:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560903:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560943:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560952:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76120064->76124159] (req 76120064->76124159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.561138:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610368:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9368us (9683us total) trans 4294985892 rc 0/0 00000100:00100000:3.0:1789760797.561151:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18595 00000100:00100000:3.0:1789760797.561164:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735789297972 time 735812040984 state 0x2 ref 0 00000100:00100000:1.0:1789760797.570334:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.570458:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610496 00000100:00100000:0.0:1789760797.570472:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610496 00000100:00100000:0.0:1789760797.570546:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735789297972 time 735812040984 state 0x0 ref 1 00000100:00100000:0.0:1789760797.570566:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735812301400 time 735812040984 state 0x1 ref 1 00000100:00100000:0.0:1789760797.570609:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735812301400 time 735830901424 state 0x0 ref 1 00000100:00100000:0.0:1789760797.570623:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610496:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.570683:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76124160, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244e0 00010000:00010000:0.0:1789760797.570694:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.570746:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.570752:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.570759:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.570778:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.578331:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985893 is committed 00002000:00010000:0.0:1789760797.578474:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76124160 -> 76128256 00002000:00010000:0.0:1789760797.578481:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148704 -> 148712 00010000:00010000:0.0:1789760797.578500:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578515:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578538:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578546:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.578551:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578560:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578595:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.578604:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76124160->76128255] (req 76124160->76128255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.578769:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565610496:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8140us (8439us total) trans 4294985893 rc 0/0 00000100:00100000:0.0:1789760797.578781:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18596 00000100:00100000:0.0:1789760797.578794:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735812301400 time 735830901424 state 0x2 ref 0 00000100:00100000:2.0:1789760797.587011:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.587174:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610624 00000100:00100000:1.0:1789760797.587187:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610624 00000100:00100000:1.0:1789760797.587258:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735812301400 time 735830901424 state 0x0 ref 1 00000100:00100000:1.0:1789760797.587275:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735831161840 time 735830901424 state 0x1 ref 1 00000100:00100000:1.0:1789760797.587310:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735831161840 time 735847601805 state 0x0 ref 1 00000100:00100000:1.0:1789760797.587323:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565610624:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.587383:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76128256, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244e8 00010000:00010000:1.0:1789760797.587393:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.587413:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.587418:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.587426:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.587442:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.604506:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985894 is committed 00002000:00010000:1.0:1789760797.610332:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76128256 -> 76132352 00002000:00010000:1.0:1789760797.610347:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148712 -> 148720 00010000:00010000:1.0:1789760797.610365:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610382:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610393:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610402:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.610414:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610424:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610451:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.610460:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76128256->76132351] (req 76128256->76132351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.610856:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565610624:12345-192.168.203.47@tcp:4:dd.0 Request processed in 23527us (23848us total) trans 4294985894 rc 0/0 00000100:00100000:1.0:1789760797.610870:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18597 00000100:00100000:1.0:1789760797.610882:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735831161840 time 735847601805 state 0x2 ref 0 00000100:00100000:2.0:1789760797.618256:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.618425:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610752 00000100:00100000:3.0:1789760797.618439:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610752 00000100:00100000:3.0:1789760797.618522:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735831161840 time 735847601805 state 0x0 ref 1 00000100:00100000:3.0:1789760797.618542:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735847862221 time 735847601805 state 0x1 ref 1 00000100:00100000:3.0:1789760797.618578:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735847862221 time 735878869524 state 0x0 ref 1 00000100:00100000:3.0:1789760797.618601:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565610752:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.618674:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76132352, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244f0 00010000:00010000:3.0:1789760797.618685:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.618746:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.618753:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.618762:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.618777:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.628471:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985895 is committed 00002000:00010000:3.0:1789760797.628682:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76132352 -> 76136448 00002000:00010000:3.0:1789760797.628688:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148720 -> 148728 00010000:00010000:3.0:1789760797.628726:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628742:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628753:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628761:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.628767:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628777:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628801:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.628817:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76132352->76136447] (req 76132352->76136447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.628933:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565610752:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10326us (10684us total) trans 4294985895 rc 0/0 00000100:00100000:3.0:1789760797.628944:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18598 00000100:00100000:3.0:1789760797.628958:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735847862221 time 735878869524 state 0x2 ref 0 00000100:00100000:2.0:1789760797.638101:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.638223:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565610880 00000100:00100000:0.0:1789760797.638236:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565610880 00000100:00100000:0.0:1789760797.638315:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735847862221 time 735878869524 state 0x0 ref 1 00000100:00100000:0.0:1789760797.638335:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735879129940 time 735878869524 state 0x1 ref 1 00000100:00100000:0.0:1789760797.638372:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735879129940 time 735898663917 state 0x0 ref 1 00000100:00100000:0.0:1789760797.638386:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565610880:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.638452:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76136448, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x244f8 00010000:00010000:0.0:1789760797.638463:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.638486:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.638492:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.638501:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.638519:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.646081:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985896 is committed 00002000:00010000:0.0:1789760797.646231:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76136448 -> 76140544 00002000:00010000:0.0:1789760797.646238:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148728 -> 148736 00010000:00010000:0.0:1789760797.646257:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646272:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646282:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646292:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.646296:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646308:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646335:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.646344:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76136448->76140543] (req 76136448->76140543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.646464:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565610880:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8074us (8373us total) trans 4294985896 rc 0/0 00000100:00100000:0.0:1789760797.646478:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18599 00000100:00100000:0.0:1789760797.646490:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735879129940 time 735898663917 state 0x2 ref 0 00000100:00100000:2.0:1789760797.651319:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.651485:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611008 00000100:00100000:1.0:1789760797.651500:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611008 00000100:00100000:1.0:1789760797.651576:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735879129940 time 735898663917 state 0x0 ref 1 00000100:00100000:1.0:1789760797.651605:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735898924333 time 735898663917 state 0x1 ref 1 00000100:00100000:1.0:1789760797.651646:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735898924333 time 735911938403 state 0x0 ref 1 00000100:00100000:1.0:1789760797.651660:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565611008:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.651761:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76140544, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24500 00010000:00010000:1.0:1789760797.651774:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.651795:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.651801:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.651809:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.651827:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.659164:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985897 is committed 00002000:00010000:1.0:1789760797.659455:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76140544 -> 76144640 00002000:00010000:1.0:1789760797.659462:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148736 -> 148744 00010000:00010000:1.0:1789760797.659481:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659498:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659508:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659517:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.659524:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659534:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659559:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.659568:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76140544->76144639] (req 76140544->76144639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.660064:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565611008:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8399us (8754us total) trans 4294985897 rc 0/0 00000100:00100000:1.0:1789760797.660078:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18600 00000100:00100000:1.0:1789760797.660090:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735898924333 time 735911938403 state 0x2 ref 0 00000100:00100000:2.0:1789760797.665875:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.669276:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611136 00000100:00100000:3.0:1789760797.669298:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611136 00000100:00100000:3.0:1789760797.669395:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735898924333 time 735911938403 state 0x0 ref 1 00000100:00100000:3.0:1789760797.669417:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735912198819 time 735911938403 state 0x1 ref 1 00000100:00100000:3.0:1789760797.669526:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735912198819 time 735929817544 state 0x0 ref 1 00000100:00100000:3.0:1789760797.669544:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611136:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.669621:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76144640, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24508 00010000:00010000:3.0:1789760797.669633:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.669655:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.669661:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.669667:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.669695:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.677760:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985898 is committed 00002000:00010000:3.0:1789760797.677894:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76144640 -> 76148736 00002000:00010000:3.0:1789760797.677900:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148744 -> 148752 00010000:00010000:3.0:1789760797.677917:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.677942:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.677952:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.677960:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.677965:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.677976:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.678001:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.678009:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76144640->76148735] (req 76144640->76148735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.678127:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611136:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8582us (12262us total) trans 4294985898 rc 0/0 00000100:00100000:3.0:1789760797.678138:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18601 00000100:00100000:3.0:1789760797.678150:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735912198819 time 735929817544 state 0x2 ref 0 00000100:00100000:2.0:1789760797.686699:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.686866:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611264 00000100:00100000:0.0:1789760797.686880:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611264 00000100:00100000:0.0:1789760797.686962:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735912198819 time 735929817544 state 0x0 ref 1 00000100:00100000:0.0:1789760797.686981:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735930077960 time 735929817544 state 0x1 ref 1 00000100:00100000:0.0:1789760797.687013:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735930077960 time 735947305252 state 0x0 ref 1 00000100:00100000:0.0:1789760797.687028:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611264:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.687100:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76148736, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24510 00010000:00010000:0.0:1789760797.687111:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.687131:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1789760797.687136:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.687144:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.687160:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.696126:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985899 is committed 00002000:00010000:1.0:1789760797.696279:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76148736 -> 76152832 00002000:00010000:1.0:1789760797.696286:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148752 -> 148760 00010000:00010000:1.0:1789760797.696302:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696317:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696327:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696335:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8400 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.696341:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696350:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696392:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.696401:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feaa4de8/0x721975f94674fb69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76148736->76152831] (req 76148736->76152831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.696579:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d42988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611264:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9547us (9886us total) trans 4294985899 rc 0/0 00000100:00100000:1.0:1789760797.696606:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18602 00000100:00100000:1.0:1789760797.696618:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735930077960 time 735947305252 state 0x2 ref 0 00000100:00100000:2.0:1789760797.707453:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.707665:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611392 00000100:00100000:1.0:1789760797.707680:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611392 00000100:00100000:1.0:1789760797.707794:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735930077960 time 735947305252 state 0x0 ref 1 00000100:00100000:1.0:1789760797.707812:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735947565668 time 735947305252 state 0x1 ref 1 00000100:00100000:1.0:1789760797.707848:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735947565668 time 735968139570 state 0x0 ref 1 00000100:00100000:1.0:1789760797.707864:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611392:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.707954:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76152832, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24518 00010000:00010000:1.0:1789760797.707968:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.707990:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1789760797.707996:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.708004:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.708023:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.714113:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985900 is committed 00002000:00010000:1.0:1789760797.714388:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76152832 -> 76156928 00002000:00010000:1.0:1789760797.714396:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148760 -> 148768 00010000:00010000:1.0:1789760797.714413:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714428:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714437:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714446:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.714451:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714461:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714485:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.714493:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76152832->76156927] (req 76152832->76156927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.714698:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4298ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611392:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6830us (7253us total) trans 4294985900 rc 0/0 00000100:00100000:1.0:1789760797.714759:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18603 00000100:00100000:1.0:1789760797.714771:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735947565668 time 735968139570 state 0x2 ref 0 00000100:00100000:0.0:1789760797.724660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.724867:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611520 00000100:00100000:3.0:1789760797.724881:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611520 00000100:00100000:3.0:1789760797.725003:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735947565668 time 735968139570 state 0x0 ref 1 00000100:00100000:3.0:1789760797.725020:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735968399986 time 735968139570 state 0x1 ref 1 00000100:00100000:3.0:1789760797.725099:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735968399986 time 735985390668 state 0x0 ref 1 00000100:00100000:3.0:1789760797.725113:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611520:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.725177:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76156928, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24520 00010000:00010000:3.0:1789760797.725189:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.725209:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1789760797.725214:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.725221:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.725237:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.730615:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985901 is committed 00002000:00010000:3.0:1789760797.734324:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76156928 -> 76161024 00002000:00010000:3.0:1789760797.734336:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148768 -> 148776 00010000:00010000:3.0:1789760797.734353:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734368:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734378:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734386:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.734391:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734401:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734426:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.734435:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76156928->76161023] (req 76156928->76161023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.734568:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611520:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9451us (9916us total) trans 4294985901 rc 0/0 00000100:00100000:3.0:1789760797.734590:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18604 00000100:00100000:3.0:1789760797.734603:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735968399986 time 735985390668 state 0x2 ref 0 00000100:00100000:2.0:1789760797.741307:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.741401:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611648 00000100:00100000:1.0:1789760797.741414:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611648 00000100:00100000:1.0:1789760797.741486:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735968399986 time 735985390668 state 0x0 ref 1 00000100:00100000:1.0:1789760797.741506:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735985651084 time 735985390668 state 0x1 ref 1 00000100:00100000:1.0:1789760797.741539:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735985651084 time 736001830929 state 0x0 ref 1 00000100:00100000:1.0:1789760797.741554:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611648:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.741628:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76161024, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24528 00010000:00010000:1.0:1789760797.741638:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.741659:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.741664:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.741672:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.741690:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760797.747446:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985902 is committed 00002000:00010000:1.0:1789760797.750063:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76161024 -> 76165120 00002000:00010000:1.0:1789760797.750075:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148776 -> 148784 00010000:00010000:1.0:1789760797.750093:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750114:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750124:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750133:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.750139:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750149:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750174:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.750182:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76161024->76165119] (req 76161024->76165119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.750392:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2360:x1876699565611648:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8833us (9092us total) trans 4294985902 rc 0/0 00000100:00100000:1.0:1789760797.750405:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18605 00000100:00100000:1.0:1789760797.750417:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735985651084 time 736001830929 state 0x2 ref 0 00000100:00100000:2.0:1789760797.759563:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.759694:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611776 00000100:00100000:1.0:1789760797.759741:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611776 00000100:00100000:1.0:1789760797.759821:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 735985651084 time 736001830929 state 0x0 ref 1 00000100:00100000:1.0:1789760797.759841:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736002091345 time 736001830929 state 0x1 ref 1 00000100:00100000:1.0:1789760797.759987:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736002091345 time 736020277685 state 0x0 ref 1 00000100:00100000:1.0:1789760797.760003:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565611776:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.760069:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76165120, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24530 00010000:00010000:1.0:1789760797.760081:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.760100:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.760106:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.760114:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.760130:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.768826:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985903 is committed 00002000:00010000:1.0:1789760797.769845:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76165120 -> 76169216 00002000:00010000:1.0:1789760797.769981:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148784 -> 148792 00010000:00010000:1.0:1789760797.770001:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770018:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770035:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770327:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.770333:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770344:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770371:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.770379:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76165120->76169215] (req 76165120->76169215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.770667:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565611776:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10507us (11146us total) trans 4294985903 rc 0/0 00000100:00100000:1.0:1789760797.770680:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18606 00000100:00100000:1.0:1789760797.770692:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736002091345 time 736020277685 state 0x2 ref 0 00000100:00100000:1.0:1789760797.780555:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.780790:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565611904 00000100:00100000:3.0:1789760797.780803:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565611904 00000100:00100000:3.0:1789760797.780946:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736002091345 time 736020277685 state 0x0 ref 1 00000100:00100000:3.0:1789760797.780968:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736020538101 time 736020277685 state 0x1 ref 1 00000100:00100000:3.0:1789760797.781058:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736020538101 time 736041348292 state 0x0 ref 1 00000100:00100000:3.0:1789760797.781075:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565611904:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.781282:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76169216, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24538 00010000:00010000:3.0:1789760797.781294:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.781315:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1789760797.781321:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.781328:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.781346:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760797.794403:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985904 is committed 00002000:00010000:3.0:1789760797.794907:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76169216 -> 76173312 00002000:00010000:3.0:1789760797.794914:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148792 -> 148800 00010000:00010000:3.0:1789760797.794935:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.794950:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.794970:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.794979:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760797.794985:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.794994:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.795019:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.795028:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fb8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76169216->76173311] (req 76169216->76173311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.795150:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565611904:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14073us (14605us total) trans 4294985904 rc 0/0 00000100:00100000:3.0:1789760797.795162:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18607 00000100:00100000:3.0:1789760797.795174:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736020538101 time 736041348292 state 0x2 ref 0 00000100:00100000:2.0:1789760797.798574:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.799153:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612032 00000100:00100000:1.0:1789760797.799167:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612032 00000100:00100000:1.0:1789760797.799243:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736020538101 time 736041348292 state 0x0 ref 1 00000100:00100000:1.0:1789760797.799263:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736041608708 time 736041348292 state 0x1 ref 1 00000100:00100000:1.0:1789760797.799302:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736041608708 time 736059593199 state 0x0 ref 1 00000100:00100000:1.0:1789760797.799317:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612032:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.799387:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76173312, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24540 00010000:00010000:1.0:1789760797.799399:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.799419:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.799425:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.799432:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.799450:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.810690:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985905 is committed 00002000:00010000:0.0:1789760797.813379:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76173312 -> 76177408 00002000:00010000:0.0:1789760797.813395:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148800 -> 148808 00010000:00010000:0.0:1789760797.813416:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813431:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813440:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813448:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaae00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.813454:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813465:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813490:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.813498:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc5f005/0x721975f94674fb93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76173312->76177407] (req 76173312->76177407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.814172:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e7f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612032:12345-192.168.203.47@tcp:4:dd.0 Request processed in 14848us (15603us total) trans 4294985905 rc 0/0 00000100:00100000:0.0:1789760797.814187:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18608 00000100:00100000:0.0:1789760797.814200:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736041608708 time 736059593199 state 0x2 ref 0 00000100:00100000:2.0:1789760797.820800:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.821661:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612160 00000100:00100000:1.0:1789760797.821678:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612160 00000100:00100000:1.0:1789760797.821788:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736041608708 time 736059593199 state 0x0 ref 1 00000100:00100000:1.0:1789760797.821808:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736059853615 time 736059593199 state 0x1 ref 1 00000100:00100000:1.0:1789760797.821849:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736059853615 time 736082140323 state 0x0 ref 1 00000100:00100000:1.0:1789760797.821863:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565612160:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.821928:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76177408, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24548 00010000:00010000:1.0:1789760797.821940:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.821960:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.821965:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.821973:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.821990:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.828139:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985906 is committed 00002000:00010000:1.0:1789760797.830157:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76177408 -> 76181504 00002000:00010000:1.0:1789760797.830169:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148808 -> 148816 00010000:00010000:1.0:1789760797.830185:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830200:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830210:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830218:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eab000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.830224:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830240:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830263:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.830270:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418ec163/0x721975f94674fb9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76177408->76181503] (req 76177408->76181503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.830414:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565612160:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8549us (9624us total) trans 4294985906 rc 0/0 00000100:00100000:1.0:1789760797.830425:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18609 00000100:00100000:1.0:1789760797.830437:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736059853615 time 736082140323 state 0x2 ref 0 00000100:00100000:1.0:1789760797.835106:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760797.835604:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612288 00000100:00100000:3.0:1789760797.835620:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612288 00000100:00100000:3.0:1789760797.835730:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736059853615 time 736082140323 state 0x0 ref 1 00000100:00100000:3.0:1789760797.835752:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736082400739 time 736082140323 state 0x1 ref 1 00000100:00100000:3.0:1789760797.835798:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736082400739 time 736096089624 state 0x0 ref 1 00000100:00100000:3.0:1789760797.835815:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612288:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760797.835884:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76181504, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24550 00010000:00010000:3.0:1789760797.835896:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.835917:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1789760797.835922:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.836176:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.836198:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.846419:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985907 is committed 00002000:00010000:2.0:1789760797.846679:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76181504 -> 76185600 00002000:00010000:2.0:1789760797.846686:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148816 -> 148824 00010000:00010000:2.0:1789760797.846779:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846794:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846804:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846812:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.846818:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846829:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846853:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.846862:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d7fae/0x721975f94674fba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76181504->76185599] (req 76181504->76185599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.847091:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612288:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11272us (11991us total) trans 4294985907 rc 0/0 00000100:00100000:2.0:1789760797.847104:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18610 00000100:00100000:2.0:1789760797.847116:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736082400739 time 736096089624 state 0x2 ref 0 00000100:00100000:2.0:1789760797.849352:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.851032:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612416 00000100:00100000:0.0:1789760797.851052:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612416 00000100:00100000:0.0:1789760797.851143:0:6958:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736082400739 time 736096089624 state 0x0 ref 1 00000100:00100000:0.0:1789760797.851166:0:6958:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736096350040 time 736096089624 state 0x1 ref 1 00000100:00100000:0.0:1789760797.851255:0:6958:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736096350040 time 736111545463 state 0x0 ref 1 00000100:00100000:0.0:1789760797.851273:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612416:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.851343:0:6958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76185600, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24558 00010000:00010000:0.0:1789760797.851354:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.851376:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760797.851381:0:6958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.851389:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.851406:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.857616:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985908 is committed 00002000:00010000:0.0:1789760797.857827:0:6958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76185600 -> 76189696 00002000:00010000:0.0:1789760797.857834:0:6958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148824 -> 148832 00010000:00010000:0.0:1789760797.857851:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857865:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857875:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857884:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.857889:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857899:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857922:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.857992:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fba8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76185600->76189695] (req 76185600->76189695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.858151:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612416:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6876us (8806us total) trans 4294985908 rc 0/0 00000100:00100000:0.0:1789760797.858164:0:6958:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18611 00000100:00100000:0.0:1789760797.858177:0:6958:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736096350040 time 736111545463 state 0x2 ref 0 00000100:00100000:3.0:1789760797.869564:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.869815:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612544 00000100:00100000:1.0:1789760797.869828:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612544 00000100:00100000:1.0:1789760797.869903:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736096350040 time 736111545463 state 0x0 ref 1 00000100:00100000:1.0:1789760797.869923:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736111805879 time 736111545463 state 0x1 ref 1 00000100:00100000:1.0:1789760797.870136:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736111805879 time 736130425941 state 0x0 ref 1 00000100:00100000:1.0:1789760797.870152:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565612544:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.870219:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76189696, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24560 00010000:00010000:1.0:1789760797.870231:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.870252:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.870257:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.870265:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.870281:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.877969:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985909 is committed 00002000:00010000:1.0:1789760797.878204:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76189696 -> 76193792 00002000:00010000:1.0:1789760797.878211:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148832 -> 148840 00010000:00010000:1.0:1789760797.878231:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878247:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878259:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878268:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760797.878274:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878285:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878311:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.878319:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76189696->76193791] (req 76189696->76193791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.878452:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565612544:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8296us (8895us total) trans 4294985909 rc 0/0 00000100:00100000:1.0:1789760797.878466:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18612 00000100:00100000:1.0:1789760797.878479:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736111805879 time 736130425941 state 0x2 ref 0 00000100:00100000:1.0:1789760797.882189:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.882295:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612672 00000100:00100000:2.0:1789760797.882309:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612672 00000100:00100000:2.0:1789760797.882383:0:13445:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736111805879 time 736130425941 state 0x0 ref 1 00000100:00100000:2.0:1789760797.882402:0:13445:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736130686357 time 736130425941 state 0x1 ref 1 00000100:00100000:2.0:1789760797.882470:0:13445:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736130686357 time 736142761891 state 0x0 ref 1 00000100:00100000:2.0:1789760797.882484:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612672:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.882555:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76193792, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24568 00010000:00010000:2.0:1789760797.882566:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.882594:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760797.882600:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.882608:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.882623:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.888351:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985910 is committed 00002000:00010000:2.0:1789760797.888510:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76193792 -> 76197888 00002000:00010000:2.0:1789760797.888600:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148840 -> 148848 00010000:00010000:2.0:1789760797.888622:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888644:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888655:0:13445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888664:0:13445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.888669:0:13445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888679:0:13445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888747:0:13445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.888756:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76193792->76197887] (req 76193792->76197887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.888887:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612672:12345-192.168.203.47@tcp:4:dd.0 Request processed in 6398us (6707us total) trans 4294985910 rc 0/0 00000100:00100000:2.0:1789760797.888900:0:13445:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18613 00000100:00100000:2.0:1789760797.888912:0:13445:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736130686357 time 736142761891 state 0x2 ref 0 00000100:00100000:3.0:1789760797.892760:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.897848:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612800 00000100:00100000:1.0:1789760797.897939:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612800 00000100:00100000:1.0:1789760797.898035:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736130686357 time 736142761891 state 0x0 ref 1 00000100:00100000:1.0:1789760797.898056:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736143022307 time 736142761891 state 0x1 ref 1 00000100:00100000:1.0:1789760797.898983:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736143022307 time 736159266573 state 0x0 ref 1 00000100:00100000:1.0:1789760797.899012:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612800:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.899081:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76197888, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24570 00010000:00010000:1.0:1789760797.899153:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.899225:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.899231:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.899239:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.899253:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.901097:0:5953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760797.905888:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985911 is committed 00002000:00010000:2.0:1789760797.906058:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76197888 -> 76201984 00002000:00010000:2.0:1789760797.906064:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148848 -> 148856 00010000:00010000:2.0:1789760797.906082:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906097:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906108:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906116:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eaac00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.906122:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906131:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906154:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.906162:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007771325a/0x721975f94674fbbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76197888->76201983] (req 76197888->76201983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.906283:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612800:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7275us (13532us total) trans 4294985911 rc 0/0 00000100:00100000:2.0:1789760797.906294:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18614 00000100:00100000:2.0:1789760797.906306:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736143022307 time 736159266573 state 0x2 ref 0 00000100:00100000:3.0:1789760797.908883:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1789760797.909094:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565612928 00000100:00100000:1.0:1789760797.909111:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565612928 00000100:00100000:1.0:1789760797.909189:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736143022307 time 736159266573 state 0x0 ref 1 00000100:00100000:1.0:1789760797.909210:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736159526989 time 736159266573 state 0x1 ref 1 00000100:00100000:1.0:1789760797.909246:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736159526989 time 736169537938 state 0x0 ref 1 00000100:00100000:1.0:1789760797.909262:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612928:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:1.0:1789760797.909325:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76201984, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24578 00010000:00010000:1.0:1789760797.909338:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.909357:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1789760797.909362:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760797.909370:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.909395:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.916376:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985912 is committed 00002000:00010000:0.0:1789760797.916636:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76201984 -> 76206080 00002000:00010000:0.0:1789760797.916643:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148856 -> 148864 00010000:00010000:0.0:1789760797.916662:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916678:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916690:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916699:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41eabe00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.916843:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916857:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916883:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.916892:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f738c9d/0x721975f94674fbc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76201984->76206079] (req 76201984->76206079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.917273:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565612928:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8004us (8387us total) trans 4294985912 rc 0/0 00000100:00100000:0.0:1789760797.917288:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18615 00000100:00100000:0.0:1789760797.917300:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736159526989 time 736169537938 state 0x2 ref 0 00000100:00100000:3.0:1789760797.924291:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.924548:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613056 00000100:00100000:2.0:1789760797.924561:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613056 00000100:00100000:2.0:1789760797.924645:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736159526989 time 736169537938 state 0x0 ref 1 00000100:00100000:2.0:1789760797.924664:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736169798354 time 736169537938 state 0x1 ref 1 00000100:00100000:2.0:1789760797.924697:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736169798354 time 736184987938 state 0x0 ref 1 00000100:00100000:2.0:1789760797.924734:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613056:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.924798:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76206080, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24580 00010000:00010000:2.0:1789760797.924810:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.924831:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760797.924836:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.924845:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.924862:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.928755:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985913 is committed 00002000:00010000:2.0:1789760797.934779:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76206080 -> 76210176 00002000:00010000:2.0:1789760797.934792:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148864 -> 148872 00010000:00010000:2.0:1789760797.934810:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934830:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934839:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934847:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.934852:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934862:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934889:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.934897:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76206080->76210175] (req 76206080->76210175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.935043:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613056:12345-192.168.203.47@tcp:4:dd.0 Request processed in 10304us (10758us total) trans 4294985913 rc 0/0 00000100:00100000:2.0:1789760797.935057:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18616 00000100:00100000:2.0:1789760797.935069:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736169798354 time 736184987938 state 0x2 ref 0 00000100:00100000:3.0:1789760797.938350:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.939825:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613184 00000100:00100000:2.0:1789760797.939851:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613184 00000100:00100000:2.0:1789760797.939946:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736169798354 time 736184987938 state 0x0 ref 1 00000100:00100000:2.0:1789760797.939967:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736185248354 time 736184987938 state 0x1 ref 1 00000100:00100000:2.0:1789760797.940005:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736185248354 time 736200295918 state 0x0 ref 1 00000100:00100000:2.0:1789760797.940021:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613184:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.940092:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76210176, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x24588 00010000:00010000:2.0:1789760797.940104:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.940123:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760797.940128:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.940136:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.940154:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.947641:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985914 is committed 00002000:00010000:2.0:1789760797.947787:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76210176 -> 76214272 00002000:00010000:2.0:1789760797.947793:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760797 -> 1789760798 00002000:00010000:2.0:1789760797.947796:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760797 -> 1789760798 00002000:00010000:2.0:1789760797.947799:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148872 -> 148880 00010000:00010000:2.0:1789760797.947816:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947836:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947845:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947853:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.947859:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947869:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947897:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.947906:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76210176->76214271] (req 76210176->76214271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.948099:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613184:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8074us (9757us total) trans 4294985914 rc 0/0 00000100:00100000:2.0:1789760797.948112:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18617 00000100:00100000:2.0:1789760797.948124:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736185248354 time 736200295918 state 0x2 ref 0 00000100:00100000:3.0:1789760797.957283:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.957412:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613312 00000100:00100000:0.0:1789760797.957425:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613312 00000100:00100000:0.0:1789760797.957509:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736185248354 time 736200295918 state 0x0 ref 1 00000100:00100000:0.0:1789760797.957528:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736200556334 time 736200295918 state 0x1 ref 1 00000100:00100000:0.0:1789760797.957566:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736200556334 time 736217857685 state 0x0 ref 1 00000100:00100000:0.0:1789760797.957592:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565613312:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.957660:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76214272, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x24590 00010000:00010000:0.0:1789760797.957671:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.957690:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760797.957695:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.957730:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.957749:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760797.964933:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760797.964966:0:3459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982d46802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580069888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760797.965058:0:3459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760797.965202:0:13530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699580069888 00000100:00100000:2.0:1789760797.965212:0:13530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699580069888 00000100:00100000:2.0:1789760797.965289:0:13530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789760797.965299:0:13530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580069888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760797.965327:0:13530:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484946496 pending 28672 free 3847495680 avail 3615600640 00000100:00100000:2.0:1789760797.965380:0:13530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1876699580069888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.965388:0:13530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:1.0:1789760797.965554:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760797.965608:0:3459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982d46802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3459:1876699580069888:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789760797.966265:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985915 is committed 00002000:00010000:0.0:1789760797.966678:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76214272 -> 76218368 00002000:00010000:0.0:1789760797.966685:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148880 -> 148888 00010000:00010000:0.0:1789760797.966726:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966741:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966751:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966759:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760797.966765:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966775:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966801:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.966810:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76214272->76218367] (req 76214272->76218367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.966918:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565613312:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9334us (9647us total) trans 4294985915 rc 0/0 00000100:00100000:0.0:1789760797.966930:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18618 00000100:00100000:0.0:1789760797.966942:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736200556334 time 736217857685 state 0x2 ref 0 00000100:00100000:1.0:1789760797.974928:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.975054:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613440 00000100:00100000:2.0:1789760797.975068:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613440 00000100:00100000:2.0:1789760797.975144:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736200556334 time 736217857685 state 0x0 ref 1 00000100:00100000:2.0:1789760797.975163:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736218118101 time 736217857685 state 0x1 ref 1 00000100:00100000:2.0:1789760797.975242:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736218118101 time 736235533248 state 0x0 ref 1 00000100:00100000:2.0:1789760797.975256:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613440:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.975319:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76218368, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x24598 00010000:00010000:2.0:1789760797.975330:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.975349:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760797.975355:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.975363:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.975380:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.984044:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985916 is committed 00002000:00010000:2.0:1789760797.984197:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76218368 -> 76222464 00002000:00010000:2.0:1789760797.984203:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148888 -> 148896 00010000:00010000:2.0:1789760797.984221:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984235:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984245:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984254:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.984260:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984271:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984296:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984304:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76218368->76222463] (req 76218368->76222463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.984425:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613440:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9164us (9505us total) trans 4294985916 rc 0/0 00000100:00100000:2.0:1789760797.984438:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18619 00000100:00100000:2.0:1789760797.984450:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736218118101 time 736235533248 state 0x2 ref 0 00000100:00100000:3.0:1789760797.987179:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760797.987279:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613568 00000100:00100000:2.0:1789760797.987291:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613568 00000100:00100000:2.0:1789760797.987363:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736218118101 time 736235533248 state 0x0 ref 1 00000100:00100000:2.0:1789760797.987380:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736235793664 time 736235533248 state 0x1 ref 1 00000100:00100000:2.0:1789760797.987414:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736235793664 time 736247705798 state 0x0 ref 1 00000100:00100000:2.0:1789760797.987426:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565613568:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760797.987487:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76222464, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245a0 00010000:00010000:2.0:1789760797.987497:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.987516:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760797.987521:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.987529:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.987546:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.992554:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985917 is committed 00002000:00010000:2.0:1789760797.992696:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76222464 -> 76226560 00002000:00010000:2.0:1789760797.992777:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148896 -> 148904 00010000:00010000:2.0:1789760797.992798:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992812:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992822:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992830:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760797.992836:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992846:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992870:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.992879:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76222464->76226559] (req 76222464->76226559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.993119:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565613568:12345-192.168.203.47@tcp:4:dd.0 Request processed in 5686us (5945us total) trans 4294985917 rc 0/0 00000100:00100000:2.0:1789760797.993133:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18620 00000100:00100000:2.0:1789760797.993145:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736235793664 time 736247705798 state 0x2 ref 0 00000100:00100000:3.0:1789760797.999365:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760797.999483:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613696 00000100:00100000:0.0:1789760797.999497:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613696 00000100:00100000:0.0:1789760797.999572:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736235793664 time 736247705798 state 0x0 ref 1 00000100:00100000:0.0:1789760797.999606:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736247966214 time 736247705798 state 0x1 ref 1 00000100:00100000:0.0:1789760797.999648:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736247966214 time 736259939419 state 0x0 ref 1 00000100:00100000:0.0:1789760797.999663:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613696:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760797.999763:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76226560, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245a8 00010000:00010000:0.0:1789760797.999775:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.999795:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760797.999801:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.999809:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.999826:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.007869:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985918 is committed 00002000:00010000:0.0:1789760798.008118:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76226560 -> 76230656 00002000:00010000:0.0:1789760798.008124:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148904 -> 148912 00010000:00010000:0.0:1789760798.008143:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008157:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008167:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008175:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760798.008181:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008191:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008214:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.008223:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fbee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76226560->76230655] (req 76226560->76230655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.008417:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613696:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8749us (9058us total) trans 4294985918 rc 0/0 00000100:00100000:0.0:1789760798.008429:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18621 00000100:00100000:0.0:1789760798.008440:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736247966214 time 736259939419 state 0x2 ref 0 00000100:00100000:1.0:1789760798.019999:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760798.020229:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613824 00000100:00100000:2.0:1789760798.020243:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613824 00000100:00100000:2.0:1789760798.020342:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736247966214 time 736259939419 state 0x0 ref 1 00000100:00100000:2.0:1789760798.020363:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736260199835 time 736259939419 state 0x1 ref 1 00000100:00100000:2.0:1789760798.020390:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736260199835 time 736280682418 state 0x0 ref 1 00000100:00100000:2.0:1789760798.020406:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613824:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760798.020473:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76230656, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245b0 00010000:00010000:2.0:1789760798.020484:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.020504:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760798.020509:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.020516:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.020532:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760798.021832:0:5961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760798.036676:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985919 is committed 00002000:00010000:2.0:1789760798.036902:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76230656 -> 76234752 00002000:00010000:2.0:1789760798.036909:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148912 -> 148920 00010000:00010000:2.0:1789760798.036936:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.036956:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.036966:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.036975:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760798.036981:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.036992:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.037022:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.037031:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fbf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76230656->76234751] (req 76230656->76234751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.037165:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613824:12345-192.168.203.47@tcp:4:dd.0 Request processed in 16755us (17176us total) trans 4294985919 rc 0/0 00000100:00100000:2.0:1789760798.037178:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18622 00000100:00100000:2.0:1789760798.037190:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736260199835 time 736280682418 state 0x2 ref 0 00000100:00100000:3.0:1789760798.040508:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760798.040680:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565613952 00000100:00100000:2.0:1789760798.040695:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565613952 00000100:00100000:2.0:1789760798.040794:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736260199835 time 736280682418 state 0x0 ref 1 00000100:00100000:2.0:1789760798.040816:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736280942834 time 736280682418 state 0x1 ref 1 00000100:00100000:2.0:1789760798.040861:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736280942834 time 736301152325 state 0x0 ref 1 00000100:00100000:2.0:1789760798.040889:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613952:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760798.040967:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76234752, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245b8 00010000:00010000:2.0:1789760798.040980:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.040999:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760798.041004:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.041012:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.041029:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.067146:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985920 is committed 00002000:00010000:3.0:1789760798.075164:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76234752 -> 76238848 00002000:00010000:3.0:1789760798.075180:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148920 -> 148928 00010000:00010000:3.0:1789760798.075199:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075215:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075453:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075462:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760798.075468:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075478:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075506:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.075515:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c9701f/0x721975f94674fbfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76234752->76238847] (req 76234752->76238847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.075670:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565613952:12345-192.168.203.47@tcp:4:dd.0 Request processed in 34777us (35170us total) trans 4294985920 rc 0/0 00000100:00100000:3.0:1789760798.075683:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18623 00000100:00100000:3.0:1789760798.075695:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736280942834 time 736301152325 state 0x2 ref 0 00000100:00100000:3.0:1789760798.084308:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760798.084432:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614080 00000100:00100000:0.0:1789760798.084445:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614080 00000100:00100000:0.0:1789760798.084522:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736280942834 time 736301152325 state 0x0 ref 1 00000100:00100000:0.0:1789760798.084540:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736301412741 time 736301152325 state 0x1 ref 1 00000100:00100000:0.0:1789760798.084577:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736301412741 time 736344868403 state 0x0 ref 1 00000100:00100000:0.0:1789760798.084602:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614080:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760798.084664:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76238848, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245c0 00010000:00010000:0.0:1789760798.084675:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.084695:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760798.084740:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.084749:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.084766:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.095171:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985921 is committed 00002000:00010000:0.0:1789760798.109522:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76238848 -> 76242944 00002000:00010000:0.0:1789760798.109538:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148928 -> 148936 00010000:00010000:0.0:1789760798.109557:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109591:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109602:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109610:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760798.109616:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109626:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109654:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.109662:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76238848->76242943] (req 76238848->76242943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.109838:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614080:12345-192.168.203.47@tcp:4:dd.0 Request processed in 25233us (25538us total) trans 4294985921 rc 0/0 00000100:00100000:0.0:1789760798.109851:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18624 00000100:00100000:0.0:1789760798.109863:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736301412741 time 736344868403 state 0x2 ref 0 00000100:00100000:1.0:1789760798.112386:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760798.112641:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614208 00000100:00100000:2.0:1789760798.112655:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614208 00000100:00100000:2.0:1789760798.112763:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736301412741 time 736344868403 state 0x0 ref 1 00000100:00100000:2.0:1789760798.112783:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736345128819 time 736344868403 state 0x1 ref 1 00000100:00100000:2.0:1789760798.112822:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736345128819 time 736373113954 state 0x0 ref 1 00000100:00100000:2.0:1789760798.112837:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614208:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760798.112903:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76242944, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245c8 00010000:00010000:2.0:1789760798.112915:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.112999:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760798.113005:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.113013:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.113030:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.120224:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985922 is committed 00002000:00010000:3.0:1789760798.120381:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76242944 -> 76247040 00002000:00010000:3.0:1789760798.120387:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148936 -> 148944 00010000:00010000:3.0:1789760798.120406:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120420:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120429:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120441:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271c00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760798.120447:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120456:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120481:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.120489:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078993f00/0x721975f94674fc0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76242944->76247039] (req 76242944->76247039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.120621:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4b41dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614208:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7779us (8237us total) trans 4294985922 rc 0/0 00000100:00100000:3.0:1789760798.120634:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18625 00000100:00100000:3.0:1789760798.120646:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736345128819 time 736373113954 state 0x2 ref 0 00000100:00100000:1.0:1789760798.129603:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760798.130303:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614336 00000100:00100000:3.0:1789760798.130413:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614336 00000100:00100000:3.0:1789760798.130492:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736345128819 time 736373113954 state 0x0 ref 1 00000100:00100000:3.0:1789760798.130513:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736373374370 time 736373113954 state 0x1 ref 1 00000100:00100000:3.0:1789760798.130615:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736373374370 time 736390905711 state 0x0 ref 1 00000100:00100000:3.0:1789760798.130633:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614336:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760798.130747:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76247040, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245d0 00010000:00010000:3.0:1789760798.130760:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.130781:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1789760798.130787:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.130795:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.130812:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.138784:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985923 is committed 00002000:00010000:3.0:1789760798.139235:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76247040 -> 76251136 00002000:00010000:3.0:1789760798.139243:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148944 -> 148952 00010000:00010000:3.0:1789760798.139261:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139277:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139286:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139294:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760798.139300:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139310:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139336:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.139346:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76247040->76251135] (req 76247040->76251135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.139521:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614336:12345-192.168.203.47@tcp:4:dd.0 Request processed in 8882us (9934us total) trans 4294985923 rc 0/0 00000100:00100000:3.0:1789760798.139534:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18626 00000100:00100000:3.0:1789760798.139546:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736373374370 time 736390905711 state 0x2 ref 0 00000100:00100000:2.0:1789760798.147387:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760798.147554:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614464 00000100:00100000:0.0:1789760798.147567:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614464 00000100:00100000:0.0:1789760798.147656:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736373374370 time 736390905711 state 0x0 ref 1 00000100:00100000:0.0:1789760798.147675:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736391166127 time 736390905711 state 0x1 ref 1 00000100:00100000:0.0:1789760798.147753:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736391166127 time 736408044611 state 0x0 ref 1 00000100:00100000:0.0:1789760798.147769:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760798.147840:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76251136, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245d8 00010000:00010000:0.0:1789760798.147851:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.147872:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760798.147877:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.147884:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.147902:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.154191:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985924 is committed 00002000:00010000:2.0:1789760798.155116:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76251136 -> 76255232 00002000:00010000:2.0:1789760798.155126:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148952 -> 148960 00010000:00010000:2.0:1789760798.155146:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155161:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155177:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155186:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea9000 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760798.155192:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155202:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155227:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.155236:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d761edc0/0x721975f94674fc18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76251136->76255231] (req 76251136->76255231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.155377:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 7603us (7996us total) trans 4294985924 rc 0/0 00000100:00100000:2.0:1789760798.155390:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18627 00000100:00100000:2.0:1789760798.155402:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736391166127 time 736408044611 state 0x2 ref 0 00000100:00100000:1.0:1789760798.162647:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760798.163910:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614592 00000100:00100000:3.0:1789760798.163928:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614592 00000100:00100000:3.0:1789760798.164017:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736391166127 time 736408044611 state 0x0 ref 1 00000100:00100000:3.0:1789760798.164037:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736408305027 time 736408044611 state 0x1 ref 1 00000100:00100000:3.0:1789760798.164115:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736408305027 time 736424405608 state 0x0 ref 1 00000100:00100000:3.0:1789760798.164131:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614592:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760798.164198:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76255232, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245e0 00010000:00010000:3.0:1789760798.164211:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.164232:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1789760798.164236:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.164244:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.164262:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.172931:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985925 is committed 00002000:00010000:3.0:1789760798.173194:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76255232 -> 76259328 00002000:00010000:3.0:1789760798.173200:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148960 -> 148968 00010000:00010000:3.0:1789760798.173219:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173234:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173245:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173253:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:3.0:1789760798.173259:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173268:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173295:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.173304:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76255232->76259327] (req 76255232->76259327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.173432:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982e6fe28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 9298us (10792us total) trans 4294985925 rc 0/0 00000100:00100000:3.0:1789760798.173443:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18628 00000100:00100000:3.0:1789760798.173454:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736408305027 time 736424405608 state 0x2 ref 0 00000100:00100000:1.0:1789760798.179491:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1789760798.179599:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614720 00000100:00100000:3.0:1789760798.179612:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614720 00000100:00100000:3.0:1789760798.179686:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736408305027 time 736424405608 state 0x0 ref 1 00000100:00100000:3.0:1789760798.179759:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736424666024 time 736424405608 state 0x1 ref 1 00000100:00100000:3.0:1789760798.179794:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736424666024 time 736440085087 state 0x0 ref 1 00000100:00100000:3.0:1789760798.179809:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614720:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1789760798.179873:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76259328, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245e8 00010000:00010000:3.0:1789760798.179885:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.179914:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1789760798.179921:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.179928:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.179949:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760798.191847:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985926 is committed 00002000:00010000:1.0:1789760798.192467:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76259328 -> 76263424 00002000:00010000:1.0:1789760798.192673:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148968 -> 148976 00010000:00010000:1.0:1789760798.192693:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192791:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192801:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192811:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982e6f5ee600 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:1.0:1789760798.192816:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192827:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192853:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.192863:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d484d550/0x721975f94674fc26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76259328->76263423] (req 76259328->76263423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760798.193252:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d47748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2357:x1876699565614720:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13438us (13769us total) trans 4294985926 rc 0/0 00000100:00100000:1.0:1789760798.193265:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18629 00000100:00100000:1.0:1789760798.193277:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736424666024 time 736440085087 state 0x2 ref 0 00000100:00100000:2.0:1789760798.201826:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760798.201985:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614848 00000100:00100000:0.0:1789760798.201998:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614848 00000100:00100000:0.0:1789760798.202091:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736424666024 time 736440085087 state 0x0 ref 1 00000100:00100000:0.0:1789760798.202109:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736440345503 time 736440085087 state 0x1 ref 1 00000100:00100000:0.0:1789760798.202147:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736440345503 time 736462438740 state 0x0 ref 1 00000100:00100000:0.0:1789760798.202163:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614848:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760798.202231:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76263424, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245f0 00010000:00010000:0.0:1789760798.202243:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.202263:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760798.202268:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.202276:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.202295:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760798.211987:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985927 is committed 00002000:00010000:0.0:1789760798.213063:0:6959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76263424 -> 76267520 00002000:00010000:0.0:1789760798.213074:0:6959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148976 -> 148984 00010000:00010000:0.0:1789760798.213093:0:6959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213109:0:6959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213119:0:6959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213134:0:6959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:0.0:1789760798.213140:0:6959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213151:0:6959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213174:0:6959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.213182:0:6959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76263424->76267519] (req 76263424->76267519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.213308:0:6959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d45018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565614848:12345-192.168.203.47@tcp:4:dd.0 Request processed in 11142us (11490us total) trans 4294985927 rc 0/0 00000100:00100000:0.0:1789760798.213321:0:6959:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18630 00000100:00100000:0.0:1789760798.213333:0:6959:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736440345503 time 736462438740 state 0x2 ref 0 00000100:00100000:3.0:1789760798.222544:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760798.222691:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565614976 00000100:00100000:0.0:1789760798.222749:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565614976 00000100:00100000:0.0:1789760798.222828:0:6957:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736440345503 time 736462438740 state 0x0 ref 1 00000100:00100000:0.0:1789760798.222849:0:6957:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736462699156 time 736462438740 state 0x1 ref 1 00000100:00100000:0.0:1789760798.222888:0:6957:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736462699156 time 736483179406 state 0x0 ref 1 00000100:00100000:0.0:1789760798.222906:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565614976:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760798.222984:0:6957:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76267520, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x245f8 00010000:00010000:0.0:1789760798.222995:0:6957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.223017:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760798.223022:0:6957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.223030:0:6957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.223064:0:6957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760798.232812:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985928 is committed 00002000:00010000:2.0:1789760798.236222:0:6957:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76267520 -> 76271616 00002000:00010000:2.0:1789760798.236236:0:6957:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148984 -> 148992 00010000:00010000:2.0:1789760798.236254:0:6957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236270:0:6957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236281:0:6957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236289:0:6957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d41ea8800 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760798.236295:0:6957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236305:0:6957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236340:0:6957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.236349:0:6957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b99847/0x721975f94674fc34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76267520->76271615] (req 76267520->76271615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.236486:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d477c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565614976:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13575us (13948us total) trans 4294985928 rc 0/0 00000100:00100000:2.0:1789760798.236500:0:6957:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18631 00000100:00100000:2.0:1789760798.236511:0:6957:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736462699156 time 736483179406 state 0x2 ref 0 00000100:00100000:1.0:1789760798.239675:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1789760798.239880:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565615104 00000100:00100000:2.0:1789760798.239894:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565615104 00000100:00100000:2.0:1789760798.239974:0:13444:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736462699156 time 736483179406 state 0x0 ref 1 00000100:00100000:2.0:1789760798.239993:0:13444:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736483439822 time 736483179406 state 0x1 ref 1 00000100:00100000:2.0:1789760798.240024:0:13444:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736483439822 time 736500316670 state 0x0 ref 1 00000100:00100000:2.0:1789760798.240187:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565615104:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:2.0:1789760798.240251:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76271616, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x24600 00010000:00010000:2.0:1789760798.240262:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.240281:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1789760798.240286:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.240293:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.240319:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760798.248369:0:6946:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294985929 is committed 00002000:00010000:2.0:1789760798.252909:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76271616 -> 76275712 00002000:00010000:2.0:1789760798.253002:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 148992 -> 149000 00010000:00010000:2.0:1789760798.253024:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253120:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253139:0:13444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253150:0:13444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982d42271e00 already unused, calling callback (ffffffffc0dae350) 00010000:00010000:2.0:1789760798.253156:0:13444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253168:0:13444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253194:0:13444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.253203:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d4945e/0x721975f94674fc3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76271616->76275711] (req 76271616->76275711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.253404:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982d4774b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2358:x1876699565615104:12345-192.168.203.47@tcp:4:dd.0 Request processed in 13361us (13735us total) trans 4294985929 rc 0/0 00000100:00100000:2.0:1789760798.253418:0:13444:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.47@tcp, seq: 18632 00000100:00100000:2.0:1789760798.253430:0:13444:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736483439822 time 736500316670 state 0x2 ref 0 00000100:00100000:3.0:1789760798.259363:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1789760798.259794:0:6959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699565615232 00000100:00100000:0.0:1789760798.259806:0:6959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699565615232 00000100:00100000:0.0:1789760798.259889:0:6959:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736483439822 time 736500316670 state 0x0 ref 1 00000100:00100000:0.0:1789760798.259910:0:6959:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736500577086 time 736500316670 state 0x1 ref 1 00000100:00100000:0.0:1789760798.259954:0:6959:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff982e6f7e4800 key nid={192.168.203.47@tcp}&opcode={ost_write} rule@0xffff982e412e7a00 gen 0 rate 15 depth 3 token 3 deadline 736500577086 time 736520245890 state 0x0 ref 1 00000100:00100000:0.0:1789760798.259969:0:6959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982d413ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1b6a8abb-fb57-4aa0-bd98-6434ab8cc627+5:2359:x1876699565615232:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:0.0:1789760798.260036:0:6959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76275712, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x24608 00010000:00010000:0.0:1789760798.260475:0:6959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674fc42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.260500:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1789760798.260505:0:6959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.260513:0:6959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674fc42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76275712->76279807] (req 76275712->76279807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.260541:0:6959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02033b6/0x721975f94674fc42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76275712->76279807] (req 76275712->76279807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 Debug log: 57072 lines, 57072 kept, 0 dropped, 0 bad.